00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2409 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3670 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.200 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.201 The recommended git tool is: git 00:00:00.201 using credential 00000000-0000-0000-0000-000000000002 00:00:00.203 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.230 Fetching changes from the remote Git repository 00:00:00.231 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.260 Using shallow fetch with depth 1 00:00:00.260 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.260 > git --version # timeout=10 00:00:00.279 > git --version # 'git version 2.39.2' 00:00:00.279 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.291 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.291 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:07.027 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:07.040 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:07.051 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:07.051 > git config core.sparsecheckout # timeout=10 00:00:07.062 > git read-tree -mu HEAD # timeout=10 00:00:07.078 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:07.110 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:07.110 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:07.213 [Pipeline] Start of Pipeline 00:00:07.228 [Pipeline] library 00:00:07.230 Loading library shm_lib@master 00:00:07.230 Library shm_lib@master is cached. Copying from home. 00:00:07.249 [Pipeline] node 00:00:07.282 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:07.283 [Pipeline] { 00:00:07.294 [Pipeline] catchError 00:00:07.295 [Pipeline] { 00:00:07.306 [Pipeline] wrap 00:00:07.313 [Pipeline] { 00:00:07.318 [Pipeline] stage 00:00:07.319 [Pipeline] { (Prologue) 00:00:07.511 [Pipeline] sh 00:00:08.475 + logger -p user.info -t JENKINS-CI 00:00:08.506 [Pipeline] echo 00:00:08.507 Node: GP11 00:00:08.513 [Pipeline] sh 00:00:08.863 [Pipeline] setCustomBuildProperty 00:00:08.876 [Pipeline] echo 00:00:08.878 Cleanup processes 00:00:08.886 [Pipeline] sh 00:00:09.189 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:09.189 6631 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:09.202 [Pipeline] sh 00:00:09.492 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:09.492 ++ grep -v 'sudo pgrep' 00:00:09.492 ++ awk '{print $1}' 00:00:09.492 + sudo kill -9 00:00:09.492 + true 00:00:09.508 [Pipeline] cleanWs 00:00:09.519 [WS-CLEANUP] Deleting project workspace... 00:00:09.519 [WS-CLEANUP] Deferred wipeout is used... 00:00:09.535 [WS-CLEANUP] done 00:00:09.539 [Pipeline] setCustomBuildProperty 00:00:09.551 [Pipeline] sh 00:00:09.842 + sudo git config --global --replace-all safe.directory '*' 00:00:09.949 [Pipeline] httpRequest 00:00:12.187 [Pipeline] echo 00:00:12.189 Sorcerer 10.211.164.20 is alive 00:00:12.199 [Pipeline] retry 00:00:12.201 [Pipeline] { 00:00:12.215 [Pipeline] httpRequest 00:00:12.220 HttpMethod: GET 00:00:12.221 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:12.223 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:12.235 Response Code: HTTP/1.1 200 OK 00:00:12.235 Success: Status code 200 is in the accepted range: 200,404 00:00:12.235 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:19.152 [Pipeline] } 00:00:19.171 [Pipeline] // retry 00:00:19.179 [Pipeline] sh 00:00:19.479 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:19.500 [Pipeline] httpRequest 00:00:19.898 [Pipeline] echo 00:00:19.900 Sorcerer 10.211.164.20 is alive 00:00:19.911 [Pipeline] retry 00:00:19.913 [Pipeline] { 00:00:19.928 [Pipeline] httpRequest 00:00:19.933 HttpMethod: GET 00:00:19.934 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:19.935 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:19.943 Response Code: HTTP/1.1 200 OK 00:00:19.944 Success: Status code 200 is in the accepted range: 200,404 00:00:19.944 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:14.919 [Pipeline] } 00:01:14.936 [Pipeline] // retry 00:01:14.944 [Pipeline] sh 00:01:15.242 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:18.573 [Pipeline] sh 00:01:18.866 + git -C spdk log --oneline -n5 00:01:18.866 c13c99a5e test: Various fixes for Fedora40 00:01:18.866 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:18.866 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:18.866 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:18.866 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:18.878 [Pipeline] } 00:01:18.890 [Pipeline] // stage 00:01:18.897 [Pipeline] stage 00:01:18.899 [Pipeline] { (Prepare) 00:01:18.913 [Pipeline] writeFile 00:01:18.926 [Pipeline] sh 00:01:19.215 + logger -p user.info -t JENKINS-CI 00:01:19.230 [Pipeline] sh 00:01:19.522 + logger -p user.info -t JENKINS-CI 00:01:19.537 [Pipeline] sh 00:01:19.829 + cat autorun-spdk.conf 00:01:19.830 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:19.830 SPDK_TEST_NVMF=1 00:01:19.830 SPDK_TEST_NVME_CLI=1 00:01:19.830 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:19.830 SPDK_TEST_NVMF_NICS=e810 00:01:19.830 SPDK_RUN_UBSAN=1 00:01:19.830 NET_TYPE=phy 00:01:19.840 RUN_NIGHTLY=1 00:01:19.845 [Pipeline] readFile 00:01:19.906 [Pipeline] withEnv 00:01:19.908 [Pipeline] { 00:01:19.921 [Pipeline] sh 00:01:20.219 + set -ex 00:01:20.219 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:20.219 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:20.219 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.219 ++ SPDK_TEST_NVMF=1 00:01:20.219 ++ SPDK_TEST_NVME_CLI=1 00:01:20.219 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.219 ++ SPDK_TEST_NVMF_NICS=e810 00:01:20.219 ++ SPDK_RUN_UBSAN=1 00:01:20.219 ++ NET_TYPE=phy 00:01:20.219 ++ RUN_NIGHTLY=1 00:01:20.219 + case $SPDK_TEST_NVMF_NICS in 00:01:20.219 + DRIVERS=ice 00:01:20.219 + [[ tcp == \r\d\m\a ]] 00:01:20.219 + [[ -n ice ]] 00:01:20.219 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:20.219 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:23.528 rmmod: ERROR: Module irdma is not currently loaded 00:01:23.528 rmmod: ERROR: Module i40iw is not currently loaded 00:01:23.528 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:23.528 + true 00:01:23.528 + for D in $DRIVERS 00:01:23.528 + sudo modprobe ice 00:01:23.528 + exit 0 00:01:23.540 [Pipeline] } 00:01:23.555 [Pipeline] // withEnv 00:01:23.560 [Pipeline] } 00:01:23.574 [Pipeline] // stage 00:01:23.584 [Pipeline] catchError 00:01:23.586 [Pipeline] { 00:01:23.599 [Pipeline] timeout 00:01:23.599 Timeout set to expire in 1 hr 0 min 00:01:23.601 [Pipeline] { 00:01:23.614 [Pipeline] stage 00:01:23.617 [Pipeline] { (Tests) 00:01:23.631 [Pipeline] sh 00:01:23.931 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.931 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.931 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.931 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:23.931 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:23.931 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:23.931 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:23.931 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:23.931 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:23.931 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:23.931 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:23.931 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.931 + source /etc/os-release 00:01:23.931 ++ NAME='Fedora Linux' 00:01:23.931 ++ VERSION='39 (Cloud Edition)' 00:01:23.931 ++ ID=fedora 00:01:23.931 ++ VERSION_ID=39 00:01:23.931 ++ VERSION_CODENAME= 00:01:23.931 ++ PLATFORM_ID=platform:f39 00:01:23.931 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:23.931 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:23.931 ++ LOGO=fedora-logo-icon 00:01:23.931 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:23.931 ++ HOME_URL=https://fedoraproject.org/ 00:01:23.931 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:23.931 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:23.931 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:23.931 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:23.931 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:23.931 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:23.931 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:23.931 ++ SUPPORT_END=2024-11-12 00:01:23.931 ++ VARIANT='Cloud Edition' 00:01:23.931 ++ VARIANT_ID=cloud 00:01:23.931 + uname -a 00:01:23.931 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:23.931 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:24.872 Hugepages 00:01:24.873 node hugesize free / total 00:01:24.873 node0 1048576kB 0 / 0 00:01:24.873 node0 2048kB 0 / 0 00:01:24.873 node1 1048576kB 0 / 0 00:01:24.873 node1 2048kB 0 / 0 00:01:24.873 00:01:24.873 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:24.873 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:24.873 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:24.873 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:24.873 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:24.873 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:24.873 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:24.873 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:24.873 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:24.873 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:24.873 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:24.873 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:24.873 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:24.873 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:24.873 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:24.873 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:24.873 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:25.133 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:25.133 + rm -f /tmp/spdk-ld-path 00:01:25.133 + source autorun-spdk.conf 00:01:25.133 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.133 ++ SPDK_TEST_NVMF=1 00:01:25.133 ++ SPDK_TEST_NVME_CLI=1 00:01:25.133 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.133 ++ SPDK_TEST_NVMF_NICS=e810 00:01:25.133 ++ SPDK_RUN_UBSAN=1 00:01:25.133 ++ NET_TYPE=phy 00:01:25.133 ++ RUN_NIGHTLY=1 00:01:25.133 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:25.133 + [[ -n '' ]] 00:01:25.133 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.133 + for M in /var/spdk/build-*-manifest.txt 00:01:25.133 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:25.133 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.133 + for M in /var/spdk/build-*-manifest.txt 00:01:25.133 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:25.133 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.133 + for M in /var/spdk/build-*-manifest.txt 00:01:25.133 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:25.133 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.133 ++ uname 00:01:25.133 + [[ Linux == \L\i\n\u\x ]] 00:01:25.133 + sudo dmesg -T 00:01:25.133 + sudo dmesg --clear 00:01:25.133 + dmesg_pid=7323 00:01:25.133 + [[ Fedora Linux == FreeBSD ]] 00:01:25.133 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.133 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.133 + sudo dmesg -Tw 00:01:25.133 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:25.133 + [[ -x /usr/src/fio-static/fio ]] 00:01:25.133 + export FIO_BIN=/usr/src/fio-static/fio 00:01:25.133 + FIO_BIN=/usr/src/fio-static/fio 00:01:25.133 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:25.133 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:25.133 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:25.133 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.133 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.133 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:25.133 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.133 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.133 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:25.133 Test configuration: 00:01:25.133 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.133 SPDK_TEST_NVMF=1 00:01:25.133 SPDK_TEST_NVME_CLI=1 00:01:25.133 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.133 SPDK_TEST_NVMF_NICS=e810 00:01:25.133 SPDK_RUN_UBSAN=1 00:01:25.133 NET_TYPE=phy 00:01:25.133 RUN_NIGHTLY=1 22:53:51 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:25.133 22:53:51 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:25.133 22:53:51 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:25.133 22:53:51 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:25.133 22:53:51 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:25.133 22:53:51 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.133 22:53:51 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.133 22:53:51 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.133 22:53:51 -- paths/export.sh@5 -- $ export PATH 00:01:25.133 22:53:51 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.133 22:53:51 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:25.133 22:53:51 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:25.133 22:53:51 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732658031.XXXXXX 00:01:25.133 22:53:51 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732658031.KdwErp 00:01:25.133 22:53:51 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:25.133 22:53:51 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:25.133 22:53:51 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:25.133 22:53:51 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:25.133 22:53:51 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:25.133 22:53:51 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:25.133 22:53:51 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:25.133 22:53:51 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.133 22:53:51 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:25.133 22:53:51 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:25.133 22:53:51 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:25.133 22:53:51 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.133 22:53:51 -- spdk/autobuild.sh@16 -- $ date -u 00:01:25.133 Tue Nov 26 09:53:51 PM UTC 2024 00:01:25.133 22:53:51 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:25.133 LTS-67-gc13c99a5e 00:01:25.133 22:53:51 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:25.133 22:53:51 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:25.133 22:53:51 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:25.133 22:53:51 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:25.133 22:53:51 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:25.133 22:53:51 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.133 ************************************ 00:01:25.133 START TEST ubsan 00:01:25.133 ************************************ 00:01:25.133 22:53:51 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:25.133 using ubsan 00:01:25.133 00:01:25.133 real 0m0.000s 00:01:25.133 user 0m0.000s 00:01:25.133 sys 0m0.000s 00:01:25.133 22:53:51 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:25.133 22:53:51 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.133 ************************************ 00:01:25.133 END TEST ubsan 00:01:25.133 ************************************ 00:01:25.133 22:53:51 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:25.133 22:53:51 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:25.133 22:53:51 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:25.134 22:53:51 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:25.134 22:53:51 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:25.134 22:53:51 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:25.134 22:53:51 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:25.134 22:53:51 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:25.134 22:53:51 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:25.395 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:25.395 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:26.788 Using 'verbs' RDMA provider 00:01:39.601 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:49.609 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:49.609 Creating mk/config.mk...done. 00:01:49.609 Creating mk/cc.flags.mk...done. 00:01:49.609 Type 'make' to build. 00:01:49.609 22:54:15 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:49.609 22:54:15 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:49.609 22:54:15 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:49.609 22:54:15 -- common/autotest_common.sh@10 -- $ set +x 00:01:49.609 ************************************ 00:01:49.609 START TEST make 00:01:49.609 ************************************ 00:01:49.609 22:54:15 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:49.609 make[1]: Nothing to be done for 'all'. 00:01:59.639 The Meson build system 00:01:59.639 Version: 1.5.0 00:01:59.639 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:59.639 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:59.639 Build type: native build 00:01:59.639 Program cat found: YES (/usr/bin/cat) 00:01:59.639 Project name: DPDK 00:01:59.639 Project version: 23.11.0 00:01:59.639 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:59.639 C linker for the host machine: cc ld.bfd 2.40-14 00:01:59.639 Host machine cpu family: x86_64 00:01:59.639 Host machine cpu: x86_64 00:01:59.639 Message: ## Building in Developer Mode ## 00:01:59.639 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:59.639 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:59.639 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:59.639 Program python3 found: YES (/usr/bin/python3) 00:01:59.639 Program cat found: YES (/usr/bin/cat) 00:01:59.639 Compiler for C supports arguments -march=native: YES 00:01:59.639 Checking for size of "void *" : 8 00:01:59.639 Checking for size of "void *" : 8 (cached) 00:01:59.639 Library m found: YES 00:01:59.639 Library numa found: YES 00:01:59.639 Has header "numaif.h" : YES 00:01:59.639 Library fdt found: NO 00:01:59.639 Library execinfo found: NO 00:01:59.640 Has header "execinfo.h" : YES 00:01:59.640 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:59.640 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:59.640 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:59.640 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:59.640 Run-time dependency openssl found: YES 3.1.1 00:01:59.640 Run-time dependency libpcap found: YES 1.10.4 00:01:59.640 Has header "pcap.h" with dependency libpcap: YES 00:01:59.640 Compiler for C supports arguments -Wcast-qual: YES 00:01:59.640 Compiler for C supports arguments -Wdeprecated: YES 00:01:59.640 Compiler for C supports arguments -Wformat: YES 00:01:59.640 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:59.640 Compiler for C supports arguments -Wformat-security: NO 00:01:59.640 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:59.640 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:59.640 Compiler for C supports arguments -Wnested-externs: YES 00:01:59.640 Compiler for C supports arguments -Wold-style-definition: YES 00:01:59.640 Compiler for C supports arguments -Wpointer-arith: YES 00:01:59.640 Compiler for C supports arguments -Wsign-compare: YES 00:01:59.640 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:59.640 Compiler for C supports arguments -Wundef: YES 00:01:59.640 Compiler for C supports arguments -Wwrite-strings: YES 00:01:59.640 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:59.640 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:59.640 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:59.640 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:59.640 Program objdump found: YES (/usr/bin/objdump) 00:01:59.640 Compiler for C supports arguments -mavx512f: YES 00:01:59.640 Checking if "AVX512 checking" compiles: YES 00:01:59.640 Fetching value of define "__SSE4_2__" : 1 00:01:59.640 Fetching value of define "__AES__" : 1 00:01:59.640 Fetching value of define "__AVX__" : 1 00:01:59.640 Fetching value of define "__AVX2__" : (undefined) 00:01:59.640 Fetching value of define "__AVX512BW__" : (undefined) 00:01:59.640 Fetching value of define "__AVX512CD__" : (undefined) 00:01:59.640 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:59.640 Fetching value of define "__AVX512F__" : (undefined) 00:01:59.640 Fetching value of define "__AVX512VL__" : (undefined) 00:01:59.640 Fetching value of define "__PCLMUL__" : 1 00:01:59.640 Fetching value of define "__RDRND__" : 1 00:01:59.640 Fetching value of define "__RDSEED__" : (undefined) 00:01:59.640 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:59.640 Fetching value of define "__znver1__" : (undefined) 00:01:59.640 Fetching value of define "__znver2__" : (undefined) 00:01:59.640 Fetching value of define "__znver3__" : (undefined) 00:01:59.640 Fetching value of define "__znver4__" : (undefined) 00:01:59.640 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:59.640 Message: lib/log: Defining dependency "log" 00:01:59.640 Message: lib/kvargs: Defining dependency "kvargs" 00:01:59.640 Message: lib/telemetry: Defining dependency "telemetry" 00:01:59.640 Checking for function "getentropy" : NO 00:01:59.640 Message: lib/eal: Defining dependency "eal" 00:01:59.640 Message: lib/ring: Defining dependency "ring" 00:01:59.640 Message: lib/rcu: Defining dependency "rcu" 00:01:59.640 Message: lib/mempool: Defining dependency "mempool" 00:01:59.640 Message: lib/mbuf: Defining dependency "mbuf" 00:01:59.640 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:59.640 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:59.640 Compiler for C supports arguments -mpclmul: YES 00:01:59.640 Compiler for C supports arguments -maes: YES 00:01:59.640 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:59.640 Compiler for C supports arguments -mavx512bw: YES 00:01:59.640 Compiler for C supports arguments -mavx512dq: YES 00:01:59.640 Compiler for C supports arguments -mavx512vl: YES 00:01:59.640 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:59.640 Compiler for C supports arguments -mavx2: YES 00:01:59.640 Compiler for C supports arguments -mavx: YES 00:01:59.640 Message: lib/net: Defining dependency "net" 00:01:59.640 Message: lib/meter: Defining dependency "meter" 00:01:59.640 Message: lib/ethdev: Defining dependency "ethdev" 00:01:59.640 Message: lib/pci: Defining dependency "pci" 00:01:59.640 Message: lib/cmdline: Defining dependency "cmdline" 00:01:59.640 Message: lib/hash: Defining dependency "hash" 00:01:59.640 Message: lib/timer: Defining dependency "timer" 00:01:59.640 Message: lib/compressdev: Defining dependency "compressdev" 00:01:59.640 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:59.640 Message: lib/dmadev: Defining dependency "dmadev" 00:01:59.640 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:59.640 Message: lib/power: Defining dependency "power" 00:01:59.640 Message: lib/reorder: Defining dependency "reorder" 00:01:59.640 Message: lib/security: Defining dependency "security" 00:01:59.640 Has header "linux/userfaultfd.h" : YES 00:01:59.640 Has header "linux/vduse.h" : YES 00:01:59.640 Message: lib/vhost: Defining dependency "vhost" 00:01:59.640 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:59.640 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:59.640 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:59.640 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:59.640 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:59.640 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:59.640 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:59.640 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:59.640 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:59.640 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:59.640 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:59.640 Configuring doxy-api-html.conf using configuration 00:01:59.640 Configuring doxy-api-man.conf using configuration 00:01:59.640 Program mandb found: YES (/usr/bin/mandb) 00:01:59.640 Program sphinx-build found: NO 00:01:59.640 Configuring rte_build_config.h using configuration 00:01:59.640 Message: 00:01:59.640 ================= 00:01:59.640 Applications Enabled 00:01:59.640 ================= 00:01:59.640 00:01:59.640 apps: 00:01:59.640 00:01:59.640 00:01:59.640 Message: 00:01:59.640 ================= 00:01:59.640 Libraries Enabled 00:01:59.640 ================= 00:01:59.640 00:01:59.640 libs: 00:01:59.640 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:59.640 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:59.640 cryptodev, dmadev, power, reorder, security, vhost, 00:01:59.640 00:01:59.640 Message: 00:01:59.640 =============== 00:01:59.640 Drivers Enabled 00:01:59.640 =============== 00:01:59.640 00:01:59.640 common: 00:01:59.640 00:01:59.640 bus: 00:01:59.640 pci, vdev, 00:01:59.640 mempool: 00:01:59.640 ring, 00:01:59.640 dma: 00:01:59.640 00:01:59.640 net: 00:01:59.640 00:01:59.640 crypto: 00:01:59.640 00:01:59.640 compress: 00:01:59.640 00:01:59.640 vdpa: 00:01:59.640 00:01:59.640 00:01:59.640 Message: 00:01:59.640 ================= 00:01:59.640 Content Skipped 00:01:59.640 ================= 00:01:59.640 00:01:59.640 apps: 00:01:59.640 dumpcap: explicitly disabled via build config 00:01:59.640 graph: explicitly disabled via build config 00:01:59.640 pdump: explicitly disabled via build config 00:01:59.640 proc-info: explicitly disabled via build config 00:01:59.640 test-acl: explicitly disabled via build config 00:01:59.640 test-bbdev: explicitly disabled via build config 00:01:59.640 test-cmdline: explicitly disabled via build config 00:01:59.640 test-compress-perf: explicitly disabled via build config 00:01:59.640 test-crypto-perf: explicitly disabled via build config 00:01:59.640 test-dma-perf: explicitly disabled via build config 00:01:59.640 test-eventdev: explicitly disabled via build config 00:01:59.640 test-fib: explicitly disabled via build config 00:01:59.640 test-flow-perf: explicitly disabled via build config 00:01:59.640 test-gpudev: explicitly disabled via build config 00:01:59.640 test-mldev: explicitly disabled via build config 00:01:59.640 test-pipeline: explicitly disabled via build config 00:01:59.640 test-pmd: explicitly disabled via build config 00:01:59.640 test-regex: explicitly disabled via build config 00:01:59.640 test-sad: explicitly disabled via build config 00:01:59.640 test-security-perf: explicitly disabled via build config 00:01:59.640 00:01:59.640 libs: 00:01:59.640 metrics: explicitly disabled via build config 00:01:59.640 acl: explicitly disabled via build config 00:01:59.640 bbdev: explicitly disabled via build config 00:01:59.640 bitratestats: explicitly disabled via build config 00:01:59.640 bpf: explicitly disabled via build config 00:01:59.640 cfgfile: explicitly disabled via build config 00:01:59.640 distributor: explicitly disabled via build config 00:01:59.640 efd: explicitly disabled via build config 00:01:59.640 eventdev: explicitly disabled via build config 00:01:59.640 dispatcher: explicitly disabled via build config 00:01:59.640 gpudev: explicitly disabled via build config 00:01:59.640 gro: explicitly disabled via build config 00:01:59.640 gso: explicitly disabled via build config 00:01:59.640 ip_frag: explicitly disabled via build config 00:01:59.640 jobstats: explicitly disabled via build config 00:01:59.640 latencystats: explicitly disabled via build config 00:01:59.640 lpm: explicitly disabled via build config 00:01:59.640 member: explicitly disabled via build config 00:01:59.640 pcapng: explicitly disabled via build config 00:01:59.640 rawdev: explicitly disabled via build config 00:01:59.640 regexdev: explicitly disabled via build config 00:01:59.640 mldev: explicitly disabled via build config 00:01:59.641 rib: explicitly disabled via build config 00:01:59.641 sched: explicitly disabled via build config 00:01:59.641 stack: explicitly disabled via build config 00:01:59.641 ipsec: explicitly disabled via build config 00:01:59.641 pdcp: explicitly disabled via build config 00:01:59.641 fib: explicitly disabled via build config 00:01:59.641 port: explicitly disabled via build config 00:01:59.641 pdump: explicitly disabled via build config 00:01:59.641 table: explicitly disabled via build config 00:01:59.641 pipeline: explicitly disabled via build config 00:01:59.641 graph: explicitly disabled via build config 00:01:59.641 node: explicitly disabled via build config 00:01:59.641 00:01:59.641 drivers: 00:01:59.641 common/cpt: not in enabled drivers build config 00:01:59.641 common/dpaax: not in enabled drivers build config 00:01:59.641 common/iavf: not in enabled drivers build config 00:01:59.641 common/idpf: not in enabled drivers build config 00:01:59.641 common/mvep: not in enabled drivers build config 00:01:59.641 common/octeontx: not in enabled drivers build config 00:01:59.641 bus/auxiliary: not in enabled drivers build config 00:01:59.641 bus/cdx: not in enabled drivers build config 00:01:59.641 bus/dpaa: not in enabled drivers build config 00:01:59.641 bus/fslmc: not in enabled drivers build config 00:01:59.641 bus/ifpga: not in enabled drivers build config 00:01:59.641 bus/platform: not in enabled drivers build config 00:01:59.641 bus/vmbus: not in enabled drivers build config 00:01:59.641 common/cnxk: not in enabled drivers build config 00:01:59.641 common/mlx5: not in enabled drivers build config 00:01:59.641 common/nfp: not in enabled drivers build config 00:01:59.641 common/qat: not in enabled drivers build config 00:01:59.641 common/sfc_efx: not in enabled drivers build config 00:01:59.641 mempool/bucket: not in enabled drivers build config 00:01:59.641 mempool/cnxk: not in enabled drivers build config 00:01:59.641 mempool/dpaa: not in enabled drivers build config 00:01:59.641 mempool/dpaa2: not in enabled drivers build config 00:01:59.641 mempool/octeontx: not in enabled drivers build config 00:01:59.641 mempool/stack: not in enabled drivers build config 00:01:59.641 dma/cnxk: not in enabled drivers build config 00:01:59.641 dma/dpaa: not in enabled drivers build config 00:01:59.641 dma/dpaa2: not in enabled drivers build config 00:01:59.641 dma/hisilicon: not in enabled drivers build config 00:01:59.641 dma/idxd: not in enabled drivers build config 00:01:59.641 dma/ioat: not in enabled drivers build config 00:01:59.641 dma/skeleton: not in enabled drivers build config 00:01:59.641 net/af_packet: not in enabled drivers build config 00:01:59.641 net/af_xdp: not in enabled drivers build config 00:01:59.641 net/ark: not in enabled drivers build config 00:01:59.641 net/atlantic: not in enabled drivers build config 00:01:59.641 net/avp: not in enabled drivers build config 00:01:59.641 net/axgbe: not in enabled drivers build config 00:01:59.641 net/bnx2x: not in enabled drivers build config 00:01:59.641 net/bnxt: not in enabled drivers build config 00:01:59.641 net/bonding: not in enabled drivers build config 00:01:59.641 net/cnxk: not in enabled drivers build config 00:01:59.641 net/cpfl: not in enabled drivers build config 00:01:59.641 net/cxgbe: not in enabled drivers build config 00:01:59.641 net/dpaa: not in enabled drivers build config 00:01:59.641 net/dpaa2: not in enabled drivers build config 00:01:59.641 net/e1000: not in enabled drivers build config 00:01:59.641 net/ena: not in enabled drivers build config 00:01:59.641 net/enetc: not in enabled drivers build config 00:01:59.641 net/enetfec: not in enabled drivers build config 00:01:59.641 net/enic: not in enabled drivers build config 00:01:59.641 net/failsafe: not in enabled drivers build config 00:01:59.641 net/fm10k: not in enabled drivers build config 00:01:59.641 net/gve: not in enabled drivers build config 00:01:59.641 net/hinic: not in enabled drivers build config 00:01:59.641 net/hns3: not in enabled drivers build config 00:01:59.641 net/i40e: not in enabled drivers build config 00:01:59.641 net/iavf: not in enabled drivers build config 00:01:59.641 net/ice: not in enabled drivers build config 00:01:59.641 net/idpf: not in enabled drivers build config 00:01:59.641 net/igc: not in enabled drivers build config 00:01:59.641 net/ionic: not in enabled drivers build config 00:01:59.641 net/ipn3ke: not in enabled drivers build config 00:01:59.641 net/ixgbe: not in enabled drivers build config 00:01:59.641 net/mana: not in enabled drivers build config 00:01:59.641 net/memif: not in enabled drivers build config 00:01:59.641 net/mlx4: not in enabled drivers build config 00:01:59.641 net/mlx5: not in enabled drivers build config 00:01:59.641 net/mvneta: not in enabled drivers build config 00:01:59.641 net/mvpp2: not in enabled drivers build config 00:01:59.641 net/netvsc: not in enabled drivers build config 00:01:59.641 net/nfb: not in enabled drivers build config 00:01:59.641 net/nfp: not in enabled drivers build config 00:01:59.641 net/ngbe: not in enabled drivers build config 00:01:59.641 net/null: not in enabled drivers build config 00:01:59.641 net/octeontx: not in enabled drivers build config 00:01:59.641 net/octeon_ep: not in enabled drivers build config 00:01:59.641 net/pcap: not in enabled drivers build config 00:01:59.641 net/pfe: not in enabled drivers build config 00:01:59.641 net/qede: not in enabled drivers build config 00:01:59.641 net/ring: not in enabled drivers build config 00:01:59.641 net/sfc: not in enabled drivers build config 00:01:59.641 net/softnic: not in enabled drivers build config 00:01:59.641 net/tap: not in enabled drivers build config 00:01:59.641 net/thunderx: not in enabled drivers build config 00:01:59.641 net/txgbe: not in enabled drivers build config 00:01:59.641 net/vdev_netvsc: not in enabled drivers build config 00:01:59.641 net/vhost: not in enabled drivers build config 00:01:59.641 net/virtio: not in enabled drivers build config 00:01:59.641 net/vmxnet3: not in enabled drivers build config 00:01:59.641 raw/*: missing internal dependency, "rawdev" 00:01:59.641 crypto/armv8: not in enabled drivers build config 00:01:59.641 crypto/bcmfs: not in enabled drivers build config 00:01:59.641 crypto/caam_jr: not in enabled drivers build config 00:01:59.641 crypto/ccp: not in enabled drivers build config 00:01:59.641 crypto/cnxk: not in enabled drivers build config 00:01:59.641 crypto/dpaa_sec: not in enabled drivers build config 00:01:59.641 crypto/dpaa2_sec: not in enabled drivers build config 00:01:59.641 crypto/ipsec_mb: not in enabled drivers build config 00:01:59.641 crypto/mlx5: not in enabled drivers build config 00:01:59.641 crypto/mvsam: not in enabled drivers build config 00:01:59.641 crypto/nitrox: not in enabled drivers build config 00:01:59.641 crypto/null: not in enabled drivers build config 00:01:59.641 crypto/octeontx: not in enabled drivers build config 00:01:59.641 crypto/openssl: not in enabled drivers build config 00:01:59.641 crypto/scheduler: not in enabled drivers build config 00:01:59.641 crypto/uadk: not in enabled drivers build config 00:01:59.641 crypto/virtio: not in enabled drivers build config 00:01:59.641 compress/isal: not in enabled drivers build config 00:01:59.641 compress/mlx5: not in enabled drivers build config 00:01:59.641 compress/octeontx: not in enabled drivers build config 00:01:59.641 compress/zlib: not in enabled drivers build config 00:01:59.641 regex/*: missing internal dependency, "regexdev" 00:01:59.641 ml/*: missing internal dependency, "mldev" 00:01:59.641 vdpa/ifc: not in enabled drivers build config 00:01:59.641 vdpa/mlx5: not in enabled drivers build config 00:01:59.641 vdpa/nfp: not in enabled drivers build config 00:01:59.641 vdpa/sfc: not in enabled drivers build config 00:01:59.641 event/*: missing internal dependency, "eventdev" 00:01:59.641 baseband/*: missing internal dependency, "bbdev" 00:01:59.641 gpu/*: missing internal dependency, "gpudev" 00:01:59.641 00:01:59.641 00:01:59.641 Build targets in project: 85 00:01:59.641 00:01:59.641 DPDK 23.11.0 00:01:59.641 00:01:59.641 User defined options 00:01:59.641 buildtype : debug 00:01:59.641 default_library : shared 00:01:59.641 libdir : lib 00:01:59.641 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:59.641 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:59.641 c_link_args : 00:01:59.641 cpu_instruction_set: native 00:01:59.641 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:59.641 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:59.641 enable_docs : false 00:01:59.641 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:59.641 enable_kmods : false 00:01:59.641 tests : false 00:01:59.641 00:01:59.641 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:59.641 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:59.641 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:59.641 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:59.641 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:59.641 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:59.641 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:59.641 [6/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:59.641 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:59.641 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:59.641 [9/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:59.641 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:59.641 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:59.641 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:59.641 [13/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:59.641 [14/265] Linking static target lib/librte_kvargs.a 00:01:59.641 [15/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:59.641 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:59.641 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:59.641 [18/265] Linking static target lib/librte_log.a 00:01:59.642 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:59.642 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:59.910 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:02:00.173 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.440 [23/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:02:00.440 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:02:00.440 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:02:00.440 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:02:00.440 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:02:00.440 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:02:00.440 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:02:00.440 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:02:00.440 [31/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:02:00.440 [32/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:02:00.440 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:02:00.440 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:02:00.440 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:02:00.440 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:02:00.440 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:02:00.440 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:02:00.440 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:02:00.440 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:02:00.440 [41/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:02:00.440 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:02:00.440 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:02:00.440 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:02:00.440 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:02:00.440 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:02:00.440 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:02:00.440 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:02:00.440 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:02:00.440 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:02:00.440 [51/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:02:00.440 [52/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:02:00.440 [53/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:02:00.440 [54/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:02:00.440 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:02:00.703 [56/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:02:00.703 [57/265] Linking static target lib/librte_telemetry.a 00:02:00.703 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:02:00.703 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:02:00.704 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:02:00.704 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:02:00.704 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:02:00.704 [63/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:02:00.704 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:02:00.704 [65/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:02:00.704 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:02:00.704 [67/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:02:00.968 [68/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.968 [69/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:02:00.968 [70/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:02:00.968 [71/265] Linking static target lib/librte_pci.a 00:02:00.968 [72/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:02:00.968 [73/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:02:00.968 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:02:00.968 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:02:00.968 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:02:00.968 [77/265] Linking target lib/librte_log.so.24.0 00:02:00.968 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:02:00.968 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:02:00.968 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:02:00.968 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:02:00.968 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:02:01.237 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:02:01.237 [84/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:02:01.237 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:02:01.237 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:02:01.237 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:02:01.237 [88/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:02:01.237 [89/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:02:01.237 [90/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:02:01.520 [91/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:02:01.520 [92/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:02:01.520 [93/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.520 [94/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:02:01.520 [95/265] Linking target lib/librte_kvargs.so.24.0 00:02:01.520 [96/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:02:01.520 [97/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:02:01.520 [98/265] Linking static target lib/librte_ring.a 00:02:01.520 [99/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:02:01.520 [100/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:02:01.520 [101/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:02:01.520 [102/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.520 [103/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:02:01.520 [104/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:02:01.520 [105/265] Linking static target lib/librte_meter.a 00:02:01.520 [106/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:02:01.520 [107/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:02:01.520 [108/265] Linking static target lib/librte_eal.a 00:02:01.520 [109/265] Linking target lib/librte_telemetry.so.24.0 00:02:01.520 [110/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:02:01.520 [111/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:01.520 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:02:01.520 [113/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:02:01.783 [114/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:02:01.783 [115/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:01.783 [116/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:01.783 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:02:01.783 [118/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:02:01.783 [119/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:02:01.783 [120/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:02:01.783 [121/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:02:01.783 [122/265] Linking static target lib/librte_mempool.a 00:02:01.783 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:02:01.783 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:02:01.783 [125/265] Linking static target lib/librte_rcu.a 00:02:01.783 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:02:01.783 [127/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:01.783 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:01.783 [129/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:02:01.783 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:02:01.783 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:01.783 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:02:02.054 [133/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:02:02.054 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:02.054 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:02.054 [136/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:02.054 [137/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:02.054 [138/265] Linking static target lib/librte_cmdline.a 00:02:02.054 [139/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:02.054 [140/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.054 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:02.054 [142/265] Linking static target lib/librte_net.a 00:02:02.054 [143/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:02.054 [144/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.317 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:02.317 [146/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:02.317 [147/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:02.317 [148/265] Linking static target lib/librte_timer.a 00:02:02.317 [149/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:02.317 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.317 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:02:02.317 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:02.317 [153/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:02.579 [154/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.579 [155/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:02.579 [156/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:02.579 [157/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:02.579 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:02.579 [159/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:02.579 [160/265] Linking static target lib/librte_dmadev.a 00:02:02.579 [161/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:02.579 [162/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:02.579 [163/265] Linking static target lib/librte_compressdev.a 00:02:02.579 [164/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.579 [165/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:02.579 [166/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:02.579 [167/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:02.839 [168/265] Linking static target lib/librte_hash.a 00:02:02.839 [169/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.839 [170/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:02.839 [171/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:02.839 [172/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:02.839 [173/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:02.839 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:02.839 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:02.839 [176/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:02.839 [177/265] Linking static target lib/librte_power.a 00:02:02.839 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:02.839 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:02.839 [180/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.840 [181/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:03.099 [182/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:03.099 [183/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.099 [184/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:03.099 [185/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:03.099 [186/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:03.099 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:03.099 [188/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:03.099 [189/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:03.099 [190/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:03.099 [191/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.099 [192/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:03.099 [193/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:03.099 [194/265] Linking static target lib/librte_mbuf.a 00:02:03.099 [195/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:03.099 [196/265] Linking static target lib/librte_reorder.a 00:02:03.099 [197/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.358 [198/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:03.358 [199/265] Linking static target lib/librte_security.a 00:02:03.358 [200/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:03.358 [201/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:03.358 [202/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:03.358 [203/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:03.358 [204/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:03.358 [205/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:03.358 [206/265] Linking static target drivers/librte_mempool_ring.a 00:02:03.358 [207/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:03.358 [208/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:03.358 [209/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:03.358 [210/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:03.358 [211/265] Linking static target drivers/librte_bus_vdev.a 00:02:03.358 [212/265] Linking static target drivers/librte_bus_pci.a 00:02:03.358 [213/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:03.358 [214/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.358 [215/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.618 [216/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.618 [217/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.618 [218/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:03.618 [219/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.618 [220/265] Linking static target lib/librte_cryptodev.a 00:02:03.618 [221/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:03.878 [222/265] Linking static target lib/librte_ethdev.a 00:02:03.878 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.818 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.196 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:08.105 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.105 [227/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.105 [228/265] Linking target lib/librte_eal.so.24.0 00:02:08.105 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:08.105 [230/265] Linking target lib/librte_meter.so.24.0 00:02:08.105 [231/265] Linking target lib/librte_ring.so.24.0 00:02:08.105 [232/265] Linking target lib/librte_pci.so.24.0 00:02:08.105 [233/265] Linking target lib/librte_timer.so.24.0 00:02:08.105 [234/265] Linking target lib/librte_dmadev.so.24.0 00:02:08.105 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:08.105 [236/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:08.105 [237/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:08.105 [238/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:08.105 [239/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:08.105 [240/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:08.105 [241/265] Linking target lib/librte_rcu.so.24.0 00:02:08.105 [242/265] Linking target lib/librte_mempool.so.24.0 00:02:08.105 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:08.364 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:08.364 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:08.364 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:08.364 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:08.364 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:08.623 [249/265] Linking target lib/librte_reorder.so.24.0 00:02:08.623 [250/265] Linking target lib/librte_compressdev.so.24.0 00:02:08.623 [251/265] Linking target lib/librte_net.so.24.0 00:02:08.623 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:08.623 [253/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:08.623 [254/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:08.623 [255/265] Linking target lib/librte_security.so.24.0 00:02:08.623 [256/265] Linking target lib/librte_hash.so.24.0 00:02:08.623 [257/265] Linking target lib/librte_cmdline.so.24.0 00:02:08.623 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:08.884 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:08.885 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:08.885 [261/265] Linking target lib/librte_power.so.24.0 00:02:11.435 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:11.435 [263/265] Linking static target lib/librte_vhost.a 00:02:12.374 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:12.374 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:12.375 INFO: autodetecting backend as ninja 00:02:12.375 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:13.331 CC lib/ut_mock/mock.o 00:02:13.332 CC lib/log/log.o 00:02:13.332 CC lib/log/log_flags.o 00:02:13.332 CC lib/log/log_deprecated.o 00:02:13.332 CC lib/ut/ut.o 00:02:13.591 LIB libspdk_ut_mock.a 00:02:13.591 SO libspdk_ut_mock.so.5.0 00:02:13.591 LIB libspdk_log.a 00:02:13.591 LIB libspdk_ut.a 00:02:13.591 SO libspdk_ut.so.1.0 00:02:13.591 SO libspdk_log.so.6.1 00:02:13.591 SYMLINK libspdk_ut_mock.so 00:02:13.591 SYMLINK libspdk_ut.so 00:02:13.591 SYMLINK libspdk_log.so 00:02:13.591 CC lib/dma/dma.o 00:02:13.591 CXX lib/trace_parser/trace.o 00:02:13.591 CC lib/ioat/ioat.o 00:02:13.591 CC lib/util/base64.o 00:02:13.591 CC lib/util/bit_array.o 00:02:13.591 CC lib/util/cpuset.o 00:02:13.591 CC lib/util/crc16.o 00:02:13.591 CC lib/util/crc32.o 00:02:13.591 CC lib/util/crc32c.o 00:02:13.591 CC lib/util/crc32_ieee.o 00:02:13.591 CC lib/util/crc64.o 00:02:13.591 CC lib/util/dif.o 00:02:13.591 CC lib/util/fd.o 00:02:13.591 CC lib/util/file.o 00:02:13.591 CC lib/util/hexlify.o 00:02:13.591 CC lib/util/iov.o 00:02:13.591 CC lib/util/math.o 00:02:13.591 CC lib/util/pipe.o 00:02:13.591 CC lib/util/strerror_tls.o 00:02:13.591 CC lib/util/string.o 00:02:13.591 CC lib/util/uuid.o 00:02:13.591 CC lib/util/xor.o 00:02:13.591 CC lib/util/fd_group.o 00:02:13.591 CC lib/util/zipf.o 00:02:13.851 CC lib/vfio_user/host/vfio_user_pci.o 00:02:13.851 CC lib/vfio_user/host/vfio_user.o 00:02:13.851 LIB libspdk_dma.a 00:02:13.851 SO libspdk_dma.so.3.0 00:02:13.851 SYMLINK libspdk_dma.so 00:02:14.110 LIB libspdk_ioat.a 00:02:14.110 SO libspdk_ioat.so.6.0 00:02:14.110 LIB libspdk_vfio_user.a 00:02:14.110 SO libspdk_vfio_user.so.4.0 00:02:14.110 SYMLINK libspdk_ioat.so 00:02:14.110 SYMLINK libspdk_vfio_user.so 00:02:14.369 LIB libspdk_util.a 00:02:14.369 SO libspdk_util.so.8.0 00:02:14.369 SYMLINK libspdk_util.so 00:02:14.628 CC lib/conf/conf.o 00:02:14.628 CC lib/rdma/common.o 00:02:14.628 CC lib/idxd/idxd.o 00:02:14.628 CC lib/json/json_parse.o 00:02:14.628 CC lib/rdma/rdma_verbs.o 00:02:14.628 CC lib/json/json_util.o 00:02:14.628 CC lib/vmd/vmd.o 00:02:14.628 CC lib/idxd/idxd_user.o 00:02:14.628 CC lib/json/json_write.o 00:02:14.628 CC lib/idxd/idxd_kernel.o 00:02:14.628 CC lib/env_dpdk/memory.o 00:02:14.628 CC lib/env_dpdk/env.o 00:02:14.628 CC lib/vmd/led.o 00:02:14.628 CC lib/env_dpdk/pci.o 00:02:14.628 CC lib/env_dpdk/init.o 00:02:14.628 CC lib/env_dpdk/threads.o 00:02:14.629 CC lib/env_dpdk/pci_ioat.o 00:02:14.629 CC lib/env_dpdk/pci_virtio.o 00:02:14.629 CC lib/env_dpdk/pci_vmd.o 00:02:14.629 CC lib/env_dpdk/pci_idxd.o 00:02:14.629 CC lib/env_dpdk/pci_event.o 00:02:14.629 CC lib/env_dpdk/sigbus_handler.o 00:02:14.629 CC lib/env_dpdk/pci_dpdk.o 00:02:14.629 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:14.629 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:14.888 LIB libspdk_rdma.a 00:02:14.888 LIB libspdk_json.a 00:02:14.888 LIB libspdk_conf.a 00:02:14.888 SO libspdk_rdma.so.5.0 00:02:14.888 SO libspdk_json.so.5.1 00:02:14.888 SO libspdk_conf.so.5.0 00:02:14.888 SYMLINK libspdk_rdma.so 00:02:14.888 SYMLINK libspdk_json.so 00:02:14.888 SYMLINK libspdk_conf.so 00:02:15.147 CC lib/jsonrpc/jsonrpc_server.o 00:02:15.147 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:15.147 CC lib/jsonrpc/jsonrpc_client.o 00:02:15.147 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:15.147 LIB libspdk_idxd.a 00:02:15.147 SO libspdk_idxd.so.11.0 00:02:15.147 SYMLINK libspdk_idxd.so 00:02:15.147 LIB libspdk_vmd.a 00:02:15.147 SO libspdk_vmd.so.5.0 00:02:15.407 SYMLINK libspdk_vmd.so 00:02:15.407 LIB libspdk_jsonrpc.a 00:02:15.407 SO libspdk_jsonrpc.so.5.1 00:02:15.407 SYMLINK libspdk_jsonrpc.so 00:02:15.407 CC lib/rpc/rpc.o 00:02:15.667 LIB libspdk_trace_parser.a 00:02:15.667 SO libspdk_trace_parser.so.4.0 00:02:15.667 SYMLINK libspdk_trace_parser.so 00:02:15.667 LIB libspdk_rpc.a 00:02:15.667 SO libspdk_rpc.so.5.0 00:02:15.667 SYMLINK libspdk_rpc.so 00:02:15.927 CC lib/trace/trace.o 00:02:15.927 CC lib/trace/trace_flags.o 00:02:15.927 CC lib/trace/trace_rpc.o 00:02:15.927 CC lib/notify/notify.o 00:02:15.927 CC lib/sock/sock.o 00:02:15.927 CC lib/sock/sock_rpc.o 00:02:15.927 CC lib/notify/notify_rpc.o 00:02:15.927 LIB libspdk_notify.a 00:02:15.927 SO libspdk_notify.so.5.0 00:02:16.186 SYMLINK libspdk_notify.so 00:02:16.187 LIB libspdk_trace.a 00:02:16.187 SO libspdk_trace.so.9.0 00:02:16.187 SYMLINK libspdk_trace.so 00:02:16.187 LIB libspdk_sock.a 00:02:16.187 SO libspdk_sock.so.8.0 00:02:16.187 CC lib/thread/thread.o 00:02:16.187 CC lib/thread/iobuf.o 00:02:16.447 SYMLINK libspdk_sock.so 00:02:16.447 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:16.447 CC lib/nvme/nvme_ctrlr.o 00:02:16.447 CC lib/nvme/nvme_fabric.o 00:02:16.447 CC lib/nvme/nvme_ns_cmd.o 00:02:16.447 CC lib/nvme/nvme_ns.o 00:02:16.447 CC lib/nvme/nvme_pcie_common.o 00:02:16.447 CC lib/nvme/nvme_pcie.o 00:02:16.447 CC lib/nvme/nvme_qpair.o 00:02:16.447 CC lib/nvme/nvme.o 00:02:16.447 CC lib/nvme/nvme_quirks.o 00:02:16.447 CC lib/nvme/nvme_transport.o 00:02:16.447 CC lib/nvme/nvme_discovery.o 00:02:16.447 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:16.447 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:16.447 CC lib/nvme/nvme_tcp.o 00:02:16.447 CC lib/nvme/nvme_opal.o 00:02:16.447 CC lib/nvme/nvme_io_msg.o 00:02:16.447 CC lib/nvme/nvme_poll_group.o 00:02:16.447 CC lib/nvme/nvme_zns.o 00:02:16.447 CC lib/nvme/nvme_cuse.o 00:02:16.447 CC lib/nvme/nvme_vfio_user.o 00:02:16.447 CC lib/nvme/nvme_rdma.o 00:02:16.707 LIB libspdk_env_dpdk.a 00:02:16.707 SO libspdk_env_dpdk.so.13.0 00:02:16.967 SYMLINK libspdk_env_dpdk.so 00:02:17.905 LIB libspdk_thread.a 00:02:17.905 SO libspdk_thread.so.9.0 00:02:17.905 SYMLINK libspdk_thread.so 00:02:18.165 CC lib/accel/accel.o 00:02:18.165 CC lib/accel/accel_rpc.o 00:02:18.165 CC lib/accel/accel_sw.o 00:02:18.165 CC lib/init/json_config.o 00:02:18.165 CC lib/blob/blobstore.o 00:02:18.165 CC lib/virtio/virtio.o 00:02:18.165 CC lib/init/subsystem.o 00:02:18.165 CC lib/blob/request.o 00:02:18.165 CC lib/init/subsystem_rpc.o 00:02:18.165 CC lib/virtio/virtio_vhost_user.o 00:02:18.165 CC lib/blob/zeroes.o 00:02:18.165 CC lib/virtio/virtio_vfio_user.o 00:02:18.165 CC lib/init/rpc.o 00:02:18.165 CC lib/blob/blob_bs_dev.o 00:02:18.165 CC lib/virtio/virtio_pci.o 00:02:18.424 LIB libspdk_init.a 00:02:18.424 SO libspdk_init.so.4.0 00:02:18.424 SYMLINK libspdk_init.so 00:02:18.424 LIB libspdk_virtio.a 00:02:18.424 SO libspdk_virtio.so.6.0 00:02:18.424 SYMLINK libspdk_virtio.so 00:02:18.424 CC lib/event/app.o 00:02:18.424 CC lib/event/reactor.o 00:02:18.424 CC lib/event/log_rpc.o 00:02:18.424 CC lib/event/app_rpc.o 00:02:18.424 CC lib/event/scheduler_static.o 00:02:18.684 LIB libspdk_nvme.a 00:02:18.943 SO libspdk_nvme.so.12.0 00:02:18.944 LIB libspdk_event.a 00:02:18.944 SO libspdk_event.so.12.0 00:02:18.944 SYMLINK libspdk_event.so 00:02:18.944 SYMLINK libspdk_nvme.so 00:02:19.203 LIB libspdk_accel.a 00:02:19.203 SO libspdk_accel.so.14.0 00:02:19.203 SYMLINK libspdk_accel.so 00:02:19.463 CC lib/bdev/bdev.o 00:02:19.463 CC lib/bdev/bdev_rpc.o 00:02:19.463 CC lib/bdev/bdev_zone.o 00:02:19.463 CC lib/bdev/part.o 00:02:19.463 CC lib/bdev/scsi_nvme.o 00:02:20.841 LIB libspdk_blob.a 00:02:20.841 SO libspdk_blob.so.10.1 00:02:20.841 SYMLINK libspdk_blob.so 00:02:21.100 CC lib/blobfs/blobfs.o 00:02:21.100 CC lib/blobfs/tree.o 00:02:21.100 CC lib/lvol/lvol.o 00:02:21.671 LIB libspdk_blobfs.a 00:02:21.671 SO libspdk_blobfs.so.9.0 00:02:21.930 SYMLINK libspdk_blobfs.so 00:02:21.931 LIB libspdk_lvol.a 00:02:21.931 SO libspdk_lvol.so.9.1 00:02:21.931 LIB libspdk_bdev.a 00:02:21.931 SYMLINK libspdk_lvol.so 00:02:21.931 SO libspdk_bdev.so.14.0 00:02:21.931 SYMLINK libspdk_bdev.so 00:02:22.195 CC lib/scsi/dev.o 00:02:22.195 CC lib/scsi/lun.o 00:02:22.195 CC lib/nbd/nbd.o 00:02:22.195 CC lib/scsi/port.o 00:02:22.195 CC lib/nbd/nbd_rpc.o 00:02:22.195 CC lib/scsi/scsi.o 00:02:22.195 CC lib/scsi/scsi_bdev.o 00:02:22.195 CC lib/scsi/scsi_pr.o 00:02:22.195 CC lib/scsi/scsi_rpc.o 00:02:22.195 CC lib/scsi/task.o 00:02:22.195 CC lib/ublk/ublk.o 00:02:22.195 CC lib/nvmf/ctrlr.o 00:02:22.195 CC lib/ftl/ftl_core.o 00:02:22.195 CC lib/ublk/ublk_rpc.o 00:02:22.195 CC lib/nvmf/ctrlr_discovery.o 00:02:22.195 CC lib/ftl/ftl_init.o 00:02:22.195 CC lib/nvmf/ctrlr_bdev.o 00:02:22.195 CC lib/nvmf/subsystem.o 00:02:22.195 CC lib/ftl/ftl_layout.o 00:02:22.195 CC lib/ftl/ftl_debug.o 00:02:22.195 CC lib/nvmf/nvmf.o 00:02:22.195 CC lib/ftl/ftl_io.o 00:02:22.195 CC lib/nvmf/nvmf_rpc.o 00:02:22.195 CC lib/ftl/ftl_l2p.o 00:02:22.195 CC lib/ftl/ftl_sb.o 00:02:22.195 CC lib/nvmf/transport.o 00:02:22.195 CC lib/nvmf/tcp.o 00:02:22.195 CC lib/nvmf/rdma.o 00:02:22.195 CC lib/ftl/ftl_l2p_flat.o 00:02:22.195 CC lib/ftl/ftl_band.o 00:02:22.195 CC lib/ftl/ftl_nv_cache.o 00:02:22.195 CC lib/ftl/ftl_band_ops.o 00:02:22.195 CC lib/ftl/ftl_writer.o 00:02:22.195 CC lib/ftl/ftl_rq.o 00:02:22.195 CC lib/ftl/ftl_reloc.o 00:02:22.195 CC lib/ftl/ftl_l2p_cache.o 00:02:22.195 CC lib/ftl/ftl_p2l.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:22.195 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:22.460 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:22.460 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:22.460 CC lib/ftl/utils/ftl_conf.o 00:02:22.460 CC lib/ftl/utils/ftl_md.o 00:02:22.460 CC lib/ftl/utils/ftl_mempool.o 00:02:22.460 CC lib/ftl/utils/ftl_bitmap.o 00:02:22.460 CC lib/ftl/utils/ftl_property.o 00:02:22.460 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:22.460 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:22.460 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:22.460 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:22.460 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:22.460 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:22.723 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:22.723 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:22.723 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:22.723 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:22.723 CC lib/ftl/base/ftl_base_dev.o 00:02:22.723 CC lib/ftl/base/ftl_base_bdev.o 00:02:22.723 CC lib/ftl/ftl_trace.o 00:02:22.983 LIB libspdk_nbd.a 00:02:22.983 SO libspdk_nbd.so.6.0 00:02:22.983 SYMLINK libspdk_nbd.so 00:02:22.983 LIB libspdk_scsi.a 00:02:22.983 SO libspdk_scsi.so.8.0 00:02:22.983 LIB libspdk_ublk.a 00:02:22.983 SO libspdk_ublk.so.2.0 00:02:23.243 SYMLINK libspdk_scsi.so 00:02:23.243 SYMLINK libspdk_ublk.so 00:02:23.243 CC lib/iscsi/conn.o 00:02:23.243 CC lib/vhost/vhost.o 00:02:23.243 CC lib/iscsi/init_grp.o 00:02:23.243 CC lib/vhost/vhost_rpc.o 00:02:23.243 CC lib/iscsi/iscsi.o 00:02:23.243 CC lib/vhost/vhost_scsi.o 00:02:23.243 CC lib/iscsi/md5.o 00:02:23.243 CC lib/vhost/vhost_blk.o 00:02:23.243 CC lib/iscsi/param.o 00:02:23.243 CC lib/vhost/rte_vhost_user.o 00:02:23.243 CC lib/iscsi/portal_grp.o 00:02:23.243 CC lib/iscsi/tgt_node.o 00:02:23.243 CC lib/iscsi/iscsi_subsystem.o 00:02:23.243 CC lib/iscsi/iscsi_rpc.o 00:02:23.243 CC lib/iscsi/task.o 00:02:23.502 LIB libspdk_ftl.a 00:02:23.761 SO libspdk_ftl.so.8.0 00:02:24.020 SYMLINK libspdk_ftl.so 00:02:24.589 LIB libspdk_vhost.a 00:02:24.589 SO libspdk_vhost.so.7.1 00:02:24.589 SYMLINK libspdk_vhost.so 00:02:24.589 LIB libspdk_nvmf.a 00:02:24.589 LIB libspdk_iscsi.a 00:02:24.589 SO libspdk_nvmf.so.17.0 00:02:24.847 SO libspdk_iscsi.so.7.0 00:02:24.847 SYMLINK libspdk_nvmf.so 00:02:24.847 SYMLINK libspdk_iscsi.so 00:02:25.105 CC module/env_dpdk/env_dpdk_rpc.o 00:02:25.105 CC module/accel/error/accel_error.o 00:02:25.105 CC module/accel/error/accel_error_rpc.o 00:02:25.105 CC module/accel/iaa/accel_iaa.o 00:02:25.105 CC module/accel/iaa/accel_iaa_rpc.o 00:02:25.105 CC module/blob/bdev/blob_bdev.o 00:02:25.105 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:25.105 CC module/sock/posix/posix.o 00:02:25.105 CC module/accel/ioat/accel_ioat.o 00:02:25.105 CC module/accel/dsa/accel_dsa.o 00:02:25.105 CC module/accel/ioat/accel_ioat_rpc.o 00:02:25.105 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:25.106 CC module/scheduler/gscheduler/gscheduler.o 00:02:25.106 CC module/accel/dsa/accel_dsa_rpc.o 00:02:25.106 LIB libspdk_env_dpdk_rpc.a 00:02:25.106 SO libspdk_env_dpdk_rpc.so.5.0 00:02:25.364 SYMLINK libspdk_env_dpdk_rpc.so 00:02:25.364 LIB libspdk_scheduler_gscheduler.a 00:02:25.364 LIB libspdk_scheduler_dpdk_governor.a 00:02:25.364 SO libspdk_scheduler_gscheduler.so.3.0 00:02:25.364 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:25.364 LIB libspdk_accel_error.a 00:02:25.364 LIB libspdk_accel_ioat.a 00:02:25.364 LIB libspdk_scheduler_dynamic.a 00:02:25.364 SO libspdk_accel_error.so.1.0 00:02:25.364 LIB libspdk_accel_iaa.a 00:02:25.364 SO libspdk_accel_ioat.so.5.0 00:02:25.364 SO libspdk_scheduler_dynamic.so.3.0 00:02:25.364 SYMLINK libspdk_scheduler_gscheduler.so 00:02:25.364 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:25.364 SO libspdk_accel_iaa.so.2.0 00:02:25.364 LIB libspdk_accel_dsa.a 00:02:25.364 SYMLINK libspdk_accel_error.so 00:02:25.364 SYMLINK libspdk_scheduler_dynamic.so 00:02:25.364 SYMLINK libspdk_accel_ioat.so 00:02:25.364 SO libspdk_accel_dsa.so.4.0 00:02:25.364 LIB libspdk_blob_bdev.a 00:02:25.364 SYMLINK libspdk_accel_iaa.so 00:02:25.364 SO libspdk_blob_bdev.so.10.1 00:02:25.364 SYMLINK libspdk_accel_dsa.so 00:02:25.364 SYMLINK libspdk_blob_bdev.so 00:02:25.626 CC module/bdev/null/bdev_null.o 00:02:25.626 CC module/bdev/null/bdev_null_rpc.o 00:02:25.626 CC module/bdev/ftl/bdev_ftl.o 00:02:25.626 CC module/bdev/aio/bdev_aio.o 00:02:25.626 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:25.626 CC module/bdev/aio/bdev_aio_rpc.o 00:02:25.626 CC module/bdev/malloc/bdev_malloc.o 00:02:25.626 CC module/bdev/gpt/gpt.o 00:02:25.626 CC module/bdev/error/vbdev_error.o 00:02:25.626 CC module/bdev/gpt/vbdev_gpt.o 00:02:25.626 CC module/bdev/error/vbdev_error_rpc.o 00:02:25.626 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:25.626 CC module/bdev/passthru/vbdev_passthru.o 00:02:25.626 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:25.626 CC module/bdev/delay/vbdev_delay.o 00:02:25.626 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:25.626 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:25.626 CC module/bdev/iscsi/bdev_iscsi.o 00:02:25.626 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:25.626 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:25.626 CC module/bdev/raid/bdev_raid.o 00:02:25.626 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:25.626 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:25.626 CC module/bdev/nvme/bdev_nvme.o 00:02:25.626 CC module/bdev/raid/bdev_raid_sb.o 00:02:25.626 CC module/bdev/split/vbdev_split.o 00:02:25.626 CC module/bdev/raid/bdev_raid_rpc.o 00:02:25.626 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:25.626 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:25.626 CC module/bdev/split/vbdev_split_rpc.o 00:02:25.626 CC module/bdev/nvme/nvme_rpc.o 00:02:25.626 CC module/bdev/lvol/vbdev_lvol.o 00:02:25.626 CC module/bdev/raid/raid0.o 00:02:25.626 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:25.626 CC module/bdev/raid/raid1.o 00:02:25.626 CC module/bdev/nvme/bdev_mdns_client.o 00:02:25.626 CC module/bdev/nvme/vbdev_opal.o 00:02:25.626 CC module/bdev/raid/concat.o 00:02:25.626 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:25.626 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:25.626 CC module/blobfs/bdev/blobfs_bdev.o 00:02:25.626 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:25.886 LIB libspdk_bdev_error.a 00:02:25.886 LIB libspdk_bdev_split.a 00:02:25.886 LIB libspdk_sock_posix.a 00:02:25.886 SO libspdk_bdev_error.so.5.0 00:02:25.886 LIB libspdk_blobfs_bdev.a 00:02:25.886 SO libspdk_bdev_split.so.5.0 00:02:25.886 SO libspdk_sock_posix.so.5.0 00:02:26.145 SO libspdk_blobfs_bdev.so.5.0 00:02:26.145 LIB libspdk_bdev_null.a 00:02:26.145 SYMLINK libspdk_bdev_split.so 00:02:26.145 SO libspdk_bdev_null.so.5.0 00:02:26.145 SYMLINK libspdk_bdev_error.so 00:02:26.145 LIB libspdk_bdev_ftl.a 00:02:26.145 SYMLINK libspdk_sock_posix.so 00:02:26.145 SYMLINK libspdk_blobfs_bdev.so 00:02:26.145 SO libspdk_bdev_ftl.so.5.0 00:02:26.145 LIB libspdk_bdev_passthru.a 00:02:26.145 SYMLINK libspdk_bdev_null.so 00:02:26.145 LIB libspdk_bdev_zone_block.a 00:02:26.145 LIB libspdk_bdev_gpt.a 00:02:26.145 LIB libspdk_bdev_malloc.a 00:02:26.145 SO libspdk_bdev_passthru.so.5.0 00:02:26.146 SO libspdk_bdev_gpt.so.5.0 00:02:26.146 SO libspdk_bdev_zone_block.so.5.0 00:02:26.146 SO libspdk_bdev_malloc.so.5.0 00:02:26.146 SYMLINK libspdk_bdev_ftl.so 00:02:26.146 LIB libspdk_bdev_aio.a 00:02:26.146 LIB libspdk_bdev_iscsi.a 00:02:26.146 SYMLINK libspdk_bdev_passthru.so 00:02:26.146 SYMLINK libspdk_bdev_gpt.so 00:02:26.146 SYMLINK libspdk_bdev_zone_block.so 00:02:26.146 SYMLINK libspdk_bdev_malloc.so 00:02:26.146 SO libspdk_bdev_aio.so.5.0 00:02:26.146 SO libspdk_bdev_iscsi.so.5.0 00:02:26.146 LIB libspdk_bdev_delay.a 00:02:26.146 SO libspdk_bdev_delay.so.5.0 00:02:26.146 SYMLINK libspdk_bdev_aio.so 00:02:26.146 SYMLINK libspdk_bdev_iscsi.so 00:02:26.405 LIB libspdk_bdev_lvol.a 00:02:26.405 SYMLINK libspdk_bdev_delay.so 00:02:26.405 SO libspdk_bdev_lvol.so.5.0 00:02:26.405 SYMLINK libspdk_bdev_lvol.so 00:02:26.405 LIB libspdk_bdev_virtio.a 00:02:26.405 SO libspdk_bdev_virtio.so.5.0 00:02:26.405 SYMLINK libspdk_bdev_virtio.so 00:02:26.664 LIB libspdk_bdev_raid.a 00:02:26.664 SO libspdk_bdev_raid.so.5.0 00:02:26.925 SYMLINK libspdk_bdev_raid.so 00:02:27.868 LIB libspdk_bdev_nvme.a 00:02:27.868 SO libspdk_bdev_nvme.so.6.0 00:02:28.127 SYMLINK libspdk_bdev_nvme.so 00:02:28.387 CC module/event/subsystems/scheduler/scheduler.o 00:02:28.387 CC module/event/subsystems/iobuf/iobuf.o 00:02:28.387 CC module/event/subsystems/sock/sock.o 00:02:28.387 CC module/event/subsystems/vmd/vmd.o 00:02:28.387 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:28.387 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:28.387 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:28.387 LIB libspdk_event_sock.a 00:02:28.387 LIB libspdk_event_vhost_blk.a 00:02:28.387 LIB libspdk_event_scheduler.a 00:02:28.387 LIB libspdk_event_vmd.a 00:02:28.387 SO libspdk_event_sock.so.4.0 00:02:28.387 SO libspdk_event_vhost_blk.so.2.0 00:02:28.387 LIB libspdk_event_iobuf.a 00:02:28.387 SO libspdk_event_scheduler.so.3.0 00:02:28.387 SO libspdk_event_vmd.so.5.0 00:02:28.387 SO libspdk_event_iobuf.so.2.0 00:02:28.387 SYMLINK libspdk_event_sock.so 00:02:28.387 SYMLINK libspdk_event_vhost_blk.so 00:02:28.387 SYMLINK libspdk_event_scheduler.so 00:02:28.387 SYMLINK libspdk_event_vmd.so 00:02:28.647 SYMLINK libspdk_event_iobuf.so 00:02:28.647 CC module/event/subsystems/accel/accel.o 00:02:28.910 LIB libspdk_event_accel.a 00:02:28.910 SO libspdk_event_accel.so.5.0 00:02:28.910 SYMLINK libspdk_event_accel.so 00:02:28.910 CC module/event/subsystems/bdev/bdev.o 00:02:29.169 LIB libspdk_event_bdev.a 00:02:29.169 SO libspdk_event_bdev.so.5.0 00:02:29.169 SYMLINK libspdk_event_bdev.so 00:02:29.429 CC module/event/subsystems/nbd/nbd.o 00:02:29.429 CC module/event/subsystems/ublk/ublk.o 00:02:29.429 CC module/event/subsystems/scsi/scsi.o 00:02:29.429 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:29.429 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:29.429 LIB libspdk_event_ublk.a 00:02:29.429 LIB libspdk_event_nbd.a 00:02:29.429 LIB libspdk_event_scsi.a 00:02:29.429 SO libspdk_event_ublk.so.2.0 00:02:29.429 SO libspdk_event_nbd.so.5.0 00:02:29.429 SO libspdk_event_scsi.so.5.0 00:02:29.429 SYMLINK libspdk_event_nbd.so 00:02:29.429 SYMLINK libspdk_event_ublk.so 00:02:29.429 SYMLINK libspdk_event_scsi.so 00:02:29.429 LIB libspdk_event_nvmf.a 00:02:29.688 SO libspdk_event_nvmf.so.5.0 00:02:29.688 SYMLINK libspdk_event_nvmf.so 00:02:29.688 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:29.688 CC module/event/subsystems/iscsi/iscsi.o 00:02:29.688 LIB libspdk_event_vhost_scsi.a 00:02:29.688 SO libspdk_event_vhost_scsi.so.2.0 00:02:29.688 LIB libspdk_event_iscsi.a 00:02:29.948 SO libspdk_event_iscsi.so.5.0 00:02:29.948 SYMLINK libspdk_event_vhost_scsi.so 00:02:29.948 SYMLINK libspdk_event_iscsi.so 00:02:29.948 SO libspdk.so.5.0 00:02:29.948 SYMLINK libspdk.so 00:02:30.212 CXX app/trace/trace.o 00:02:30.212 CC app/trace_record/trace_record.o 00:02:30.212 CC app/spdk_top/spdk_top.o 00:02:30.212 CC app/spdk_nvme_identify/identify.o 00:02:30.212 CC app/spdk_nvme_perf/perf.o 00:02:30.212 CC app/spdk_nvme_discover/discovery_aer.o 00:02:30.212 TEST_HEADER include/spdk/accel.h 00:02:30.212 TEST_HEADER include/spdk/accel_module.h 00:02:30.212 CC test/rpc_client/rpc_client_test.o 00:02:30.212 TEST_HEADER include/spdk/assert.h 00:02:30.212 CC app/spdk_lspci/spdk_lspci.o 00:02:30.212 TEST_HEADER include/spdk/barrier.h 00:02:30.212 TEST_HEADER include/spdk/base64.h 00:02:30.212 TEST_HEADER include/spdk/bdev.h 00:02:30.212 TEST_HEADER include/spdk/bdev_module.h 00:02:30.212 TEST_HEADER include/spdk/bdev_zone.h 00:02:30.212 TEST_HEADER include/spdk/bit_array.h 00:02:30.212 TEST_HEADER include/spdk/bit_pool.h 00:02:30.212 TEST_HEADER include/spdk/blob_bdev.h 00:02:30.212 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:30.212 TEST_HEADER include/spdk/blobfs.h 00:02:30.212 TEST_HEADER include/spdk/blob.h 00:02:30.212 TEST_HEADER include/spdk/conf.h 00:02:30.212 TEST_HEADER include/spdk/config.h 00:02:30.212 CC app/spdk_dd/spdk_dd.o 00:02:30.212 TEST_HEADER include/spdk/cpuset.h 00:02:30.212 TEST_HEADER include/spdk/crc16.h 00:02:30.212 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:30.212 TEST_HEADER include/spdk/crc32.h 00:02:30.212 CC app/iscsi_tgt/iscsi_tgt.o 00:02:30.212 CC app/nvmf_tgt/nvmf_main.o 00:02:30.212 TEST_HEADER include/spdk/crc64.h 00:02:30.212 TEST_HEADER include/spdk/dif.h 00:02:30.212 CC examples/ioat/verify/verify.o 00:02:30.212 TEST_HEADER include/spdk/dma.h 00:02:30.212 TEST_HEADER include/spdk/endian.h 00:02:30.212 CC examples/ioat/perf/perf.o 00:02:30.212 TEST_HEADER include/spdk/env_dpdk.h 00:02:30.212 TEST_HEADER include/spdk/env.h 00:02:30.212 CC app/vhost/vhost.o 00:02:30.212 TEST_HEADER include/spdk/event.h 00:02:30.212 CC test/app/histogram_perf/histogram_perf.o 00:02:30.212 TEST_HEADER include/spdk/fd_group.h 00:02:30.212 CC examples/util/zipf/zipf.o 00:02:30.212 CC examples/vmd/led/led.o 00:02:30.212 CC examples/vmd/lsvmd/lsvmd.o 00:02:30.212 CC examples/nvme/reconnect/reconnect.o 00:02:30.212 CC examples/nvme/hello_world/hello_world.o 00:02:30.212 TEST_HEADER include/spdk/fd.h 00:02:30.212 CC examples/nvme/hotplug/hotplug.o 00:02:30.212 CC app/fio/nvme/fio_plugin.o 00:02:30.212 CC test/event/event_perf/event_perf.o 00:02:30.212 CC examples/idxd/perf/perf.o 00:02:30.212 CC test/thread/poller_perf/poller_perf.o 00:02:30.212 TEST_HEADER include/spdk/file.h 00:02:30.212 CC examples/nvme/arbitration/arbitration.o 00:02:30.212 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:30.213 TEST_HEADER include/spdk/ftl.h 00:02:30.213 TEST_HEADER include/spdk/gpt_spec.h 00:02:30.213 CC examples/sock/hello_world/hello_sock.o 00:02:30.213 CC examples/accel/perf/accel_perf.o 00:02:30.213 TEST_HEADER include/spdk/hexlify.h 00:02:30.213 TEST_HEADER include/spdk/histogram_data.h 00:02:30.213 CC test/nvme/aer/aer.o 00:02:30.213 TEST_HEADER include/spdk/idxd.h 00:02:30.213 TEST_HEADER include/spdk/idxd_spec.h 00:02:30.213 TEST_HEADER include/spdk/init.h 00:02:30.213 CC app/spdk_tgt/spdk_tgt.o 00:02:30.213 TEST_HEADER include/spdk/ioat.h 00:02:30.213 TEST_HEADER include/spdk/ioat_spec.h 00:02:30.213 TEST_HEADER include/spdk/iscsi_spec.h 00:02:30.213 TEST_HEADER include/spdk/json.h 00:02:30.213 TEST_HEADER include/spdk/jsonrpc.h 00:02:30.213 CC examples/blob/hello_world/hello_blob.o 00:02:30.213 TEST_HEADER include/spdk/likely.h 00:02:30.213 TEST_HEADER include/spdk/log.h 00:02:30.213 CC examples/blob/cli/blobcli.o 00:02:30.213 TEST_HEADER include/spdk/lvol.h 00:02:30.213 CC test/blobfs/mkfs/mkfs.o 00:02:30.213 TEST_HEADER include/spdk/memory.h 00:02:30.213 TEST_HEADER include/spdk/mmio.h 00:02:30.213 CC test/dma/test_dma/test_dma.o 00:02:30.213 CC app/fio/bdev/fio_plugin.o 00:02:30.213 CC examples/nvmf/nvmf/nvmf.o 00:02:30.213 CC examples/bdev/hello_world/hello_bdev.o 00:02:30.213 CC test/accel/dif/dif.o 00:02:30.213 TEST_HEADER include/spdk/nbd.h 00:02:30.213 TEST_HEADER include/spdk/notify.h 00:02:30.213 CC examples/thread/thread/thread_ex.o 00:02:30.213 CC examples/bdev/bdevperf/bdevperf.o 00:02:30.213 TEST_HEADER include/spdk/nvme.h 00:02:30.213 CC test/bdev/bdevio/bdevio.o 00:02:30.213 CC test/app/bdev_svc/bdev_svc.o 00:02:30.213 TEST_HEADER include/spdk/nvme_intel.h 00:02:30.213 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:30.213 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:30.213 TEST_HEADER include/spdk/nvme_spec.h 00:02:30.213 TEST_HEADER include/spdk/nvme_zns.h 00:02:30.213 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:30.213 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:30.213 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:30.213 CC test/env/mem_callbacks/mem_callbacks.o 00:02:30.213 TEST_HEADER include/spdk/nvmf.h 00:02:30.481 TEST_HEADER include/spdk/nvmf_spec.h 00:02:30.481 CC test/lvol/esnap/esnap.o 00:02:30.481 TEST_HEADER include/spdk/nvmf_transport.h 00:02:30.481 TEST_HEADER include/spdk/opal.h 00:02:30.481 TEST_HEADER include/spdk/opal_spec.h 00:02:30.481 TEST_HEADER include/spdk/pci_ids.h 00:02:30.481 TEST_HEADER include/spdk/pipe.h 00:02:30.481 TEST_HEADER include/spdk/queue.h 00:02:30.481 TEST_HEADER include/spdk/reduce.h 00:02:30.481 TEST_HEADER include/spdk/rpc.h 00:02:30.481 TEST_HEADER include/spdk/scheduler.h 00:02:30.481 TEST_HEADER include/spdk/scsi.h 00:02:30.481 TEST_HEADER include/spdk/scsi_spec.h 00:02:30.481 TEST_HEADER include/spdk/sock.h 00:02:30.481 TEST_HEADER include/spdk/stdinc.h 00:02:30.481 TEST_HEADER include/spdk/string.h 00:02:30.481 TEST_HEADER include/spdk/thread.h 00:02:30.481 TEST_HEADER include/spdk/trace.h 00:02:30.481 TEST_HEADER include/spdk/trace_parser.h 00:02:30.481 TEST_HEADER include/spdk/tree.h 00:02:30.481 TEST_HEADER include/spdk/ublk.h 00:02:30.481 TEST_HEADER include/spdk/util.h 00:02:30.481 LINK spdk_lspci 00:02:30.481 TEST_HEADER include/spdk/uuid.h 00:02:30.481 TEST_HEADER include/spdk/version.h 00:02:30.481 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:30.481 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:30.481 TEST_HEADER include/spdk/vhost.h 00:02:30.481 TEST_HEADER include/spdk/vmd.h 00:02:30.481 TEST_HEADER include/spdk/xor.h 00:02:30.481 TEST_HEADER include/spdk/zipf.h 00:02:30.481 CXX test/cpp_headers/accel.o 00:02:30.481 LINK rpc_client_test 00:02:30.481 LINK lsvmd 00:02:30.481 LINK spdk_nvme_discover 00:02:30.481 LINK event_perf 00:02:30.481 LINK histogram_perf 00:02:30.481 LINK led 00:02:30.481 LINK zipf 00:02:30.481 LINK poller_perf 00:02:30.481 LINK interrupt_tgt 00:02:30.481 LINK nvmf_tgt 00:02:30.481 LINK vhost 00:02:30.481 LINK iscsi_tgt 00:02:30.481 LINK spdk_trace_record 00:02:30.744 LINK verify 00:02:30.744 LINK ioat_perf 00:02:30.744 LINK spdk_tgt 00:02:30.744 LINK mkfs 00:02:30.744 LINK hotplug 00:02:30.744 LINK bdev_svc 00:02:30.744 LINK hello_world 00:02:30.744 LINK hello_sock 00:02:30.744 LINK hello_blob 00:02:30.744 LINK hello_bdev 00:02:30.744 LINK thread 00:02:30.744 LINK aer 00:02:30.744 CXX test/cpp_headers/accel_module.o 00:02:30.744 LINK arbitration 00:02:30.744 CC test/app/jsoncat/jsoncat.o 00:02:30.744 LINK idxd_perf 00:02:30.744 LINK nvmf 00:02:31.011 LINK spdk_dd 00:02:31.011 CC test/env/vtophys/vtophys.o 00:02:31.011 LINK reconnect 00:02:31.011 CC test/nvme/reset/reset.o 00:02:31.011 CC test/event/reactor/reactor.o 00:02:31.011 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:31.011 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:31.011 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:31.011 CC examples/nvme/abort/abort.o 00:02:31.011 CXX test/cpp_headers/assert.o 00:02:31.011 CXX test/cpp_headers/barrier.o 00:02:31.011 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:31.011 LINK test_dma 00:02:31.011 LINK spdk_trace 00:02:31.011 CXX test/cpp_headers/base64.o 00:02:31.011 CC test/event/reactor_perf/reactor_perf.o 00:02:31.011 CC test/app/stub/stub.o 00:02:31.011 LINK dif 00:02:31.011 CC test/event/app_repeat/app_repeat.o 00:02:31.011 LINK bdevio 00:02:31.011 CXX test/cpp_headers/bdev.o 00:02:31.011 CC test/nvme/sgl/sgl.o 00:02:31.011 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:31.011 CC test/nvme/e2edp/nvme_dp.o 00:02:31.011 CXX test/cpp_headers/bdev_module.o 00:02:31.011 LINK jsoncat 00:02:31.011 LINK nvme_fuzz 00:02:31.011 CXX test/cpp_headers/bdev_zone.o 00:02:31.282 LINK accel_perf 00:02:31.282 CXX test/cpp_headers/bit_array.o 00:02:31.282 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:31.282 CC test/env/pci/pci_ut.o 00:02:31.282 CC test/env/memory/memory_ut.o 00:02:31.282 CC test/event/scheduler/scheduler.o 00:02:31.282 LINK nvme_manage 00:02:31.282 LINK vtophys 00:02:31.282 CC test/nvme/overhead/overhead.o 00:02:31.282 LINK reactor 00:02:31.282 LINK blobcli 00:02:31.282 LINK env_dpdk_post_init 00:02:31.282 LINK cmb_copy 00:02:31.282 CXX test/cpp_headers/bit_pool.o 00:02:31.282 CXX test/cpp_headers/blob_bdev.o 00:02:31.282 CC test/nvme/err_injection/err_injection.o 00:02:31.282 CC test/nvme/startup/startup.o 00:02:31.282 LINK reactor_perf 00:02:31.282 LINK pmr_persistence 00:02:31.282 CC test/nvme/reserve/reserve.o 00:02:31.282 CXX test/cpp_headers/blobfs_bdev.o 00:02:31.282 LINK app_repeat 00:02:31.282 LINK stub 00:02:31.282 CC test/nvme/simple_copy/simple_copy.o 00:02:31.549 CC test/nvme/connect_stress/connect_stress.o 00:02:31.549 LINK reset 00:02:31.549 CC test/nvme/boot_partition/boot_partition.o 00:02:31.549 CXX test/cpp_headers/blobfs.o 00:02:31.549 CC test/nvme/compliance/nvme_compliance.o 00:02:31.549 CXX test/cpp_headers/blob.o 00:02:31.549 LINK spdk_bdev 00:02:31.549 LINK mem_callbacks 00:02:31.549 CC test/nvme/fused_ordering/fused_ordering.o 00:02:31.549 CXX test/cpp_headers/conf.o 00:02:31.549 CXX test/cpp_headers/config.o 00:02:31.549 CXX test/cpp_headers/cpuset.o 00:02:31.549 CXX test/cpp_headers/crc16.o 00:02:31.549 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:31.549 CXX test/cpp_headers/crc32.o 00:02:31.549 CC test/nvme/fdp/fdp.o 00:02:31.549 CXX test/cpp_headers/crc64.o 00:02:31.549 CXX test/cpp_headers/dif.o 00:02:31.549 CC test/nvme/cuse/cuse.o 00:02:31.549 CXX test/cpp_headers/dma.o 00:02:31.549 CXX test/cpp_headers/endian.o 00:02:31.549 CXX test/cpp_headers/env_dpdk.o 00:02:31.549 LINK spdk_nvme 00:02:31.549 CXX test/cpp_headers/env.o 00:02:31.549 LINK scheduler 00:02:31.549 CXX test/cpp_headers/event.o 00:02:31.549 CXX test/cpp_headers/fd_group.o 00:02:31.549 CXX test/cpp_headers/fd.o 00:02:31.549 LINK sgl 00:02:31.549 LINK startup 00:02:31.549 LINK abort 00:02:31.549 LINK nvme_dp 00:02:31.549 CXX test/cpp_headers/file.o 00:02:31.549 LINK err_injection 00:02:31.549 LINK spdk_nvme_perf 00:02:31.814 CXX test/cpp_headers/ftl.o 00:02:31.814 CXX test/cpp_headers/gpt_spec.o 00:02:31.814 CXX test/cpp_headers/hexlify.o 00:02:31.814 LINK bdevperf 00:02:31.814 CXX test/cpp_headers/histogram_data.o 00:02:31.814 CXX test/cpp_headers/idxd.o 00:02:31.814 CXX test/cpp_headers/idxd_spec.o 00:02:31.814 LINK reserve 00:02:31.814 LINK overhead 00:02:31.814 CXX test/cpp_headers/init.o 00:02:31.814 LINK boot_partition 00:02:31.814 LINK spdk_nvme_identify 00:02:31.814 LINK connect_stress 00:02:31.814 CXX test/cpp_headers/ioat.o 00:02:31.814 CXX test/cpp_headers/ioat_spec.o 00:02:31.814 LINK spdk_top 00:02:31.814 CXX test/cpp_headers/iscsi_spec.o 00:02:31.814 LINK simple_copy 00:02:31.814 CXX test/cpp_headers/json.o 00:02:31.814 CXX test/cpp_headers/jsonrpc.o 00:02:31.814 LINK pci_ut 00:02:31.814 CXX test/cpp_headers/likely.o 00:02:31.814 LINK fused_ordering 00:02:31.814 LINK doorbell_aers 00:02:31.814 CXX test/cpp_headers/log.o 00:02:31.814 CXX test/cpp_headers/lvol.o 00:02:32.085 CXX test/cpp_headers/memory.o 00:02:32.085 LINK vhost_fuzz 00:02:32.085 CXX test/cpp_headers/mmio.o 00:02:32.085 CXX test/cpp_headers/nbd.o 00:02:32.085 CXX test/cpp_headers/notify.o 00:02:32.085 CXX test/cpp_headers/nvme.o 00:02:32.085 CXX test/cpp_headers/nvme_intel.o 00:02:32.085 CXX test/cpp_headers/nvme_ocssd.o 00:02:32.085 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:32.085 CXX test/cpp_headers/nvme_spec.o 00:02:32.085 CXX test/cpp_headers/nvme_zns.o 00:02:32.085 CXX test/cpp_headers/nvmf_cmd.o 00:02:32.085 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:32.085 CXX test/cpp_headers/nvmf.o 00:02:32.085 CXX test/cpp_headers/nvmf_spec.o 00:02:32.085 CXX test/cpp_headers/nvmf_transport.o 00:02:32.085 CXX test/cpp_headers/opal.o 00:02:32.085 CXX test/cpp_headers/opal_spec.o 00:02:32.085 CXX test/cpp_headers/pci_ids.o 00:02:32.085 CXX test/cpp_headers/pipe.o 00:02:32.085 CXX test/cpp_headers/queue.o 00:02:32.085 CXX test/cpp_headers/reduce.o 00:02:32.085 CXX test/cpp_headers/rpc.o 00:02:32.085 LINK nvme_compliance 00:02:32.085 CXX test/cpp_headers/scheduler.o 00:02:32.085 CXX test/cpp_headers/scsi.o 00:02:32.085 CXX test/cpp_headers/scsi_spec.o 00:02:32.085 CXX test/cpp_headers/sock.o 00:02:32.085 CXX test/cpp_headers/stdinc.o 00:02:32.085 CXX test/cpp_headers/string.o 00:02:32.085 CXX test/cpp_headers/thread.o 00:02:32.085 LINK fdp 00:02:32.085 CXX test/cpp_headers/trace.o 00:02:32.085 CXX test/cpp_headers/trace_parser.o 00:02:32.085 CXX test/cpp_headers/tree.o 00:02:32.085 CXX test/cpp_headers/ublk.o 00:02:32.085 CXX test/cpp_headers/util.o 00:02:32.348 CXX test/cpp_headers/uuid.o 00:02:32.348 CXX test/cpp_headers/version.o 00:02:32.348 CXX test/cpp_headers/vfio_user_pci.o 00:02:32.348 CXX test/cpp_headers/vfio_user_spec.o 00:02:32.348 CXX test/cpp_headers/vhost.o 00:02:32.348 CXX test/cpp_headers/vmd.o 00:02:32.348 CXX test/cpp_headers/xor.o 00:02:32.348 CXX test/cpp_headers/zipf.o 00:02:32.607 LINK memory_ut 00:02:33.174 LINK cuse 00:02:33.174 LINK iscsi_fuzz 00:02:35.712 LINK esnap 00:02:36.286 00:02:36.286 real 0m46.780s 00:02:36.286 user 9m39.770s 00:02:36.286 sys 2m12.196s 00:02:36.286 22:55:02 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:36.286 22:55:02 -- common/autotest_common.sh@10 -- $ set +x 00:02:36.286 ************************************ 00:02:36.286 END TEST make 00:02:36.286 ************************************ 00:02:36.286 22:55:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:36.286 22:55:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:36.286 22:55:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:36.286 22:55:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:36.286 22:55:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:36.286 22:55:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:36.286 22:55:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:36.286 22:55:02 -- scripts/common.sh@335 -- # IFS=.-: 00:02:36.286 22:55:02 -- scripts/common.sh@335 -- # read -ra ver1 00:02:36.286 22:55:02 -- scripts/common.sh@336 -- # IFS=.-: 00:02:36.286 22:55:02 -- scripts/common.sh@336 -- # read -ra ver2 00:02:36.286 22:55:02 -- scripts/common.sh@337 -- # local 'op=<' 00:02:36.286 22:55:02 -- scripts/common.sh@339 -- # ver1_l=2 00:02:36.286 22:55:02 -- scripts/common.sh@340 -- # ver2_l=1 00:02:36.286 22:55:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:36.286 22:55:02 -- scripts/common.sh@343 -- # case "$op" in 00:02:36.286 22:55:02 -- scripts/common.sh@344 -- # : 1 00:02:36.286 22:55:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:36.286 22:55:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:36.286 22:55:02 -- scripts/common.sh@364 -- # decimal 1 00:02:36.286 22:55:02 -- scripts/common.sh@352 -- # local d=1 00:02:36.286 22:55:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:36.286 22:55:02 -- scripts/common.sh@354 -- # echo 1 00:02:36.286 22:55:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:36.286 22:55:02 -- scripts/common.sh@365 -- # decimal 2 00:02:36.286 22:55:02 -- scripts/common.sh@352 -- # local d=2 00:02:36.286 22:55:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:36.286 22:55:02 -- scripts/common.sh@354 -- # echo 2 00:02:36.286 22:55:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:36.286 22:55:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:36.286 22:55:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:36.286 22:55:02 -- scripts/common.sh@367 -- # return 0 00:02:36.286 22:55:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:36.286 22:55:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:36.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:36.286 --rc genhtml_branch_coverage=1 00:02:36.286 --rc genhtml_function_coverage=1 00:02:36.286 --rc genhtml_legend=1 00:02:36.286 --rc geninfo_all_blocks=1 00:02:36.286 --rc geninfo_unexecuted_blocks=1 00:02:36.286 00:02:36.286 ' 00:02:36.286 22:55:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:36.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:36.286 --rc genhtml_branch_coverage=1 00:02:36.286 --rc genhtml_function_coverage=1 00:02:36.286 --rc genhtml_legend=1 00:02:36.286 --rc geninfo_all_blocks=1 00:02:36.286 --rc geninfo_unexecuted_blocks=1 00:02:36.286 00:02:36.286 ' 00:02:36.286 22:55:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:36.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:36.286 --rc genhtml_branch_coverage=1 00:02:36.286 --rc genhtml_function_coverage=1 00:02:36.286 --rc genhtml_legend=1 00:02:36.286 --rc geninfo_all_blocks=1 00:02:36.286 --rc geninfo_unexecuted_blocks=1 00:02:36.286 00:02:36.286 ' 00:02:36.286 22:55:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:36.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:36.286 --rc genhtml_branch_coverage=1 00:02:36.286 --rc genhtml_function_coverage=1 00:02:36.286 --rc genhtml_legend=1 00:02:36.286 --rc geninfo_all_blocks=1 00:02:36.286 --rc geninfo_unexecuted_blocks=1 00:02:36.286 00:02:36.286 ' 00:02:36.286 22:55:02 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:36.286 22:55:02 -- nvmf/common.sh@7 -- # uname -s 00:02:36.286 22:55:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:36.286 22:55:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:36.286 22:55:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:36.286 22:55:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:36.286 22:55:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:36.286 22:55:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:36.286 22:55:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:36.286 22:55:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:36.286 22:55:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:36.286 22:55:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:36.286 22:55:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:36.286 22:55:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:36.286 22:55:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:36.286 22:55:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:36.286 22:55:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:36.286 22:55:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:36.286 22:55:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:36.286 22:55:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:36.286 22:55:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:36.286 22:55:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:36.286 22:55:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:36.286 22:55:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:36.286 22:55:02 -- paths/export.sh@5 -- # export PATH 00:02:36.286 22:55:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:36.286 22:55:02 -- nvmf/common.sh@46 -- # : 0 00:02:36.286 22:55:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:36.286 22:55:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:36.286 22:55:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:36.286 22:55:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:36.286 22:55:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:36.286 22:55:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:36.286 22:55:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:36.286 22:55:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:36.286 22:55:02 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:36.286 22:55:02 -- spdk/autotest.sh@32 -- # uname -s 00:02:36.286 22:55:02 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:36.286 22:55:02 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:36.286 22:55:02 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:36.286 22:55:02 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:36.286 22:55:02 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:36.286 22:55:02 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:36.286 22:55:02 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:36.286 22:55:02 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:36.286 22:55:02 -- spdk/autotest.sh@48 -- # udevadm_pid=50268 00:02:36.286 22:55:02 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:36.286 22:55:02 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:36.286 22:55:02 -- spdk/autotest.sh@54 -- # echo 50279 00:02:36.286 22:55:02 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:36.286 22:55:02 -- spdk/autotest.sh@56 -- # echo 50283 00:02:36.286 22:55:02 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:36.286 22:55:02 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:36.286 22:55:02 -- spdk/autotest.sh@60 -- # echo 50288 00:02:36.286 22:55:02 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:36.286 22:55:02 -- spdk/autotest.sh@62 -- # echo 50290 00:02:36.287 22:55:02 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:36.287 22:55:02 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:36.287 22:55:02 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:36.287 22:55:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:36.287 22:55:02 -- common/autotest_common.sh@10 -- # set +x 00:02:36.287 22:55:02 -- spdk/autotest.sh@70 -- # create_test_list 00:02:36.287 22:55:02 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:36.287 22:55:02 -- common/autotest_common.sh@10 -- # set +x 00:02:36.287 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:36.287 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:36.548 22:55:02 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:36.548 22:55:02 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:36.548 22:55:02 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:36.548 22:55:02 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:36.548 22:55:02 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:36.548 22:55:02 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:36.548 22:55:02 -- common/autotest_common.sh@1450 -- # uname 00:02:36.548 22:55:02 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:36.548 22:55:02 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:36.548 22:55:02 -- common/autotest_common.sh@1470 -- # uname 00:02:36.548 22:55:02 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:36.548 22:55:02 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:36.548 22:55:02 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:36.548 lcov: LCOV version 1.15 00:02:36.548 22:55:02 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:39.853 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:39.853 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:39.853 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:39.853 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:39.853 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:39.853 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:11.981 22:55:34 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:11.981 22:55:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:11.981 22:55:34 -- common/autotest_common.sh@10 -- # set +x 00:03:11.981 22:55:34 -- spdk/autotest.sh@89 -- # rm -f 00:03:11.981 22:55:34 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:11.981 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:11.981 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:11.981 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:11.981 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:11.981 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:11.981 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:11.981 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:11.982 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:11.982 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:11.982 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:11.982 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:11.982 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:11.982 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:11.982 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:11.982 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:11.982 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:11.982 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:11.982 22:55:36 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:11.982 22:55:36 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:11.982 22:55:36 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:11.982 22:55:36 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:11.982 22:55:36 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:11.982 22:55:36 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:11.982 22:55:36 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:11.982 22:55:36 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:11.982 22:55:36 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:11.982 22:55:36 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:11.982 22:55:36 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:11.982 22:55:36 -- spdk/autotest.sh@108 -- # grep -v p 00:03:11.982 22:55:36 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:11.982 22:55:36 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:11.982 22:55:36 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:11.982 22:55:36 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:11.982 22:55:36 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:11.982 No valid GPT data, bailing 00:03:11.982 22:55:36 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:11.982 22:55:36 -- scripts/common.sh@393 -- # pt= 00:03:11.982 22:55:36 -- scripts/common.sh@394 -- # return 1 00:03:11.982 22:55:36 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:11.982 1+0 records in 00:03:11.982 1+0 records out 00:03:11.982 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0021423 s, 489 MB/s 00:03:11.982 22:55:36 -- spdk/autotest.sh@116 -- # sync 00:03:11.982 22:55:36 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:11.982 22:55:36 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:11.982 22:55:36 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:11.982 22:55:38 -- spdk/autotest.sh@122 -- # uname -s 00:03:11.982 22:55:38 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:11.982 22:55:38 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:11.982 22:55:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:11.982 22:55:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:11.982 22:55:38 -- common/autotest_common.sh@10 -- # set +x 00:03:11.982 ************************************ 00:03:11.982 START TEST setup.sh 00:03:11.982 ************************************ 00:03:11.982 22:55:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:11.982 * Looking for test storage... 00:03:11.982 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:11.982 22:55:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:11.982 22:55:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:11.982 22:55:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:12.242 22:55:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:12.242 22:55:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:12.242 22:55:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:12.242 22:55:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:12.242 22:55:38 -- scripts/common.sh@335 -- # IFS=.-: 00:03:12.242 22:55:38 -- scripts/common.sh@335 -- # read -ra ver1 00:03:12.242 22:55:38 -- scripts/common.sh@336 -- # IFS=.-: 00:03:12.242 22:55:38 -- scripts/common.sh@336 -- # read -ra ver2 00:03:12.242 22:55:38 -- scripts/common.sh@337 -- # local 'op=<' 00:03:12.242 22:55:38 -- scripts/common.sh@339 -- # ver1_l=2 00:03:12.242 22:55:38 -- scripts/common.sh@340 -- # ver2_l=1 00:03:12.242 22:55:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:12.242 22:55:38 -- scripts/common.sh@343 -- # case "$op" in 00:03:12.242 22:55:38 -- scripts/common.sh@344 -- # : 1 00:03:12.242 22:55:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:12.242 22:55:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:12.242 22:55:38 -- scripts/common.sh@364 -- # decimal 1 00:03:12.242 22:55:38 -- scripts/common.sh@352 -- # local d=1 00:03:12.242 22:55:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:12.242 22:55:38 -- scripts/common.sh@354 -- # echo 1 00:03:12.242 22:55:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:12.242 22:55:38 -- scripts/common.sh@365 -- # decimal 2 00:03:12.242 22:55:38 -- scripts/common.sh@352 -- # local d=2 00:03:12.242 22:55:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:12.242 22:55:38 -- scripts/common.sh@354 -- # echo 2 00:03:12.242 22:55:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:12.242 22:55:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:12.242 22:55:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:12.242 22:55:38 -- scripts/common.sh@367 -- # return 0 00:03:12.242 22:55:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:12.242 22:55:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:12.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.242 --rc genhtml_branch_coverage=1 00:03:12.242 --rc genhtml_function_coverage=1 00:03:12.242 --rc genhtml_legend=1 00:03:12.242 --rc geninfo_all_blocks=1 00:03:12.242 --rc geninfo_unexecuted_blocks=1 00:03:12.242 00:03:12.242 ' 00:03:12.242 22:55:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:12.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.242 --rc genhtml_branch_coverage=1 00:03:12.242 --rc genhtml_function_coverage=1 00:03:12.242 --rc genhtml_legend=1 00:03:12.242 --rc geninfo_all_blocks=1 00:03:12.242 --rc geninfo_unexecuted_blocks=1 00:03:12.242 00:03:12.242 ' 00:03:12.242 22:55:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:12.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.242 --rc genhtml_branch_coverage=1 00:03:12.242 --rc genhtml_function_coverage=1 00:03:12.242 --rc genhtml_legend=1 00:03:12.242 --rc geninfo_all_blocks=1 00:03:12.242 --rc geninfo_unexecuted_blocks=1 00:03:12.242 00:03:12.242 ' 00:03:12.242 22:55:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:12.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.242 --rc genhtml_branch_coverage=1 00:03:12.242 --rc genhtml_function_coverage=1 00:03:12.242 --rc genhtml_legend=1 00:03:12.242 --rc geninfo_all_blocks=1 00:03:12.242 --rc geninfo_unexecuted_blocks=1 00:03:12.242 00:03:12.242 ' 00:03:12.242 22:55:38 -- setup/test-setup.sh@10 -- # uname -s 00:03:12.242 22:55:38 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:12.242 22:55:38 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:12.242 22:55:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.242 22:55:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.242 22:55:38 -- common/autotest_common.sh@10 -- # set +x 00:03:12.242 ************************************ 00:03:12.242 START TEST acl 00:03:12.242 ************************************ 00:03:12.242 22:55:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:12.242 * Looking for test storage... 00:03:12.242 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:12.242 22:55:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:12.242 22:55:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:12.242 22:55:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:12.242 22:55:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:12.242 22:55:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:12.242 22:55:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:12.242 22:55:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:12.242 22:55:38 -- scripts/common.sh@335 -- # IFS=.-: 00:03:12.242 22:55:38 -- scripts/common.sh@335 -- # read -ra ver1 00:03:12.242 22:55:38 -- scripts/common.sh@336 -- # IFS=.-: 00:03:12.242 22:55:38 -- scripts/common.sh@336 -- # read -ra ver2 00:03:12.242 22:55:38 -- scripts/common.sh@337 -- # local 'op=<' 00:03:12.242 22:55:38 -- scripts/common.sh@339 -- # ver1_l=2 00:03:12.242 22:55:38 -- scripts/common.sh@340 -- # ver2_l=1 00:03:12.242 22:55:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:12.242 22:55:38 -- scripts/common.sh@343 -- # case "$op" in 00:03:12.242 22:55:38 -- scripts/common.sh@344 -- # : 1 00:03:12.242 22:55:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:12.242 22:55:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:12.242 22:55:38 -- scripts/common.sh@364 -- # decimal 1 00:03:12.242 22:55:38 -- scripts/common.sh@352 -- # local d=1 00:03:12.242 22:55:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:12.242 22:55:38 -- scripts/common.sh@354 -- # echo 1 00:03:12.242 22:55:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:12.242 22:55:38 -- scripts/common.sh@365 -- # decimal 2 00:03:12.242 22:55:38 -- scripts/common.sh@352 -- # local d=2 00:03:12.242 22:55:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:12.242 22:55:38 -- scripts/common.sh@354 -- # echo 2 00:03:12.242 22:55:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:12.242 22:55:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:12.242 22:55:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:12.242 22:55:38 -- scripts/common.sh@367 -- # return 0 00:03:12.243 22:55:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:12.243 22:55:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:12.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.243 --rc genhtml_branch_coverage=1 00:03:12.243 --rc genhtml_function_coverage=1 00:03:12.243 --rc genhtml_legend=1 00:03:12.243 --rc geninfo_all_blocks=1 00:03:12.243 --rc geninfo_unexecuted_blocks=1 00:03:12.243 00:03:12.243 ' 00:03:12.243 22:55:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:12.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.243 --rc genhtml_branch_coverage=1 00:03:12.243 --rc genhtml_function_coverage=1 00:03:12.243 --rc genhtml_legend=1 00:03:12.243 --rc geninfo_all_blocks=1 00:03:12.243 --rc geninfo_unexecuted_blocks=1 00:03:12.243 00:03:12.243 ' 00:03:12.243 22:55:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:12.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.243 --rc genhtml_branch_coverage=1 00:03:12.243 --rc genhtml_function_coverage=1 00:03:12.243 --rc genhtml_legend=1 00:03:12.243 --rc geninfo_all_blocks=1 00:03:12.243 --rc geninfo_unexecuted_blocks=1 00:03:12.243 00:03:12.243 ' 00:03:12.243 22:55:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:12.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.243 --rc genhtml_branch_coverage=1 00:03:12.243 --rc genhtml_function_coverage=1 00:03:12.243 --rc genhtml_legend=1 00:03:12.243 --rc geninfo_all_blocks=1 00:03:12.243 --rc geninfo_unexecuted_blocks=1 00:03:12.243 00:03:12.243 ' 00:03:12.243 22:55:38 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:12.243 22:55:38 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:12.243 22:55:38 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:12.243 22:55:38 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:12.243 22:55:38 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:12.243 22:55:38 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:12.243 22:55:38 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:12.243 22:55:38 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:12.243 22:55:38 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:12.243 22:55:38 -- setup/acl.sh@12 -- # devs=() 00:03:12.243 22:55:38 -- setup/acl.sh@12 -- # declare -a devs 00:03:12.243 22:55:38 -- setup/acl.sh@13 -- # drivers=() 00:03:12.243 22:55:38 -- setup/acl.sh@13 -- # declare -A drivers 00:03:12.243 22:55:38 -- setup/acl.sh@51 -- # setup reset 00:03:12.243 22:55:38 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:12.243 22:55:38 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:14.152 22:55:40 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:14.152 22:55:40 -- setup/acl.sh@16 -- # local dev driver 00:03:14.152 22:55:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:14.152 22:55:40 -- setup/acl.sh@15 -- # setup output status 00:03:14.152 22:55:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.152 22:55:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:15.092 Hugepages 00:03:15.092 node hugesize free / total 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 00:03:15.092 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # continue 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:15.092 22:55:41 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:15.092 22:55:41 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:15.092 22:55:41 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:15.092 22:55:41 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.092 22:55:41 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:15.092 22:55:41 -- setup/acl.sh@54 -- # run_test denied denied 00:03:15.092 22:55:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.092 22:55:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.092 22:55:41 -- common/autotest_common.sh@10 -- # set +x 00:03:15.092 ************************************ 00:03:15.092 START TEST denied 00:03:15.092 ************************************ 00:03:15.092 22:55:41 -- common/autotest_common.sh@1114 -- # denied 00:03:15.092 22:55:41 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:15.092 22:55:41 -- setup/acl.sh@38 -- # setup output config 00:03:15.092 22:55:41 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:15.092 22:55:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.092 22:55:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:16.999 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:16.999 22:55:43 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:16.999 22:55:43 -- setup/acl.sh@28 -- # local dev driver 00:03:16.999 22:55:43 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:16.999 22:55:43 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:16.999 22:55:43 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:16.999 22:55:43 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:16.999 22:55:43 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:16.999 22:55:43 -- setup/acl.sh@41 -- # setup reset 00:03:16.999 22:55:43 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:16.999 22:55:43 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:19.541 00:03:19.541 real 0m4.222s 00:03:19.541 user 0m1.237s 00:03:19.541 sys 0m2.085s 00:03:19.541 22:55:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.541 22:55:45 -- common/autotest_common.sh@10 -- # set +x 00:03:19.541 ************************************ 00:03:19.541 END TEST denied 00:03:19.541 ************************************ 00:03:19.541 22:55:45 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:19.541 22:55:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.541 22:55:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.541 22:55:45 -- common/autotest_common.sh@10 -- # set +x 00:03:19.541 ************************************ 00:03:19.541 START TEST allowed 00:03:19.541 ************************************ 00:03:19.541 22:55:45 -- common/autotest_common.sh@1114 -- # allowed 00:03:19.541 22:55:45 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:19.541 22:55:45 -- setup/acl.sh@45 -- # setup output config 00:03:19.541 22:55:45 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:19.541 22:55:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.541 22:55:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:22.089 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:22.089 22:55:48 -- setup/acl.sh@47 -- # verify 00:03:22.089 22:55:48 -- setup/acl.sh@28 -- # local dev driver 00:03:22.089 22:55:48 -- setup/acl.sh@48 -- # setup reset 00:03:22.089 22:55:48 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:22.089 22:55:48 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:23.466 00:03:23.466 real 0m4.056s 00:03:23.466 user 0m1.081s 00:03:23.466 sys 0m1.884s 00:03:23.466 22:55:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.466 22:55:49 -- common/autotest_common.sh@10 -- # set +x 00:03:23.466 ************************************ 00:03:23.466 END TEST allowed 00:03:23.466 ************************************ 00:03:23.466 00:03:23.466 real 0m11.303s 00:03:23.466 user 0m3.538s 00:03:23.466 sys 0m5.873s 00:03:23.466 22:55:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.466 22:55:49 -- common/autotest_common.sh@10 -- # set +x 00:03:23.466 ************************************ 00:03:23.466 END TEST acl 00:03:23.466 ************************************ 00:03:23.466 22:55:49 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:23.466 22:55:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.466 22:55:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.466 22:55:49 -- common/autotest_common.sh@10 -- # set +x 00:03:23.466 ************************************ 00:03:23.466 START TEST hugepages 00:03:23.466 ************************************ 00:03:23.466 22:55:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:23.466 * Looking for test storage... 00:03:23.466 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:23.466 22:55:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:23.466 22:55:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:23.466 22:55:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:23.726 22:55:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:23.726 22:55:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:23.726 22:55:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:23.726 22:55:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:23.726 22:55:49 -- scripts/common.sh@335 -- # IFS=.-: 00:03:23.726 22:55:49 -- scripts/common.sh@335 -- # read -ra ver1 00:03:23.726 22:55:49 -- scripts/common.sh@336 -- # IFS=.-: 00:03:23.726 22:55:49 -- scripts/common.sh@336 -- # read -ra ver2 00:03:23.726 22:55:49 -- scripts/common.sh@337 -- # local 'op=<' 00:03:23.726 22:55:49 -- scripts/common.sh@339 -- # ver1_l=2 00:03:23.726 22:55:49 -- scripts/common.sh@340 -- # ver2_l=1 00:03:23.726 22:55:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:23.726 22:55:49 -- scripts/common.sh@343 -- # case "$op" in 00:03:23.726 22:55:49 -- scripts/common.sh@344 -- # : 1 00:03:23.726 22:55:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:23.726 22:55:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:23.726 22:55:49 -- scripts/common.sh@364 -- # decimal 1 00:03:23.726 22:55:49 -- scripts/common.sh@352 -- # local d=1 00:03:23.726 22:55:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:23.726 22:55:49 -- scripts/common.sh@354 -- # echo 1 00:03:23.726 22:55:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:23.726 22:55:49 -- scripts/common.sh@365 -- # decimal 2 00:03:23.726 22:55:49 -- scripts/common.sh@352 -- # local d=2 00:03:23.726 22:55:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:23.726 22:55:49 -- scripts/common.sh@354 -- # echo 2 00:03:23.726 22:55:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:23.726 22:55:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:23.726 22:55:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:23.726 22:55:49 -- scripts/common.sh@367 -- # return 0 00:03:23.726 22:55:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:23.726 22:55:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:23.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.726 --rc genhtml_branch_coverage=1 00:03:23.726 --rc genhtml_function_coverage=1 00:03:23.726 --rc genhtml_legend=1 00:03:23.726 --rc geninfo_all_blocks=1 00:03:23.726 --rc geninfo_unexecuted_blocks=1 00:03:23.726 00:03:23.726 ' 00:03:23.727 22:55:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:23.727 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.727 --rc genhtml_branch_coverage=1 00:03:23.727 --rc genhtml_function_coverage=1 00:03:23.727 --rc genhtml_legend=1 00:03:23.727 --rc geninfo_all_blocks=1 00:03:23.727 --rc geninfo_unexecuted_blocks=1 00:03:23.727 00:03:23.727 ' 00:03:23.727 22:55:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:23.727 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.727 --rc genhtml_branch_coverage=1 00:03:23.727 --rc genhtml_function_coverage=1 00:03:23.727 --rc genhtml_legend=1 00:03:23.727 --rc geninfo_all_blocks=1 00:03:23.727 --rc geninfo_unexecuted_blocks=1 00:03:23.727 00:03:23.727 ' 00:03:23.727 22:55:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:23.727 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.727 --rc genhtml_branch_coverage=1 00:03:23.727 --rc genhtml_function_coverage=1 00:03:23.727 --rc genhtml_legend=1 00:03:23.727 --rc geninfo_all_blocks=1 00:03:23.727 --rc geninfo_unexecuted_blocks=1 00:03:23.727 00:03:23.727 ' 00:03:23.727 22:55:49 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:23.727 22:55:49 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:23.727 22:55:49 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:23.727 22:55:49 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:23.727 22:55:49 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:23.727 22:55:49 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:23.727 22:55:49 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:23.727 22:55:49 -- setup/common.sh@18 -- # local node= 00:03:23.727 22:55:49 -- setup/common.sh@19 -- # local var val 00:03:23.727 22:55:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.727 22:55:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.727 22:55:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.727 22:55:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.727 22:55:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.727 22:55:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44776160 kB' 'MemAvailable: 48388456 kB' 'Buffers: 11580 kB' 'Cached: 9185920 kB' 'SwapCached: 0 kB' 'Active: 6086640 kB' 'Inactive: 3666140 kB' 'Active(anon): 5724760 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 558280 kB' 'Mapped: 142020 kB' 'Shmem: 5169480 kB' 'KReclaimable: 155712 kB' 'Slab: 522560 kB' 'SReclaimable: 155712 kB' 'SUnreclaim: 366848 kB' 'KernelStack: 12768 kB' 'PageTables: 7596 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559276 kB' 'Committed_AS: 7490880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195076 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.727 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.727 22:55:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.728 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.728 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # continue 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.729 22:55:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.729 22:55:49 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.729 22:55:49 -- setup/common.sh@33 -- # echo 2048 00:03:23.729 22:55:49 -- setup/common.sh@33 -- # return 0 00:03:23.729 22:55:49 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:23.729 22:55:49 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:23.729 22:55:49 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:23.729 22:55:49 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:23.729 22:55:49 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:23.729 22:55:49 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:23.729 22:55:49 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:23.729 22:55:49 -- setup/hugepages.sh@207 -- # get_nodes 00:03:23.729 22:55:49 -- setup/hugepages.sh@27 -- # local node 00:03:23.729 22:55:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.729 22:55:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:23.729 22:55:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.729 22:55:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:23.729 22:55:49 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.729 22:55:49 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.729 22:55:49 -- setup/hugepages.sh@208 -- # clear_hp 00:03:23.729 22:55:49 -- setup/hugepages.sh@37 -- # local node hp 00:03:23.729 22:55:49 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:23.729 22:55:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.729 22:55:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.729 22:55:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.729 22:55:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.729 22:55:49 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:23.729 22:55:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.729 22:55:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.729 22:55:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.729 22:55:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.729 22:55:49 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:23.729 22:55:49 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:23.729 22:55:49 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:23.729 22:55:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.729 22:55:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.729 22:55:49 -- common/autotest_common.sh@10 -- # set +x 00:03:23.729 ************************************ 00:03:23.729 START TEST default_setup 00:03:23.729 ************************************ 00:03:23.729 22:55:49 -- common/autotest_common.sh@1114 -- # default_setup 00:03:23.729 22:55:49 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:23.729 22:55:49 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:23.729 22:55:49 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:23.729 22:55:49 -- setup/hugepages.sh@51 -- # shift 00:03:23.729 22:55:49 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:23.729 22:55:49 -- setup/hugepages.sh@52 -- # local node_ids 00:03:23.729 22:55:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:23.729 22:55:49 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:23.729 22:55:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:23.729 22:55:49 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:23.729 22:55:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:23.729 22:55:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:23.729 22:55:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:23.729 22:55:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:23.729 22:55:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:23.729 22:55:49 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:23.729 22:55:49 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:23.729 22:55:49 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:23.729 22:55:49 -- setup/hugepages.sh@73 -- # return 0 00:03:23.729 22:55:49 -- setup/hugepages.sh@137 -- # setup output 00:03:23.729 22:55:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.729 22:55:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:25.112 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:25.112 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:25.112 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:25.112 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:25.112 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:25.112 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:25.112 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:25.112 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:25.112 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:25.112 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:25.112 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:25.112 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:25.112 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:25.112 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:25.112 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:25.112 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:26.061 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:26.061 22:55:52 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:26.061 22:55:52 -- setup/hugepages.sh@89 -- # local node 00:03:26.061 22:55:52 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.061 22:55:52 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.061 22:55:52 -- setup/hugepages.sh@92 -- # local surp 00:03:26.061 22:55:52 -- setup/hugepages.sh@93 -- # local resv 00:03:26.061 22:55:52 -- setup/hugepages.sh@94 -- # local anon 00:03:26.061 22:55:52 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.061 22:55:52 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.061 22:55:52 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.061 22:55:52 -- setup/common.sh@18 -- # local node= 00:03:26.061 22:55:52 -- setup/common.sh@19 -- # local var val 00:03:26.061 22:55:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.061 22:55:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.061 22:55:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.061 22:55:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.061 22:55:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.061 22:55:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.061 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.061 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46787300 kB' 'MemAvailable: 50399956 kB' 'Buffers: 11580 kB' 'Cached: 9186040 kB' 'SwapCached: 0 kB' 'Active: 6091384 kB' 'Inactive: 3666140 kB' 'Active(anon): 5729504 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 563612 kB' 'Mapped: 141552 kB' 'Shmem: 5169600 kB' 'KReclaimable: 156432 kB' 'Slab: 523076 kB' 'SReclaimable: 156432 kB' 'SUnreclaim: 366644 kB' 'KernelStack: 12832 kB' 'PageTables: 7408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7493572 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195220 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.062 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.062 22:55:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.062 22:55:52 -- setup/common.sh@33 -- # echo 0 00:03:26.063 22:55:52 -- setup/common.sh@33 -- # return 0 00:03:26.063 22:55:52 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.063 22:55:52 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.063 22:55:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.063 22:55:52 -- setup/common.sh@18 -- # local node= 00:03:26.063 22:55:52 -- setup/common.sh@19 -- # local var val 00:03:26.063 22:55:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.063 22:55:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.063 22:55:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.063 22:55:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.063 22:55:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.063 22:55:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46792128 kB' 'MemAvailable: 50404784 kB' 'Buffers: 11580 kB' 'Cached: 9186044 kB' 'SwapCached: 0 kB' 'Active: 6090900 kB' 'Inactive: 3666140 kB' 'Active(anon): 5729020 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 563092 kB' 'Mapped: 141588 kB' 'Shmem: 5169604 kB' 'KReclaimable: 156432 kB' 'Slab: 523032 kB' 'SReclaimable: 156432 kB' 'SUnreclaim: 366600 kB' 'KernelStack: 12656 kB' 'PageTables: 6848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7493584 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.063 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.063 22:55:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.064 22:55:52 -- setup/common.sh@33 -- # echo 0 00:03:26.064 22:55:52 -- setup/common.sh@33 -- # return 0 00:03:26.064 22:55:52 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.064 22:55:52 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.064 22:55:52 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.064 22:55:52 -- setup/common.sh@18 -- # local node= 00:03:26.064 22:55:52 -- setup/common.sh@19 -- # local var val 00:03:26.064 22:55:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.064 22:55:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.064 22:55:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.064 22:55:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.064 22:55:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.064 22:55:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46792560 kB' 'MemAvailable: 50405216 kB' 'Buffers: 11580 kB' 'Cached: 9186056 kB' 'SwapCached: 0 kB' 'Active: 6089544 kB' 'Inactive: 3666140 kB' 'Active(anon): 5727664 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 561744 kB' 'Mapped: 141532 kB' 'Shmem: 5169616 kB' 'KReclaimable: 156432 kB' 'Slab: 523068 kB' 'SReclaimable: 156432 kB' 'SUnreclaim: 366636 kB' 'KernelStack: 12640 kB' 'PageTables: 7108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7493600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.064 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.064 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.065 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.065 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.065 22:55:52 -- setup/common.sh@33 -- # echo 0 00:03:26.065 22:55:52 -- setup/common.sh@33 -- # return 0 00:03:26.065 22:55:52 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.065 22:55:52 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:26.065 nr_hugepages=1024 00:03:26.065 22:55:52 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.065 resv_hugepages=0 00:03:26.065 22:55:52 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.065 surplus_hugepages=0 00:03:26.065 22:55:52 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.065 anon_hugepages=0 00:03:26.065 22:55:52 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.065 22:55:52 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:26.065 22:55:52 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.065 22:55:52 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.065 22:55:52 -- setup/common.sh@18 -- # local node= 00:03:26.065 22:55:52 -- setup/common.sh@19 -- # local var val 00:03:26.065 22:55:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.065 22:55:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.065 22:55:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.065 22:55:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.065 22:55:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.065 22:55:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46793296 kB' 'MemAvailable: 50405952 kB' 'Buffers: 11580 kB' 'Cached: 9186072 kB' 'SwapCached: 0 kB' 'Active: 6089844 kB' 'Inactive: 3666140 kB' 'Active(anon): 5727964 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 562180 kB' 'Mapped: 141456 kB' 'Shmem: 5169632 kB' 'KReclaimable: 156432 kB' 'Slab: 523048 kB' 'SReclaimable: 156432 kB' 'SUnreclaim: 366616 kB' 'KernelStack: 12672 kB' 'PageTables: 7204 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7493616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.327 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.327 22:55:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.328 22:55:52 -- setup/common.sh@33 -- # echo 1024 00:03:26.328 22:55:52 -- setup/common.sh@33 -- # return 0 00:03:26.328 22:55:52 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.328 22:55:52 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.328 22:55:52 -- setup/hugepages.sh@27 -- # local node 00:03:26.328 22:55:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.328 22:55:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:26.328 22:55:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.328 22:55:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:26.328 22:55:52 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.328 22:55:52 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.328 22:55:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.328 22:55:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.328 22:55:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.328 22:55:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.328 22:55:52 -- setup/common.sh@18 -- # local node=0 00:03:26.328 22:55:52 -- setup/common.sh@19 -- # local var val 00:03:26.328 22:55:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.328 22:55:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.328 22:55:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.328 22:55:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.328 22:55:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.328 22:55:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28060028 kB' 'MemUsed: 4765828 kB' 'SwapCached: 0 kB' 'Active: 1690700 kB' 'Inactive: 108452 kB' 'Active(anon): 1542784 kB' 'Inactive(anon): 0 kB' 'Active(file): 147916 kB' 'Inactive(file): 108452 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1532544 kB' 'Mapped: 61748 kB' 'AnonPages: 270248 kB' 'Shmem: 1276176 kB' 'KernelStack: 7608 kB' 'PageTables: 3832 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104732 kB' 'Slab: 313796 kB' 'SReclaimable: 104732 kB' 'SUnreclaim: 209064 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.328 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.328 22:55:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # continue 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.329 22:55:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.329 22:55:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.329 22:55:52 -- setup/common.sh@33 -- # echo 0 00:03:26.329 22:55:52 -- setup/common.sh@33 -- # return 0 00:03:26.329 22:55:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.329 22:55:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.329 22:55:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.329 22:55:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.329 22:55:52 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:26.329 node0=1024 expecting 1024 00:03:26.329 22:55:52 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:26.329 00:03:26.329 real 0m2.572s 00:03:26.329 user 0m0.692s 00:03:26.329 sys 0m1.009s 00:03:26.329 22:55:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.329 22:55:52 -- common/autotest_common.sh@10 -- # set +x 00:03:26.329 ************************************ 00:03:26.329 END TEST default_setup 00:03:26.329 ************************************ 00:03:26.329 22:55:52 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:26.329 22:55:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.329 22:55:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.329 22:55:52 -- common/autotest_common.sh@10 -- # set +x 00:03:26.329 ************************************ 00:03:26.329 START TEST per_node_1G_alloc 00:03:26.329 ************************************ 00:03:26.329 22:55:52 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:26.329 22:55:52 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:26.329 22:55:52 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:26.329 22:55:52 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:26.329 22:55:52 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:26.329 22:55:52 -- setup/hugepages.sh@51 -- # shift 00:03:26.329 22:55:52 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:26.329 22:55:52 -- setup/hugepages.sh@52 -- # local node_ids 00:03:26.330 22:55:52 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.330 22:55:52 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:26.330 22:55:52 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:26.330 22:55:52 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:26.330 22:55:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.330 22:55:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:26.330 22:55:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.330 22:55:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.330 22:55:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.330 22:55:52 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:26.330 22:55:52 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:26.330 22:55:52 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:26.330 22:55:52 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:26.330 22:55:52 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:26.330 22:55:52 -- setup/hugepages.sh@73 -- # return 0 00:03:26.330 22:55:52 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:26.330 22:55:52 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:26.330 22:55:52 -- setup/hugepages.sh@146 -- # setup output 00:03:26.330 22:55:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.330 22:55:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:27.720 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:27.720 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:27.720 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:27.720 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:27.720 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:27.720 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:27.720 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:27.720 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:27.720 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:27.720 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:27.720 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:27.720 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:27.720 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:27.720 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:27.720 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:27.720 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:27.720 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:27.720 22:55:53 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:27.720 22:55:53 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:27.720 22:55:53 -- setup/hugepages.sh@89 -- # local node 00:03:27.720 22:55:53 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:27.720 22:55:53 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:27.720 22:55:53 -- setup/hugepages.sh@92 -- # local surp 00:03:27.720 22:55:53 -- setup/hugepages.sh@93 -- # local resv 00:03:27.720 22:55:53 -- setup/hugepages.sh@94 -- # local anon 00:03:27.720 22:55:53 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:27.720 22:55:53 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:27.720 22:55:53 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:27.720 22:55:53 -- setup/common.sh@18 -- # local node= 00:03:27.720 22:55:53 -- setup/common.sh@19 -- # local var val 00:03:27.720 22:55:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.720 22:55:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.720 22:55:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.720 22:55:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.720 22:55:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.720 22:55:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46798492 kB' 'MemAvailable: 50411148 kB' 'Buffers: 11580 kB' 'Cached: 9186132 kB' 'SwapCached: 0 kB' 'Active: 6092720 kB' 'Inactive: 3666140 kB' 'Active(anon): 5730840 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 564424 kB' 'Mapped: 141484 kB' 'Shmem: 5169692 kB' 'KReclaimable: 156432 kB' 'Slab: 522940 kB' 'SReclaimable: 156432 kB' 'SUnreclaim: 366508 kB' 'KernelStack: 12736 kB' 'PageTables: 7404 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7493792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195300 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.720 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.720 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.721 22:55:53 -- setup/common.sh@33 -- # echo 0 00:03:27.721 22:55:53 -- setup/common.sh@33 -- # return 0 00:03:27.721 22:55:53 -- setup/hugepages.sh@97 -- # anon=0 00:03:27.721 22:55:53 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:27.721 22:55:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.721 22:55:53 -- setup/common.sh@18 -- # local node= 00:03:27.721 22:55:53 -- setup/common.sh@19 -- # local var val 00:03:27.721 22:55:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.721 22:55:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.721 22:55:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.721 22:55:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.721 22:55:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.721 22:55:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46801464 kB' 'MemAvailable: 50414120 kB' 'Buffers: 11580 kB' 'Cached: 9186132 kB' 'SwapCached: 0 kB' 'Active: 6093140 kB' 'Inactive: 3666140 kB' 'Active(anon): 5731260 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 564868 kB' 'Mapped: 141560 kB' 'Shmem: 5169692 kB' 'KReclaimable: 156432 kB' 'Slab: 522972 kB' 'SReclaimable: 156432 kB' 'SUnreclaim: 366540 kB' 'KernelStack: 12704 kB' 'PageTables: 7324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7493804 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195284 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.721 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.721 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:53 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.722 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.722 22:55:54 -- setup/common.sh@33 -- # echo 0 00:03:27.722 22:55:54 -- setup/common.sh@33 -- # return 0 00:03:27.722 22:55:54 -- setup/hugepages.sh@99 -- # surp=0 00:03:27.722 22:55:54 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:27.722 22:55:54 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:27.722 22:55:54 -- setup/common.sh@18 -- # local node= 00:03:27.722 22:55:54 -- setup/common.sh@19 -- # local var val 00:03:27.722 22:55:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.722 22:55:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.722 22:55:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.722 22:55:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.722 22:55:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.722 22:55:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.722 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46801760 kB' 'MemAvailable: 50414416 kB' 'Buffers: 11580 kB' 'Cached: 9186132 kB' 'SwapCached: 0 kB' 'Active: 6092840 kB' 'Inactive: 3666140 kB' 'Active(anon): 5730960 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 564588 kB' 'Mapped: 141544 kB' 'Shmem: 5169692 kB' 'KReclaimable: 156432 kB' 'Slab: 522972 kB' 'SReclaimable: 156432 kB' 'SUnreclaim: 366540 kB' 'KernelStack: 12704 kB' 'PageTables: 7316 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7493816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195284 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.723 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.723 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.724 22:55:54 -- setup/common.sh@33 -- # echo 0 00:03:27.724 22:55:54 -- setup/common.sh@33 -- # return 0 00:03:27.724 22:55:54 -- setup/hugepages.sh@100 -- # resv=0 00:03:27.724 22:55:54 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:27.724 nr_hugepages=1024 00:03:27.724 22:55:54 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:27.724 resv_hugepages=0 00:03:27.724 22:55:54 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:27.724 surplus_hugepages=0 00:03:27.724 22:55:54 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:27.724 anon_hugepages=0 00:03:27.724 22:55:54 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:27.724 22:55:54 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:27.724 22:55:54 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:27.724 22:55:54 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:27.724 22:55:54 -- setup/common.sh@18 -- # local node= 00:03:27.724 22:55:54 -- setup/common.sh@19 -- # local var val 00:03:27.724 22:55:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.724 22:55:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.724 22:55:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.724 22:55:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.724 22:55:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.724 22:55:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46804320 kB' 'MemAvailable: 50416976 kB' 'Buffers: 11580 kB' 'Cached: 9186160 kB' 'SwapCached: 0 kB' 'Active: 6092360 kB' 'Inactive: 3666140 kB' 'Active(anon): 5730480 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 563984 kB' 'Mapped: 141468 kB' 'Shmem: 5169720 kB' 'KReclaimable: 156432 kB' 'Slab: 522868 kB' 'SReclaimable: 156432 kB' 'SUnreclaim: 366436 kB' 'KernelStack: 12672 kB' 'PageTables: 7196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7493832 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195284 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.724 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.724 22:55:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.725 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.725 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.726 22:55:54 -- setup/common.sh@33 -- # echo 1024 00:03:27.726 22:55:54 -- setup/common.sh@33 -- # return 0 00:03:27.726 22:55:54 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:27.726 22:55:54 -- setup/hugepages.sh@112 -- # get_nodes 00:03:27.726 22:55:54 -- setup/hugepages.sh@27 -- # local node 00:03:27.726 22:55:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:27.726 22:55:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:27.726 22:55:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:27.726 22:55:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:27.726 22:55:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:27.726 22:55:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:27.726 22:55:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:27.726 22:55:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:27.726 22:55:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:27.726 22:55:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.726 22:55:54 -- setup/common.sh@18 -- # local node=0 00:03:27.726 22:55:54 -- setup/common.sh@19 -- # local var val 00:03:27.726 22:55:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.726 22:55:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.726 22:55:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:27.726 22:55:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:27.726 22:55:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.726 22:55:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 29119128 kB' 'MemUsed: 3706728 kB' 'SwapCached: 0 kB' 'Active: 1692308 kB' 'Inactive: 108452 kB' 'Active(anon): 1544392 kB' 'Inactive(anon): 0 kB' 'Active(file): 147916 kB' 'Inactive(file): 108452 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1532552 kB' 'Mapped: 61760 kB' 'AnonPages: 271308 kB' 'Shmem: 1276184 kB' 'KernelStack: 7640 kB' 'PageTables: 3880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104732 kB' 'Slab: 313700 kB' 'SReclaimable: 104732 kB' 'SUnreclaim: 208968 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.726 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.726 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@33 -- # echo 0 00:03:27.727 22:55:54 -- setup/common.sh@33 -- # return 0 00:03:27.727 22:55:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:27.727 22:55:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:27.727 22:55:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:27.727 22:55:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:27.727 22:55:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.727 22:55:54 -- setup/common.sh@18 -- # local node=1 00:03:27.727 22:55:54 -- setup/common.sh@19 -- # local var val 00:03:27.727 22:55:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.727 22:55:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.727 22:55:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:27.727 22:55:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:27.727 22:55:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.727 22:55:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17686324 kB' 'MemUsed: 10023468 kB' 'SwapCached: 0 kB' 'Active: 4400220 kB' 'Inactive: 3557688 kB' 'Active(anon): 4186256 kB' 'Inactive(anon): 0 kB' 'Active(file): 213964 kB' 'Inactive(file): 3557688 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7665216 kB' 'Mapped: 79708 kB' 'AnonPages: 292808 kB' 'Shmem: 3893564 kB' 'KernelStack: 5080 kB' 'PageTables: 3472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 51700 kB' 'Slab: 209168 kB' 'SReclaimable: 51700 kB' 'SUnreclaim: 157468 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # continue 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 22:55:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 22:55:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 22:55:54 -- setup/common.sh@33 -- # echo 0 00:03:27.728 22:55:54 -- setup/common.sh@33 -- # return 0 00:03:27.728 22:55:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:27.728 22:55:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:27.728 22:55:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:27.728 22:55:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:27.728 22:55:54 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:27.728 node0=512 expecting 512 00:03:27.728 22:55:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:27.728 22:55:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:27.728 22:55:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:27.728 22:55:54 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:27.728 node1=512 expecting 512 00:03:27.728 22:55:54 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:27.728 00:03:27.728 real 0m1.579s 00:03:27.728 user 0m0.636s 00:03:27.728 sys 0m0.912s 00:03:27.728 22:55:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:27.728 22:55:54 -- common/autotest_common.sh@10 -- # set +x 00:03:27.728 ************************************ 00:03:27.728 END TEST per_node_1G_alloc 00:03:27.728 ************************************ 00:03:27.989 22:55:54 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:27.989 22:55:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:27.989 22:55:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:27.989 22:55:54 -- common/autotest_common.sh@10 -- # set +x 00:03:27.989 ************************************ 00:03:27.989 START TEST even_2G_alloc 00:03:27.989 ************************************ 00:03:27.989 22:55:54 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:27.989 22:55:54 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:27.989 22:55:54 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:27.989 22:55:54 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:27.989 22:55:54 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:27.989 22:55:54 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:27.989 22:55:54 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:27.989 22:55:54 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:27.989 22:55:54 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:27.989 22:55:54 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:27.989 22:55:54 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:27.989 22:55:54 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:27.989 22:55:54 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:27.989 22:55:54 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:27.989 22:55:54 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:27.989 22:55:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.989 22:55:54 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:27.989 22:55:54 -- setup/hugepages.sh@83 -- # : 512 00:03:27.989 22:55:54 -- setup/hugepages.sh@84 -- # : 1 00:03:27.989 22:55:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.989 22:55:54 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:27.989 22:55:54 -- setup/hugepages.sh@83 -- # : 0 00:03:27.989 22:55:54 -- setup/hugepages.sh@84 -- # : 0 00:03:27.989 22:55:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.989 22:55:54 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:27.989 22:55:54 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:27.989 22:55:54 -- setup/hugepages.sh@153 -- # setup output 00:03:27.989 22:55:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:27.989 22:55:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:29.374 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.374 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:29.374 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.374 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.374 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.374 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.374 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.374 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.374 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.374 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.374 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.374 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.374 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.374 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.374 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.374 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.374 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.374 22:55:55 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:29.374 22:55:55 -- setup/hugepages.sh@89 -- # local node 00:03:29.374 22:55:55 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.374 22:55:55 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.374 22:55:55 -- setup/hugepages.sh@92 -- # local surp 00:03:29.374 22:55:55 -- setup/hugepages.sh@93 -- # local resv 00:03:29.374 22:55:55 -- setup/hugepages.sh@94 -- # local anon 00:03:29.374 22:55:55 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.374 22:55:55 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.374 22:55:55 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.374 22:55:55 -- setup/common.sh@18 -- # local node= 00:03:29.374 22:55:55 -- setup/common.sh@19 -- # local var val 00:03:29.374 22:55:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.374 22:55:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.374 22:55:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.374 22:55:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.374 22:55:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.374 22:55:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46784136 kB' 'MemAvailable: 50396756 kB' 'Buffers: 11580 kB' 'Cached: 9186232 kB' 'SwapCached: 0 kB' 'Active: 6091736 kB' 'Inactive: 3666140 kB' 'Active(anon): 5729856 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 563388 kB' 'Mapped: 140444 kB' 'Shmem: 5169792 kB' 'KReclaimable: 156360 kB' 'Slab: 522600 kB' 'SReclaimable: 156360 kB' 'SUnreclaim: 366240 kB' 'KernelStack: 12672 kB' 'PageTables: 7036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7479636 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195124 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.374 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.374 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.375 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.375 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.376 22:55:55 -- setup/common.sh@33 -- # echo 0 00:03:29.376 22:55:55 -- setup/common.sh@33 -- # return 0 00:03:29.376 22:55:55 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.376 22:55:55 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.376 22:55:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.376 22:55:55 -- setup/common.sh@18 -- # local node= 00:03:29.376 22:55:55 -- setup/common.sh@19 -- # local var val 00:03:29.376 22:55:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.376 22:55:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.376 22:55:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.376 22:55:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.376 22:55:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.376 22:55:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46793476 kB' 'MemAvailable: 50406096 kB' 'Buffers: 11580 kB' 'Cached: 9186236 kB' 'SwapCached: 0 kB' 'Active: 6092004 kB' 'Inactive: 3666140 kB' 'Active(anon): 5730124 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 563596 kB' 'Mapped: 140444 kB' 'Shmem: 5169796 kB' 'KReclaimable: 156360 kB' 'Slab: 522592 kB' 'SReclaimable: 156360 kB' 'SUnreclaim: 366232 kB' 'KernelStack: 12640 kB' 'PageTables: 6868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7479648 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195108 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.376 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.376 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.377 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.377 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.378 22:55:55 -- setup/common.sh@33 -- # echo 0 00:03:29.378 22:55:55 -- setup/common.sh@33 -- # return 0 00:03:29.378 22:55:55 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.378 22:55:55 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.378 22:55:55 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.378 22:55:55 -- setup/common.sh@18 -- # local node= 00:03:29.378 22:55:55 -- setup/common.sh@19 -- # local var val 00:03:29.378 22:55:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.378 22:55:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.378 22:55:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.378 22:55:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.378 22:55:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.378 22:55:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46792720 kB' 'MemAvailable: 50405340 kB' 'Buffers: 11580 kB' 'Cached: 9186236 kB' 'SwapCached: 0 kB' 'Active: 6092644 kB' 'Inactive: 3666140 kB' 'Active(anon): 5730764 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 564212 kB' 'Mapped: 140420 kB' 'Shmem: 5169796 kB' 'KReclaimable: 156360 kB' 'Slab: 522592 kB' 'SReclaimable: 156360 kB' 'SUnreclaim: 366232 kB' 'KernelStack: 12688 kB' 'PageTables: 7016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7479664 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195108 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.378 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.378 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.379 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.379 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.380 22:55:55 -- setup/common.sh@33 -- # echo 0 00:03:29.380 22:55:55 -- setup/common.sh@33 -- # return 0 00:03:29.380 22:55:55 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.380 22:55:55 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:29.380 nr_hugepages=1024 00:03:29.380 22:55:55 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.380 resv_hugepages=0 00:03:29.380 22:55:55 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.380 surplus_hugepages=0 00:03:29.380 22:55:55 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.380 anon_hugepages=0 00:03:29.380 22:55:55 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.380 22:55:55 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:29.380 22:55:55 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.380 22:55:55 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.380 22:55:55 -- setup/common.sh@18 -- # local node= 00:03:29.380 22:55:55 -- setup/common.sh@19 -- # local var val 00:03:29.380 22:55:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.380 22:55:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.380 22:55:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.380 22:55:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.380 22:55:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.380 22:55:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46793040 kB' 'MemAvailable: 50405660 kB' 'Buffers: 11580 kB' 'Cached: 9186260 kB' 'SwapCached: 0 kB' 'Active: 6091848 kB' 'Inactive: 3666140 kB' 'Active(anon): 5729968 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 563428 kB' 'Mapped: 140420 kB' 'Shmem: 5169820 kB' 'KReclaimable: 156360 kB' 'Slab: 522628 kB' 'SReclaimable: 156360 kB' 'SUnreclaim: 366268 kB' 'KernelStack: 12640 kB' 'PageTables: 6872 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7479676 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195108 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.380 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.380 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.381 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.381 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.382 22:55:55 -- setup/common.sh@33 -- # echo 1024 00:03:29.382 22:55:55 -- setup/common.sh@33 -- # return 0 00:03:29.382 22:55:55 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.382 22:55:55 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.382 22:55:55 -- setup/hugepages.sh@27 -- # local node 00:03:29.382 22:55:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.382 22:55:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:29.382 22:55:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.382 22:55:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:29.382 22:55:55 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.382 22:55:55 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.382 22:55:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.382 22:55:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.382 22:55:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.382 22:55:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.382 22:55:55 -- setup/common.sh@18 -- # local node=0 00:03:29.382 22:55:55 -- setup/common.sh@19 -- # local var val 00:03:29.382 22:55:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.382 22:55:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.382 22:55:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.382 22:55:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.382 22:55:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.382 22:55:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 29117360 kB' 'MemUsed: 3708496 kB' 'SwapCached: 0 kB' 'Active: 1694616 kB' 'Inactive: 108452 kB' 'Active(anon): 1546700 kB' 'Inactive(anon): 0 kB' 'Active(file): 147916 kB' 'Inactive(file): 108452 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1532568 kB' 'Mapped: 60788 kB' 'AnonPages: 273792 kB' 'Shmem: 1276200 kB' 'KernelStack: 7672 kB' 'PageTables: 4056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104732 kB' 'Slab: 313696 kB' 'SReclaimable: 104732 kB' 'SUnreclaim: 208964 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.382 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.382 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@33 -- # echo 0 00:03:29.383 22:55:55 -- setup/common.sh@33 -- # return 0 00:03:29.383 22:55:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.383 22:55:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.383 22:55:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.383 22:55:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:29.383 22:55:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.383 22:55:55 -- setup/common.sh@18 -- # local node=1 00:03:29.383 22:55:55 -- setup/common.sh@19 -- # local var val 00:03:29.383 22:55:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.383 22:55:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.383 22:55:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:29.383 22:55:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:29.383 22:55:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.383 22:55:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17675428 kB' 'MemUsed: 10034364 kB' 'SwapCached: 0 kB' 'Active: 4397492 kB' 'Inactive: 3557688 kB' 'Active(anon): 4183528 kB' 'Inactive(anon): 0 kB' 'Active(file): 213964 kB' 'Inactive(file): 3557688 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7665288 kB' 'Mapped: 79632 kB' 'AnonPages: 289988 kB' 'Shmem: 3893636 kB' 'KernelStack: 5032 kB' 'PageTables: 3032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 51628 kB' 'Slab: 208924 kB' 'SReclaimable: 51628 kB' 'SUnreclaim: 157296 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.383 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.383 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.384 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.384 22:55:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.385 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.385 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.385 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.385 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.385 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.385 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.385 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.385 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.385 22:55:55 -- setup/common.sh@32 -- # continue 00:03:29.385 22:55:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.385 22:55:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.385 22:55:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.385 22:55:55 -- setup/common.sh@33 -- # echo 0 00:03:29.385 22:55:55 -- setup/common.sh@33 -- # return 0 00:03:29.385 22:55:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.385 22:55:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.385 22:55:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.385 22:55:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.385 22:55:55 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:29.385 node0=512 expecting 512 00:03:29.385 22:55:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.385 22:55:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.385 22:55:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.385 22:55:55 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:29.385 node1=512 expecting 512 00:03:29.385 22:55:55 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:29.385 00:03:29.385 real 0m1.562s 00:03:29.385 user 0m0.682s 00:03:29.385 sys 0m0.847s 00:03:29.385 22:55:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:29.385 22:55:55 -- common/autotest_common.sh@10 -- # set +x 00:03:29.385 ************************************ 00:03:29.385 END TEST even_2G_alloc 00:03:29.385 ************************************ 00:03:29.385 22:55:55 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:29.385 22:55:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.385 22:55:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.385 22:55:55 -- common/autotest_common.sh@10 -- # set +x 00:03:29.385 ************************************ 00:03:29.385 START TEST odd_alloc 00:03:29.385 ************************************ 00:03:29.385 22:55:55 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:29.385 22:55:55 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:29.385 22:55:55 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:29.385 22:55:55 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:29.385 22:55:55 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:29.385 22:55:55 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:29.385 22:55:55 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:29.385 22:55:55 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:29.385 22:55:55 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:29.385 22:55:55 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:29.385 22:55:55 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:29.385 22:55:55 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:29.385 22:55:55 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:29.385 22:55:55 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:29.385 22:55:55 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:29.385 22:55:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:29.385 22:55:55 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:29.385 22:55:55 -- setup/hugepages.sh@83 -- # : 513 00:03:29.385 22:55:55 -- setup/hugepages.sh@84 -- # : 1 00:03:29.385 22:55:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:29.385 22:55:55 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:29.385 22:55:55 -- setup/hugepages.sh@83 -- # : 0 00:03:29.385 22:55:55 -- setup/hugepages.sh@84 -- # : 0 00:03:29.385 22:55:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:29.385 22:55:55 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:29.385 22:55:55 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:29.385 22:55:55 -- setup/hugepages.sh@160 -- # setup output 00:03:29.385 22:55:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.385 22:55:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:30.775 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.775 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:30.775 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.775 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.775 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.775 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.775 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.775 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.775 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.775 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.775 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.775 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.775 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.775 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.775 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.775 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.775 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.775 22:55:57 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:30.775 22:55:57 -- setup/hugepages.sh@89 -- # local node 00:03:30.775 22:55:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:30.775 22:55:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:30.775 22:55:57 -- setup/hugepages.sh@92 -- # local surp 00:03:30.775 22:55:57 -- setup/hugepages.sh@93 -- # local resv 00:03:30.775 22:55:57 -- setup/hugepages.sh@94 -- # local anon 00:03:30.775 22:55:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:30.775 22:55:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:30.775 22:55:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:30.775 22:55:57 -- setup/common.sh@18 -- # local node= 00:03:30.775 22:55:57 -- setup/common.sh@19 -- # local var val 00:03:30.775 22:55:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.775 22:55:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.776 22:55:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.776 22:55:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.776 22:55:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.776 22:55:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46783844 kB' 'MemAvailable: 50396464 kB' 'Buffers: 11580 kB' 'Cached: 9186344 kB' 'SwapCached: 0 kB' 'Active: 6093716 kB' 'Inactive: 3666140 kB' 'Active(anon): 5731836 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 565280 kB' 'Mapped: 140448 kB' 'Shmem: 5169904 kB' 'KReclaimable: 156360 kB' 'Slab: 522840 kB' 'SReclaimable: 156360 kB' 'SUnreclaim: 366480 kB' 'KernelStack: 12720 kB' 'PageTables: 7100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 7479880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195252 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.776 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.776 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.777 22:55:57 -- setup/common.sh@33 -- # echo 0 00:03:30.777 22:55:57 -- setup/common.sh@33 -- # return 0 00:03:30.777 22:55:57 -- setup/hugepages.sh@97 -- # anon=0 00:03:30.777 22:55:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:30.777 22:55:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:30.777 22:55:57 -- setup/common.sh@18 -- # local node= 00:03:30.777 22:55:57 -- setup/common.sh@19 -- # local var val 00:03:30.777 22:55:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.777 22:55:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.777 22:55:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.777 22:55:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.777 22:55:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.777 22:55:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46786372 kB' 'MemAvailable: 50398992 kB' 'Buffers: 11580 kB' 'Cached: 9186348 kB' 'SwapCached: 0 kB' 'Active: 6093848 kB' 'Inactive: 3666140 kB' 'Active(anon): 5731968 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 565360 kB' 'Mapped: 140424 kB' 'Shmem: 5169908 kB' 'KReclaimable: 156360 kB' 'Slab: 523000 kB' 'SReclaimable: 156360 kB' 'SUnreclaim: 366640 kB' 'KernelStack: 12704 kB' 'PageTables: 7032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 7479892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195204 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.777 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.777 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.778 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.778 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.779 22:55:57 -- setup/common.sh@33 -- # echo 0 00:03:30.779 22:55:57 -- setup/common.sh@33 -- # return 0 00:03:30.779 22:55:57 -- setup/hugepages.sh@99 -- # surp=0 00:03:30.779 22:55:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:30.779 22:55:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:30.779 22:55:57 -- setup/common.sh@18 -- # local node= 00:03:30.779 22:55:57 -- setup/common.sh@19 -- # local var val 00:03:30.779 22:55:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.779 22:55:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.779 22:55:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.779 22:55:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.779 22:55:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.779 22:55:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46786372 kB' 'MemAvailable: 50398992 kB' 'Buffers: 11580 kB' 'Cached: 9186360 kB' 'SwapCached: 0 kB' 'Active: 6093864 kB' 'Inactive: 3666140 kB' 'Active(anon): 5731984 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 565368 kB' 'Mapped: 140424 kB' 'Shmem: 5169920 kB' 'KReclaimable: 156360 kB' 'Slab: 522892 kB' 'SReclaimable: 156360 kB' 'SUnreclaim: 366532 kB' 'KernelStack: 12704 kB' 'PageTables: 7032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 7479908 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195204 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.779 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.779 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.780 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.780 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.781 22:55:57 -- setup/common.sh@33 -- # echo 0 00:03:30.781 22:55:57 -- setup/common.sh@33 -- # return 0 00:03:30.781 22:55:57 -- setup/hugepages.sh@100 -- # resv=0 00:03:30.781 22:55:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:30.781 nr_hugepages=1025 00:03:30.781 22:55:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:30.781 resv_hugepages=0 00:03:30.781 22:55:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:30.781 surplus_hugepages=0 00:03:30.781 22:55:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:30.781 anon_hugepages=0 00:03:30.781 22:55:57 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:30.781 22:55:57 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:30.781 22:55:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:30.781 22:55:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:30.781 22:55:57 -- setup/common.sh@18 -- # local node= 00:03:30.781 22:55:57 -- setup/common.sh@19 -- # local var val 00:03:30.781 22:55:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.781 22:55:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.781 22:55:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.781 22:55:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.781 22:55:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.781 22:55:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46787444 kB' 'MemAvailable: 50400064 kB' 'Buffers: 11580 kB' 'Cached: 9186372 kB' 'SwapCached: 0 kB' 'Active: 6093880 kB' 'Inactive: 3666140 kB' 'Active(anon): 5732000 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 565368 kB' 'Mapped: 140424 kB' 'Shmem: 5169932 kB' 'KReclaimable: 156360 kB' 'Slab: 522892 kB' 'SReclaimable: 156360 kB' 'SUnreclaim: 366532 kB' 'KernelStack: 12704 kB' 'PageTables: 7032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 7479920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195204 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.781 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.781 22:55:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # continue 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.782 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.782 22:55:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.044 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.044 22:55:57 -- setup/common.sh@33 -- # echo 1025 00:03:31.044 22:55:57 -- setup/common.sh@33 -- # return 0 00:03:31.044 22:55:57 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:31.044 22:55:57 -- setup/hugepages.sh@112 -- # get_nodes 00:03:31.044 22:55:57 -- setup/hugepages.sh@27 -- # local node 00:03:31.044 22:55:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.044 22:55:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:31.044 22:55:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.044 22:55:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:31.044 22:55:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:31.044 22:55:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:31.044 22:55:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:31.044 22:55:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:31.044 22:55:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:31.044 22:55:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.044 22:55:57 -- setup/common.sh@18 -- # local node=0 00:03:31.044 22:55:57 -- setup/common.sh@19 -- # local var val 00:03:31.044 22:55:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.044 22:55:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.044 22:55:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:31.044 22:55:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:31.044 22:55:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.044 22:55:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.044 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 29114712 kB' 'MemUsed: 3711144 kB' 'SwapCached: 0 kB' 'Active: 1696472 kB' 'Inactive: 108452 kB' 'Active(anon): 1548556 kB' 'Inactive(anon): 0 kB' 'Active(file): 147916 kB' 'Inactive(file): 108452 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1532600 kB' 'Mapped: 60792 kB' 'AnonPages: 275536 kB' 'Shmem: 1276232 kB' 'KernelStack: 7688 kB' 'PageTables: 3904 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104732 kB' 'Slab: 314000 kB' 'SReclaimable: 104732 kB' 'SUnreclaim: 209268 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.045 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.045 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.045 22:55:57 -- setup/common.sh@33 -- # echo 0 00:03:31.045 22:55:57 -- setup/common.sh@33 -- # return 0 00:03:31.045 22:55:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.045 22:55:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:31.045 22:55:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:31.045 22:55:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:31.045 22:55:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.045 22:55:57 -- setup/common.sh@18 -- # local node=1 00:03:31.045 22:55:57 -- setup/common.sh@19 -- # local var val 00:03:31.045 22:55:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.045 22:55:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.046 22:55:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:31.046 22:55:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:31.046 22:55:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.046 22:55:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17673908 kB' 'MemUsed: 10035884 kB' 'SwapCached: 0 kB' 'Active: 4397880 kB' 'Inactive: 3557688 kB' 'Active(anon): 4183916 kB' 'Inactive(anon): 0 kB' 'Active(file): 213964 kB' 'Inactive(file): 3557688 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7665380 kB' 'Mapped: 79632 kB' 'AnonPages: 290280 kB' 'Shmem: 3893728 kB' 'KernelStack: 5000 kB' 'PageTables: 3080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 51628 kB' 'Slab: 208892 kB' 'SReclaimable: 51628 kB' 'SUnreclaim: 157264 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.046 22:55:57 -- setup/common.sh@32 -- # continue 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.046 22:55:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.047 22:55:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.047 22:55:57 -- setup/common.sh@33 -- # echo 0 00:03:31.047 22:55:57 -- setup/common.sh@33 -- # return 0 00:03:31.047 22:55:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.047 22:55:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.047 22:55:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.047 22:55:57 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:31.047 node0=512 expecting 513 00:03:31.047 22:55:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.047 22:55:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.047 22:55:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.047 22:55:57 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:31.047 node1=513 expecting 512 00:03:31.047 22:55:57 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:31.047 00:03:31.047 real 0m1.498s 00:03:31.047 user 0m0.620s 00:03:31.047 sys 0m0.836s 00:03:31.047 22:55:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.047 22:55:57 -- common/autotest_common.sh@10 -- # set +x 00:03:31.047 ************************************ 00:03:31.047 END TEST odd_alloc 00:03:31.047 ************************************ 00:03:31.047 22:55:57 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:31.047 22:55:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:31.047 22:55:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:31.047 22:55:57 -- common/autotest_common.sh@10 -- # set +x 00:03:31.047 ************************************ 00:03:31.047 START TEST custom_alloc 00:03:31.047 ************************************ 00:03:31.047 22:55:57 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:31.047 22:55:57 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:31.047 22:55:57 -- setup/hugepages.sh@169 -- # local node 00:03:31.047 22:55:57 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:31.047 22:55:57 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:31.047 22:55:57 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:31.047 22:55:57 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:31.047 22:55:57 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:31.047 22:55:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:31.047 22:55:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:31.047 22:55:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:31.047 22:55:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:31.047 22:55:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:31.047 22:55:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:31.047 22:55:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:31.047 22:55:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:31.047 22:55:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:31.047 22:55:57 -- setup/hugepages.sh@83 -- # : 256 00:03:31.047 22:55:57 -- setup/hugepages.sh@84 -- # : 1 00:03:31.047 22:55:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:31.047 22:55:57 -- setup/hugepages.sh@83 -- # : 0 00:03:31.047 22:55:57 -- setup/hugepages.sh@84 -- # : 0 00:03:31.047 22:55:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:31.047 22:55:57 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:31.047 22:55:57 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:31.047 22:55:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:31.047 22:55:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:31.047 22:55:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:31.047 22:55:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:31.047 22:55:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:31.047 22:55:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:31.047 22:55:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:31.047 22:55:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:31.047 22:55:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:31.047 22:55:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:31.047 22:55:57 -- setup/hugepages.sh@78 -- # return 0 00:03:31.047 22:55:57 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:31.047 22:55:57 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:31.047 22:55:57 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:31.047 22:55:57 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:31.047 22:55:57 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:31.047 22:55:57 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:31.047 22:55:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:31.047 22:55:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:31.047 22:55:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:31.047 22:55:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:31.047 22:55:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:31.047 22:55:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:31.047 22:55:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:31.047 22:55:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:31.047 22:55:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:31.047 22:55:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:31.047 22:55:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:31.047 22:55:57 -- setup/hugepages.sh@78 -- # return 0 00:03:31.047 22:55:57 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:31.047 22:55:57 -- setup/hugepages.sh@187 -- # setup output 00:03:31.047 22:55:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:31.047 22:55:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:32.443 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.443 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:32.443 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.443 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.443 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.443 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.443 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.443 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.443 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.443 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.443 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.443 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.443 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.443 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.443 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.443 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.443 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.443 22:55:58 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:32.443 22:55:58 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:32.443 22:55:58 -- setup/hugepages.sh@89 -- # local node 00:03:32.443 22:55:58 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:32.443 22:55:58 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:32.443 22:55:58 -- setup/hugepages.sh@92 -- # local surp 00:03:32.443 22:55:58 -- setup/hugepages.sh@93 -- # local resv 00:03:32.443 22:55:58 -- setup/hugepages.sh@94 -- # local anon 00:03:32.443 22:55:58 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:32.443 22:55:58 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:32.443 22:55:58 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:32.443 22:55:58 -- setup/common.sh@18 -- # local node= 00:03:32.443 22:55:58 -- setup/common.sh@19 -- # local var val 00:03:32.443 22:55:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.443 22:55:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.443 22:55:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.443 22:55:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.443 22:55:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.443 22:55:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45764912 kB' 'MemAvailable: 49377548 kB' 'Buffers: 11580 kB' 'Cached: 9186464 kB' 'SwapCached: 0 kB' 'Active: 6097080 kB' 'Inactive: 3666140 kB' 'Active(anon): 5735200 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 568540 kB' 'Mapped: 140496 kB' 'Shmem: 5170024 kB' 'KReclaimable: 156392 kB' 'Slab: 523044 kB' 'SReclaimable: 156392 kB' 'SUnreclaim: 366652 kB' 'KernelStack: 12688 kB' 'PageTables: 7024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 7480132 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195108 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.443 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.443 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.444 22:55:58 -- setup/common.sh@33 -- # echo 0 00:03:32.444 22:55:58 -- setup/common.sh@33 -- # return 0 00:03:32.444 22:55:58 -- setup/hugepages.sh@97 -- # anon=0 00:03:32.444 22:55:58 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:32.444 22:55:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.444 22:55:58 -- setup/common.sh@18 -- # local node= 00:03:32.444 22:55:58 -- setup/common.sh@19 -- # local var val 00:03:32.444 22:55:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.444 22:55:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.444 22:55:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.444 22:55:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.444 22:55:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.444 22:55:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45765348 kB' 'MemAvailable: 49377984 kB' 'Buffers: 11580 kB' 'Cached: 9186464 kB' 'SwapCached: 0 kB' 'Active: 6098192 kB' 'Inactive: 3666140 kB' 'Active(anon): 5736312 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 569648 kB' 'Mapped: 140932 kB' 'Shmem: 5170024 kB' 'KReclaimable: 156392 kB' 'Slab: 523036 kB' 'SReclaimable: 156392 kB' 'SUnreclaim: 366644 kB' 'KernelStack: 12704 kB' 'PageTables: 7064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 7481500 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195092 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.444 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.444 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.445 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.445 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.446 22:55:58 -- setup/common.sh@33 -- # echo 0 00:03:32.446 22:55:58 -- setup/common.sh@33 -- # return 0 00:03:32.446 22:55:58 -- setup/hugepages.sh@99 -- # surp=0 00:03:32.446 22:55:58 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:32.446 22:55:58 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:32.446 22:55:58 -- setup/common.sh@18 -- # local node= 00:03:32.446 22:55:58 -- setup/common.sh@19 -- # local var val 00:03:32.446 22:55:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.446 22:55:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.446 22:55:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.446 22:55:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.446 22:55:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.446 22:55:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45762744 kB' 'MemAvailable: 49375380 kB' 'Buffers: 11580 kB' 'Cached: 9186468 kB' 'SwapCached: 0 kB' 'Active: 6100080 kB' 'Inactive: 3666140 kB' 'Active(anon): 5738200 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571488 kB' 'Mapped: 140832 kB' 'Shmem: 5170028 kB' 'KReclaimable: 156392 kB' 'Slab: 523004 kB' 'SReclaimable: 156392 kB' 'SUnreclaim: 366612 kB' 'KernelStack: 12672 kB' 'PageTables: 6948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 7484552 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195076 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.446 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.446 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.447 22:55:58 -- setup/common.sh@33 -- # echo 0 00:03:32.447 22:55:58 -- setup/common.sh@33 -- # return 0 00:03:32.447 22:55:58 -- setup/hugepages.sh@100 -- # resv=0 00:03:32.447 22:55:58 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:32.447 nr_hugepages=1536 00:03:32.447 22:55:58 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:32.447 resv_hugepages=0 00:03:32.447 22:55:58 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:32.447 surplus_hugepages=0 00:03:32.447 22:55:58 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:32.447 anon_hugepages=0 00:03:32.447 22:55:58 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:32.447 22:55:58 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:32.447 22:55:58 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:32.447 22:55:58 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:32.447 22:55:58 -- setup/common.sh@18 -- # local node= 00:03:32.447 22:55:58 -- setup/common.sh@19 -- # local var val 00:03:32.447 22:55:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.447 22:55:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.447 22:55:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.447 22:55:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.447 22:55:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.447 22:55:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45758964 kB' 'MemAvailable: 49371600 kB' 'Buffers: 11580 kB' 'Cached: 9186492 kB' 'SwapCached: 0 kB' 'Active: 6101752 kB' 'Inactive: 3666140 kB' 'Active(anon): 5739872 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 573124 kB' 'Mapped: 141300 kB' 'Shmem: 5170052 kB' 'KReclaimable: 156392 kB' 'Slab: 522996 kB' 'SReclaimable: 156392 kB' 'SUnreclaim: 366604 kB' 'KernelStack: 12640 kB' 'PageTables: 6868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 7486292 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195080 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.447 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.447 22:55:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.448 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.448 22:55:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.449 22:55:58 -- setup/common.sh@33 -- # echo 1536 00:03:32.449 22:55:58 -- setup/common.sh@33 -- # return 0 00:03:32.449 22:55:58 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:32.449 22:55:58 -- setup/hugepages.sh@112 -- # get_nodes 00:03:32.449 22:55:58 -- setup/hugepages.sh@27 -- # local node 00:03:32.449 22:55:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.449 22:55:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:32.449 22:55:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.449 22:55:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:32.449 22:55:58 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:32.449 22:55:58 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:32.449 22:55:58 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.449 22:55:58 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.449 22:55:58 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:32.449 22:55:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.449 22:55:58 -- setup/common.sh@18 -- # local node=0 00:03:32.449 22:55:58 -- setup/common.sh@19 -- # local var val 00:03:32.449 22:55:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.449 22:55:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.449 22:55:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:32.449 22:55:58 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:32.449 22:55:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.449 22:55:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 29147272 kB' 'MemUsed: 3678584 kB' 'SwapCached: 0 kB' 'Active: 1697148 kB' 'Inactive: 108452 kB' 'Active(anon): 1549232 kB' 'Inactive(anon): 0 kB' 'Active(file): 147916 kB' 'Inactive(file): 108452 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1532620 kB' 'Mapped: 60916 kB' 'AnonPages: 276116 kB' 'Shmem: 1276252 kB' 'KernelStack: 7640 kB' 'PageTables: 3812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104764 kB' 'Slab: 313964 kB' 'SReclaimable: 104764 kB' 'SUnreclaim: 209200 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.449 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.449 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@33 -- # echo 0 00:03:32.450 22:55:58 -- setup/common.sh@33 -- # return 0 00:03:32.450 22:55:58 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.450 22:55:58 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.450 22:55:58 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.450 22:55:58 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:32.450 22:55:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.450 22:55:58 -- setup/common.sh@18 -- # local node=1 00:03:32.450 22:55:58 -- setup/common.sh@19 -- # local var val 00:03:32.450 22:55:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.450 22:55:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.450 22:55:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:32.450 22:55:58 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:32.450 22:55:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.450 22:55:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16608348 kB' 'MemUsed: 11101444 kB' 'SwapCached: 0 kB' 'Active: 4402584 kB' 'Inactive: 3557688 kB' 'Active(anon): 4188620 kB' 'Inactive(anon): 0 kB' 'Active(file): 213964 kB' 'Inactive(file): 3557688 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7665452 kB' 'Mapped: 80068 kB' 'AnonPages: 294972 kB' 'Shmem: 3893800 kB' 'KernelStack: 4984 kB' 'PageTables: 2980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 51628 kB' 'Slab: 209032 kB' 'SReclaimable: 51628 kB' 'SUnreclaim: 157404 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.450 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.450 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.451 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.451 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # continue 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.711 22:55:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.711 22:55:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.711 22:55:58 -- setup/common.sh@33 -- # echo 0 00:03:32.711 22:55:58 -- setup/common.sh@33 -- # return 0 00:03:32.711 22:55:58 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.711 22:55:58 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.711 22:55:58 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.711 22:55:58 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.711 22:55:58 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:32.711 node0=512 expecting 512 00:03:32.711 22:55:58 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.711 22:55:58 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.711 22:55:58 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.711 22:55:58 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:32.711 node1=1024 expecting 1024 00:03:32.711 22:55:58 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:32.711 00:03:32.711 real 0m1.593s 00:03:32.711 user 0m0.658s 00:03:32.711 sys 0m0.902s 00:03:32.711 22:55:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.711 22:55:58 -- common/autotest_common.sh@10 -- # set +x 00:03:32.711 ************************************ 00:03:32.711 END TEST custom_alloc 00:03:32.711 ************************************ 00:03:32.711 22:55:58 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:32.711 22:55:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.711 22:55:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.711 22:55:58 -- common/autotest_common.sh@10 -- # set +x 00:03:32.711 ************************************ 00:03:32.711 START TEST no_shrink_alloc 00:03:32.711 ************************************ 00:03:32.711 22:55:58 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:32.711 22:55:58 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:32.711 22:55:58 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:32.711 22:55:58 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:32.711 22:55:58 -- setup/hugepages.sh@51 -- # shift 00:03:32.711 22:55:58 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:32.711 22:55:58 -- setup/hugepages.sh@52 -- # local node_ids 00:03:32.711 22:55:58 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:32.711 22:55:58 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:32.711 22:55:58 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:32.711 22:55:58 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:32.711 22:55:58 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:32.711 22:55:58 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:32.711 22:55:58 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:32.711 22:55:58 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:32.711 22:55:58 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:32.711 22:55:58 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:32.711 22:55:58 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:32.711 22:55:58 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:32.711 22:55:58 -- setup/hugepages.sh@73 -- # return 0 00:03:32.711 22:55:58 -- setup/hugepages.sh@198 -- # setup output 00:03:32.711 22:55:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:32.711 22:55:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:34.093 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:34.093 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:34.093 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:34.093 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:34.093 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:34.093 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:34.093 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:34.093 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:34.093 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:34.093 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:34.093 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:34.093 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:34.093 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:34.093 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:34.093 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:34.093 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:34.093 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:34.093 22:56:00 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:34.093 22:56:00 -- setup/hugepages.sh@89 -- # local node 00:03:34.093 22:56:00 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:34.093 22:56:00 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:34.093 22:56:00 -- setup/hugepages.sh@92 -- # local surp 00:03:34.093 22:56:00 -- setup/hugepages.sh@93 -- # local resv 00:03:34.093 22:56:00 -- setup/hugepages.sh@94 -- # local anon 00:03:34.093 22:56:00 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:34.093 22:56:00 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:34.093 22:56:00 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:34.093 22:56:00 -- setup/common.sh@18 -- # local node= 00:03:34.093 22:56:00 -- setup/common.sh@19 -- # local var val 00:03:34.093 22:56:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.093 22:56:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.093 22:56:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:34.093 22:56:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:34.093 22:56:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.093 22:56:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.093 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.093 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.093 22:56:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46817376 kB' 'MemAvailable: 50430128 kB' 'Buffers: 11580 kB' 'Cached: 9186580 kB' 'SwapCached: 0 kB' 'Active: 6099636 kB' 'Inactive: 3666140 kB' 'Active(anon): 5737756 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 570844 kB' 'Mapped: 140496 kB' 'Shmem: 5170140 kB' 'KReclaimable: 156624 kB' 'Slab: 523108 kB' 'SReclaimable: 156624 kB' 'SUnreclaim: 366484 kB' 'KernelStack: 13072 kB' 'PageTables: 8280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7483924 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195380 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.094 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.094 22:56:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:34.094 22:56:00 -- setup/common.sh@33 -- # echo 0 00:03:34.094 22:56:00 -- setup/common.sh@33 -- # return 0 00:03:34.094 22:56:00 -- setup/hugepages.sh@97 -- # anon=0 00:03:34.095 22:56:00 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:34.095 22:56:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:34.095 22:56:00 -- setup/common.sh@18 -- # local node= 00:03:34.095 22:56:00 -- setup/common.sh@19 -- # local var val 00:03:34.095 22:56:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.095 22:56:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.095 22:56:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:34.095 22:56:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:34.095 22:56:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.095 22:56:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46818172 kB' 'MemAvailable: 50430924 kB' 'Buffers: 11580 kB' 'Cached: 9186584 kB' 'SwapCached: 0 kB' 'Active: 6099184 kB' 'Inactive: 3666140 kB' 'Active(anon): 5737304 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 570452 kB' 'Mapped: 140480 kB' 'Shmem: 5170144 kB' 'KReclaimable: 156624 kB' 'Slab: 523140 kB' 'SReclaimable: 156624 kB' 'SUnreclaim: 366516 kB' 'KernelStack: 13024 kB' 'PageTables: 8344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7484304 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195380 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.095 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.095 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.096 22:56:00 -- setup/common.sh@33 -- # echo 0 00:03:34.096 22:56:00 -- setup/common.sh@33 -- # return 0 00:03:34.096 22:56:00 -- setup/hugepages.sh@99 -- # surp=0 00:03:34.096 22:56:00 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:34.096 22:56:00 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:34.096 22:56:00 -- setup/common.sh@18 -- # local node= 00:03:34.096 22:56:00 -- setup/common.sh@19 -- # local var val 00:03:34.096 22:56:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.096 22:56:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.096 22:56:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:34.096 22:56:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:34.096 22:56:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.096 22:56:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46816576 kB' 'MemAvailable: 50429328 kB' 'Buffers: 11580 kB' 'Cached: 9186596 kB' 'SwapCached: 0 kB' 'Active: 6100436 kB' 'Inactive: 3666140 kB' 'Active(anon): 5738556 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571648 kB' 'Mapped: 140480 kB' 'Shmem: 5170156 kB' 'KReclaimable: 156624 kB' 'Slab: 523172 kB' 'SReclaimable: 156624 kB' 'SUnreclaim: 366548 kB' 'KernelStack: 13152 kB' 'PageTables: 8936 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7484320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195412 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.096 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.096 22:56:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.097 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:34.097 22:56:00 -- setup/common.sh@33 -- # echo 0 00:03:34.097 22:56:00 -- setup/common.sh@33 -- # return 0 00:03:34.097 22:56:00 -- setup/hugepages.sh@100 -- # resv=0 00:03:34.097 22:56:00 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:34.097 nr_hugepages=1024 00:03:34.097 22:56:00 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:34.097 resv_hugepages=0 00:03:34.097 22:56:00 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:34.097 surplus_hugepages=0 00:03:34.097 22:56:00 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:34.097 anon_hugepages=0 00:03:34.097 22:56:00 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:34.097 22:56:00 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:34.097 22:56:00 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:34.097 22:56:00 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:34.097 22:56:00 -- setup/common.sh@18 -- # local node= 00:03:34.097 22:56:00 -- setup/common.sh@19 -- # local var val 00:03:34.097 22:56:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.097 22:56:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.097 22:56:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:34.097 22:56:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:34.097 22:56:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.097 22:56:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.097 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46815936 kB' 'MemAvailable: 50428688 kB' 'Buffers: 11580 kB' 'Cached: 9186608 kB' 'SwapCached: 0 kB' 'Active: 6099004 kB' 'Inactive: 3666140 kB' 'Active(anon): 5737124 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 570100 kB' 'Mapped: 140412 kB' 'Shmem: 5170168 kB' 'KReclaimable: 156624 kB' 'Slab: 523172 kB' 'SReclaimable: 156624 kB' 'SUnreclaim: 366548 kB' 'KernelStack: 12752 kB' 'PageTables: 7048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7480292 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.098 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.098 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:34.099 22:56:00 -- setup/common.sh@33 -- # echo 1024 00:03:34.099 22:56:00 -- setup/common.sh@33 -- # return 0 00:03:34.099 22:56:00 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:34.099 22:56:00 -- setup/hugepages.sh@112 -- # get_nodes 00:03:34.099 22:56:00 -- setup/hugepages.sh@27 -- # local node 00:03:34.099 22:56:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:34.099 22:56:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:34.099 22:56:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:34.099 22:56:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:34.099 22:56:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:34.099 22:56:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:34.099 22:56:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:34.099 22:56:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:34.099 22:56:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:34.099 22:56:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:34.099 22:56:00 -- setup/common.sh@18 -- # local node=0 00:03:34.099 22:56:00 -- setup/common.sh@19 -- # local var val 00:03:34.099 22:56:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.099 22:56:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.099 22:56:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:34.099 22:56:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:34.099 22:56:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.099 22:56:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28101228 kB' 'MemUsed: 4724628 kB' 'SwapCached: 0 kB' 'Active: 1700004 kB' 'Inactive: 108452 kB' 'Active(anon): 1552088 kB' 'Inactive(anon): 0 kB' 'Active(file): 147916 kB' 'Inactive(file): 108452 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1532652 kB' 'Mapped: 60796 kB' 'AnonPages: 278888 kB' 'Shmem: 1276284 kB' 'KernelStack: 7672 kB' 'PageTables: 3908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104764 kB' 'Slab: 314052 kB' 'SReclaimable: 104764 kB' 'SUnreclaim: 209288 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.099 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.099 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # continue 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.100 22:56:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.100 22:56:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.100 22:56:00 -- setup/common.sh@33 -- # echo 0 00:03:34.100 22:56:00 -- setup/common.sh@33 -- # return 0 00:03:34.100 22:56:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:34.100 22:56:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:34.100 22:56:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:34.100 22:56:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:34.100 22:56:00 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:34.100 node0=1024 expecting 1024 00:03:34.100 22:56:00 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:34.100 22:56:00 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:34.100 22:56:00 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:34.100 22:56:00 -- setup/hugepages.sh@202 -- # setup output 00:03:34.100 22:56:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:34.100 22:56:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:35.488 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:35.488 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:35.488 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:35.488 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:35.488 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:35.488 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:35.488 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:35.488 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:35.488 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:35.488 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:35.488 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:35.488 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:35.488 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:35.488 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:35.488 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:35.488 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:35.488 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:35.488 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:35.488 22:56:01 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:35.488 22:56:01 -- setup/hugepages.sh@89 -- # local node 00:03:35.488 22:56:01 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:35.488 22:56:01 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:35.488 22:56:01 -- setup/hugepages.sh@92 -- # local surp 00:03:35.488 22:56:01 -- setup/hugepages.sh@93 -- # local resv 00:03:35.488 22:56:01 -- setup/hugepages.sh@94 -- # local anon 00:03:35.488 22:56:01 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:35.488 22:56:01 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:35.488 22:56:01 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:35.488 22:56:01 -- setup/common.sh@18 -- # local node= 00:03:35.489 22:56:01 -- setup/common.sh@19 -- # local var val 00:03:35.489 22:56:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.489 22:56:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.489 22:56:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.489 22:56:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.489 22:56:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.489 22:56:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46815536 kB' 'MemAvailable: 50428288 kB' 'Buffers: 11580 kB' 'Cached: 9186724 kB' 'SwapCached: 0 kB' 'Active: 6100480 kB' 'Inactive: 3666140 kB' 'Active(anon): 5738600 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571532 kB' 'Mapped: 140432 kB' 'Shmem: 5170284 kB' 'KReclaimable: 156624 kB' 'Slab: 523516 kB' 'SReclaimable: 156624 kB' 'SUnreclaim: 366892 kB' 'KernelStack: 12752 kB' 'PageTables: 7096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7480524 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195220 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.489 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.489 22:56:01 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.490 22:56:01 -- setup/common.sh@33 -- # echo 0 00:03:35.490 22:56:01 -- setup/common.sh@33 -- # return 0 00:03:35.490 22:56:01 -- setup/hugepages.sh@97 -- # anon=0 00:03:35.490 22:56:01 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:35.490 22:56:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:35.490 22:56:01 -- setup/common.sh@18 -- # local node= 00:03:35.490 22:56:01 -- setup/common.sh@19 -- # local var val 00:03:35.490 22:56:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.490 22:56:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.490 22:56:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.490 22:56:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.490 22:56:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.490 22:56:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46816660 kB' 'MemAvailable: 50429412 kB' 'Buffers: 11580 kB' 'Cached: 9186724 kB' 'SwapCached: 0 kB' 'Active: 6100992 kB' 'Inactive: 3666140 kB' 'Active(anon): 5739112 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 572040 kB' 'Mapped: 140508 kB' 'Shmem: 5170284 kB' 'KReclaimable: 156624 kB' 'Slab: 523600 kB' 'SReclaimable: 156624 kB' 'SUnreclaim: 366976 kB' 'KernelStack: 12736 kB' 'PageTables: 7056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7480536 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195172 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.490 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.490 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.491 22:56:01 -- setup/common.sh@33 -- # echo 0 00:03:35.491 22:56:01 -- setup/common.sh@33 -- # return 0 00:03:35.491 22:56:01 -- setup/hugepages.sh@99 -- # surp=0 00:03:35.491 22:56:01 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:35.491 22:56:01 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:35.491 22:56:01 -- setup/common.sh@18 -- # local node= 00:03:35.491 22:56:01 -- setup/common.sh@19 -- # local var val 00:03:35.491 22:56:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.491 22:56:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.491 22:56:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.491 22:56:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.491 22:56:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.491 22:56:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46816988 kB' 'MemAvailable: 50429740 kB' 'Buffers: 11580 kB' 'Cached: 9186732 kB' 'SwapCached: 0 kB' 'Active: 6100368 kB' 'Inactive: 3666140 kB' 'Active(anon): 5738488 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571428 kB' 'Mapped: 140484 kB' 'Shmem: 5170292 kB' 'KReclaimable: 156624 kB' 'Slab: 523600 kB' 'SReclaimable: 156624 kB' 'SUnreclaim: 366976 kB' 'KernelStack: 12752 kB' 'PageTables: 6996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7480552 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195204 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.491 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.491 22:56:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.492 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.492 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.493 22:56:01 -- setup/common.sh@33 -- # echo 0 00:03:35.493 22:56:01 -- setup/common.sh@33 -- # return 0 00:03:35.493 22:56:01 -- setup/hugepages.sh@100 -- # resv=0 00:03:35.493 22:56:01 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:35.493 nr_hugepages=1024 00:03:35.493 22:56:01 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:35.493 resv_hugepages=0 00:03:35.493 22:56:01 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:35.493 surplus_hugepages=0 00:03:35.493 22:56:01 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:35.493 anon_hugepages=0 00:03:35.493 22:56:01 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:35.493 22:56:01 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:35.493 22:56:01 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:35.493 22:56:01 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:35.493 22:56:01 -- setup/common.sh@18 -- # local node= 00:03:35.493 22:56:01 -- setup/common.sh@19 -- # local var val 00:03:35.493 22:56:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.493 22:56:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.493 22:56:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.493 22:56:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.493 22:56:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.493 22:56:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 46817276 kB' 'MemAvailable: 50430028 kB' 'Buffers: 11580 kB' 'Cached: 9186744 kB' 'SwapCached: 0 kB' 'Active: 6099556 kB' 'Inactive: 3666140 kB' 'Active(anon): 5737676 kB' 'Inactive(anon): 0 kB' 'Active(file): 361880 kB' 'Inactive(file): 3666140 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 570552 kB' 'Mapped: 140408 kB' 'Shmem: 5170304 kB' 'KReclaimable: 156624 kB' 'Slab: 523584 kB' 'SReclaimable: 156624 kB' 'SUnreclaim: 366960 kB' 'KernelStack: 12720 kB' 'PageTables: 6888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 7480568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195204 kB' 'VmallocChunk: 0 kB' 'Percpu: 31104 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 505436 kB' 'DirectMap2M: 9900032 kB' 'DirectMap1G: 59768832 kB' 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.493 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.493 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.494 22:56:01 -- setup/common.sh@33 -- # echo 1024 00:03:35.494 22:56:01 -- setup/common.sh@33 -- # return 0 00:03:35.494 22:56:01 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:35.494 22:56:01 -- setup/hugepages.sh@112 -- # get_nodes 00:03:35.494 22:56:01 -- setup/hugepages.sh@27 -- # local node 00:03:35.494 22:56:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:35.494 22:56:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:35.494 22:56:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:35.494 22:56:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:35.494 22:56:01 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:35.494 22:56:01 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:35.494 22:56:01 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:35.494 22:56:01 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:35.494 22:56:01 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:35.494 22:56:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:35.494 22:56:01 -- setup/common.sh@18 -- # local node=0 00:03:35.494 22:56:01 -- setup/common.sh@19 -- # local var val 00:03:35.494 22:56:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.494 22:56:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.494 22:56:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:35.494 22:56:01 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:35.494 22:56:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.494 22:56:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28106292 kB' 'MemUsed: 4719564 kB' 'SwapCached: 0 kB' 'Active: 1701324 kB' 'Inactive: 108452 kB' 'Active(anon): 1553408 kB' 'Inactive(anon): 0 kB' 'Active(file): 147916 kB' 'Inactive(file): 108452 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1532724 kB' 'Mapped: 60776 kB' 'AnonPages: 280156 kB' 'Shmem: 1276356 kB' 'KernelStack: 7704 kB' 'PageTables: 3872 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104764 kB' 'Slab: 314372 kB' 'SReclaimable: 104764 kB' 'SUnreclaim: 209608 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.494 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.494 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # continue 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.495 22:56:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.495 22:56:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.495 22:56:01 -- setup/common.sh@33 -- # echo 0 00:03:35.495 22:56:01 -- setup/common.sh@33 -- # return 0 00:03:35.495 22:56:01 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:35.495 22:56:01 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:35.495 22:56:01 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:35.495 22:56:01 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:35.495 22:56:01 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:35.495 node0=1024 expecting 1024 00:03:35.495 22:56:01 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:35.495 00:03:35.495 real 0m2.961s 00:03:35.495 user 0m1.201s 00:03:35.495 sys 0m1.680s 00:03:35.495 22:56:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.495 22:56:01 -- common/autotest_common.sh@10 -- # set +x 00:03:35.495 ************************************ 00:03:35.495 END TEST no_shrink_alloc 00:03:35.495 ************************************ 00:03:35.495 22:56:01 -- setup/hugepages.sh@217 -- # clear_hp 00:03:35.495 22:56:01 -- setup/hugepages.sh@37 -- # local node hp 00:03:35.495 22:56:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:35.495 22:56:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:35.495 22:56:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:35.495 22:56:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:35.495 22:56:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:35.495 22:56:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:35.495 22:56:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:35.495 22:56:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:35.495 22:56:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:35.495 22:56:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:35.495 22:56:01 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:35.495 22:56:01 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:35.495 00:03:35.495 real 0m12.106s 00:03:35.495 user 0m4.678s 00:03:35.495 sys 0m6.373s 00:03:35.495 22:56:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.495 22:56:01 -- common/autotest_common.sh@10 -- # set +x 00:03:35.495 ************************************ 00:03:35.495 END TEST hugepages 00:03:35.495 ************************************ 00:03:35.755 22:56:01 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:35.755 22:56:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.755 22:56:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.755 22:56:01 -- common/autotest_common.sh@10 -- # set +x 00:03:35.755 ************************************ 00:03:35.755 START TEST driver 00:03:35.755 ************************************ 00:03:35.755 22:56:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:35.755 * Looking for test storage... 00:03:35.755 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:35.755 22:56:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:35.755 22:56:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:35.755 22:56:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:35.755 22:56:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:35.755 22:56:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:35.755 22:56:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:35.755 22:56:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:35.755 22:56:02 -- scripts/common.sh@335 -- # IFS=.-: 00:03:35.755 22:56:02 -- scripts/common.sh@335 -- # read -ra ver1 00:03:35.755 22:56:02 -- scripts/common.sh@336 -- # IFS=.-: 00:03:35.755 22:56:02 -- scripts/common.sh@336 -- # read -ra ver2 00:03:35.755 22:56:02 -- scripts/common.sh@337 -- # local 'op=<' 00:03:35.755 22:56:02 -- scripts/common.sh@339 -- # ver1_l=2 00:03:35.755 22:56:02 -- scripts/common.sh@340 -- # ver2_l=1 00:03:35.755 22:56:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:35.755 22:56:02 -- scripts/common.sh@343 -- # case "$op" in 00:03:35.755 22:56:02 -- scripts/common.sh@344 -- # : 1 00:03:35.755 22:56:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:35.755 22:56:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:35.755 22:56:02 -- scripts/common.sh@364 -- # decimal 1 00:03:35.755 22:56:02 -- scripts/common.sh@352 -- # local d=1 00:03:35.755 22:56:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:35.755 22:56:02 -- scripts/common.sh@354 -- # echo 1 00:03:35.755 22:56:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:35.755 22:56:02 -- scripts/common.sh@365 -- # decimal 2 00:03:35.755 22:56:02 -- scripts/common.sh@352 -- # local d=2 00:03:35.755 22:56:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:35.755 22:56:02 -- scripts/common.sh@354 -- # echo 2 00:03:35.755 22:56:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:35.755 22:56:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:35.755 22:56:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:35.755 22:56:02 -- scripts/common.sh@367 -- # return 0 00:03:35.755 22:56:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:35.755 22:56:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:35.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:35.755 --rc genhtml_branch_coverage=1 00:03:35.755 --rc genhtml_function_coverage=1 00:03:35.755 --rc genhtml_legend=1 00:03:35.755 --rc geninfo_all_blocks=1 00:03:35.755 --rc geninfo_unexecuted_blocks=1 00:03:35.755 00:03:35.755 ' 00:03:35.755 22:56:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:35.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:35.755 --rc genhtml_branch_coverage=1 00:03:35.755 --rc genhtml_function_coverage=1 00:03:35.755 --rc genhtml_legend=1 00:03:35.755 --rc geninfo_all_blocks=1 00:03:35.755 --rc geninfo_unexecuted_blocks=1 00:03:35.755 00:03:35.755 ' 00:03:35.755 22:56:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:35.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:35.755 --rc genhtml_branch_coverage=1 00:03:35.755 --rc genhtml_function_coverage=1 00:03:35.755 --rc genhtml_legend=1 00:03:35.755 --rc geninfo_all_blocks=1 00:03:35.755 --rc geninfo_unexecuted_blocks=1 00:03:35.755 00:03:35.755 ' 00:03:35.755 22:56:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:35.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:35.755 --rc genhtml_branch_coverage=1 00:03:35.755 --rc genhtml_function_coverage=1 00:03:35.755 --rc genhtml_legend=1 00:03:35.755 --rc geninfo_all_blocks=1 00:03:35.755 --rc geninfo_unexecuted_blocks=1 00:03:35.755 00:03:35.755 ' 00:03:35.755 22:56:02 -- setup/driver.sh@68 -- # setup reset 00:03:35.755 22:56:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:35.755 22:56:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:38.301 22:56:04 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:38.301 22:56:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.301 22:56:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.301 22:56:04 -- common/autotest_common.sh@10 -- # set +x 00:03:38.301 ************************************ 00:03:38.301 START TEST guess_driver 00:03:38.301 ************************************ 00:03:38.301 22:56:04 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:38.301 22:56:04 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:38.301 22:56:04 -- setup/driver.sh@47 -- # local fail=0 00:03:38.301 22:56:04 -- setup/driver.sh@49 -- # pick_driver 00:03:38.301 22:56:04 -- setup/driver.sh@36 -- # vfio 00:03:38.301 22:56:04 -- setup/driver.sh@21 -- # local iommu_grups 00:03:38.301 22:56:04 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:38.301 22:56:04 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:38.301 22:56:04 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:38.301 22:56:04 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:38.301 22:56:04 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:38.301 22:56:04 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:38.301 22:56:04 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:38.301 22:56:04 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:38.301 22:56:04 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:38.301 22:56:04 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:38.301 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:38.301 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:38.301 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:38.301 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:38.301 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:38.301 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:38.301 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:38.301 22:56:04 -- setup/driver.sh@30 -- # return 0 00:03:38.301 22:56:04 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:38.302 22:56:04 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:38.302 22:56:04 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:38.302 22:56:04 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:38.302 Looking for driver=vfio-pci 00:03:38.302 22:56:04 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:38.302 22:56:04 -- setup/driver.sh@45 -- # setup output config 00:03:38.302 22:56:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:38.302 22:56:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:05 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:05 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:05 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:06 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:06 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:06 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:06 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:06 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:06 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:06 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:06 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.683 22:56:06 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.683 22:56:06 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.683 22:56:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.626 22:56:06 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.626 22:56:06 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.626 22:56:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.887 22:56:07 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:40.887 22:56:07 -- setup/driver.sh@65 -- # setup reset 00:03:40.887 22:56:07 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:40.887 22:56:07 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:43.427 00:03:43.427 real 0m5.006s 00:03:43.427 user 0m1.223s 00:03:43.427 sys 0m1.931s 00:03:43.427 22:56:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:43.427 22:56:09 -- common/autotest_common.sh@10 -- # set +x 00:03:43.427 ************************************ 00:03:43.427 END TEST guess_driver 00:03:43.427 ************************************ 00:03:43.427 00:03:43.427 real 0m7.802s 00:03:43.427 user 0m1.915s 00:03:43.427 sys 0m3.062s 00:03:43.427 22:56:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:43.427 22:56:09 -- common/autotest_common.sh@10 -- # set +x 00:03:43.427 ************************************ 00:03:43.427 END TEST driver 00:03:43.427 ************************************ 00:03:43.427 22:56:09 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:43.427 22:56:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:43.427 22:56:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:43.427 22:56:09 -- common/autotest_common.sh@10 -- # set +x 00:03:43.427 ************************************ 00:03:43.427 START TEST devices 00:03:43.427 ************************************ 00:03:43.427 22:56:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:43.428 * Looking for test storage... 00:03:43.428 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:43.428 22:56:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:43.428 22:56:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:43.428 22:56:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:43.687 22:56:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:43.687 22:56:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:43.687 22:56:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:43.687 22:56:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:43.687 22:56:09 -- scripts/common.sh@335 -- # IFS=.-: 00:03:43.687 22:56:09 -- scripts/common.sh@335 -- # read -ra ver1 00:03:43.687 22:56:09 -- scripts/common.sh@336 -- # IFS=.-: 00:03:43.687 22:56:09 -- scripts/common.sh@336 -- # read -ra ver2 00:03:43.687 22:56:09 -- scripts/common.sh@337 -- # local 'op=<' 00:03:43.687 22:56:09 -- scripts/common.sh@339 -- # ver1_l=2 00:03:43.687 22:56:09 -- scripts/common.sh@340 -- # ver2_l=1 00:03:43.687 22:56:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:43.687 22:56:09 -- scripts/common.sh@343 -- # case "$op" in 00:03:43.687 22:56:09 -- scripts/common.sh@344 -- # : 1 00:03:43.687 22:56:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:43.687 22:56:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:43.687 22:56:09 -- scripts/common.sh@364 -- # decimal 1 00:03:43.687 22:56:09 -- scripts/common.sh@352 -- # local d=1 00:03:43.687 22:56:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:43.687 22:56:09 -- scripts/common.sh@354 -- # echo 1 00:03:43.687 22:56:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:43.687 22:56:09 -- scripts/common.sh@365 -- # decimal 2 00:03:43.687 22:56:09 -- scripts/common.sh@352 -- # local d=2 00:03:43.687 22:56:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:43.687 22:56:09 -- scripts/common.sh@354 -- # echo 2 00:03:43.687 22:56:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:43.687 22:56:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:43.687 22:56:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:43.687 22:56:09 -- scripts/common.sh@367 -- # return 0 00:03:43.687 22:56:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:43.687 22:56:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:43.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:43.687 --rc genhtml_branch_coverage=1 00:03:43.687 --rc genhtml_function_coverage=1 00:03:43.687 --rc genhtml_legend=1 00:03:43.687 --rc geninfo_all_blocks=1 00:03:43.687 --rc geninfo_unexecuted_blocks=1 00:03:43.687 00:03:43.687 ' 00:03:43.687 22:56:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:43.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:43.687 --rc genhtml_branch_coverage=1 00:03:43.687 --rc genhtml_function_coverage=1 00:03:43.687 --rc genhtml_legend=1 00:03:43.687 --rc geninfo_all_blocks=1 00:03:43.687 --rc geninfo_unexecuted_blocks=1 00:03:43.688 00:03:43.688 ' 00:03:43.688 22:56:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:43.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:43.688 --rc genhtml_branch_coverage=1 00:03:43.688 --rc genhtml_function_coverage=1 00:03:43.688 --rc genhtml_legend=1 00:03:43.688 --rc geninfo_all_blocks=1 00:03:43.688 --rc geninfo_unexecuted_blocks=1 00:03:43.688 00:03:43.688 ' 00:03:43.688 22:56:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:43.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:43.688 --rc genhtml_branch_coverage=1 00:03:43.688 --rc genhtml_function_coverage=1 00:03:43.688 --rc genhtml_legend=1 00:03:43.688 --rc geninfo_all_blocks=1 00:03:43.688 --rc geninfo_unexecuted_blocks=1 00:03:43.688 00:03:43.688 ' 00:03:43.688 22:56:09 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:43.688 22:56:09 -- setup/devices.sh@192 -- # setup reset 00:03:43.688 22:56:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:43.688 22:56:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:45.068 22:56:11 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:45.068 22:56:11 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:45.068 22:56:11 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:45.068 22:56:11 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:45.069 22:56:11 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:45.069 22:56:11 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:45.069 22:56:11 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:45.069 22:56:11 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:45.069 22:56:11 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:45.069 22:56:11 -- setup/devices.sh@196 -- # blocks=() 00:03:45.069 22:56:11 -- setup/devices.sh@196 -- # declare -a blocks 00:03:45.069 22:56:11 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:45.069 22:56:11 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:45.069 22:56:11 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:45.069 22:56:11 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:45.069 22:56:11 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:45.069 22:56:11 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:45.069 22:56:11 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:45.069 22:56:11 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:45.069 22:56:11 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:45.069 22:56:11 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:45.069 22:56:11 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:45.069 No valid GPT data, bailing 00:03:45.069 22:56:11 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:45.069 22:56:11 -- scripts/common.sh@393 -- # pt= 00:03:45.069 22:56:11 -- scripts/common.sh@394 -- # return 1 00:03:45.069 22:56:11 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:45.069 22:56:11 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:45.069 22:56:11 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:45.069 22:56:11 -- setup/common.sh@80 -- # echo 1000204886016 00:03:45.069 22:56:11 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:45.069 22:56:11 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:45.069 22:56:11 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:45.069 22:56:11 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:45.069 22:56:11 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:45.069 22:56:11 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:45.069 22:56:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:45.069 22:56:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:45.069 22:56:11 -- common/autotest_common.sh@10 -- # set +x 00:03:45.069 ************************************ 00:03:45.069 START TEST nvme_mount 00:03:45.069 ************************************ 00:03:45.069 22:56:11 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:45.069 22:56:11 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:45.069 22:56:11 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:45.069 22:56:11 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.069 22:56:11 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:45.069 22:56:11 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:45.069 22:56:11 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:45.069 22:56:11 -- setup/common.sh@40 -- # local part_no=1 00:03:45.069 22:56:11 -- setup/common.sh@41 -- # local size=1073741824 00:03:45.069 22:56:11 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:45.069 22:56:11 -- setup/common.sh@44 -- # parts=() 00:03:45.069 22:56:11 -- setup/common.sh@44 -- # local parts 00:03:45.069 22:56:11 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:45.069 22:56:11 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:45.069 22:56:11 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:45.069 22:56:11 -- setup/common.sh@46 -- # (( part++ )) 00:03:45.069 22:56:11 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:45.069 22:56:11 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:45.069 22:56:11 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:45.069 22:56:11 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:46.456 Creating new GPT entries in memory. 00:03:46.456 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:46.456 other utilities. 00:03:46.456 22:56:12 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:46.456 22:56:12 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:46.456 22:56:12 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:46.456 22:56:12 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:46.456 22:56:12 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:47.400 Creating new GPT entries in memory. 00:03:47.401 The operation has completed successfully. 00:03:47.401 22:56:13 -- setup/common.sh@57 -- # (( part++ )) 00:03:47.401 22:56:13 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:47.401 22:56:13 -- setup/common.sh@62 -- # wait 70212 00:03:47.401 22:56:13 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.401 22:56:13 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:47.401 22:56:13 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.401 22:56:13 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:47.401 22:56:13 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:47.401 22:56:13 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.401 22:56:13 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:47.401 22:56:13 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:47.401 22:56:13 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:47.401 22:56:13 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.401 22:56:13 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:47.401 22:56:13 -- setup/devices.sh@53 -- # local found=0 00:03:47.401 22:56:13 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:47.401 22:56:13 -- setup/devices.sh@56 -- # : 00:03:47.401 22:56:13 -- setup/devices.sh@59 -- # local pci status 00:03:47.401 22:56:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.401 22:56:13 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:47.401 22:56:13 -- setup/devices.sh@47 -- # setup output config 00:03:47.401 22:56:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:47.401 22:56:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:48.787 22:56:14 -- setup/devices.sh@63 -- # found=1 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.787 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.787 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.788 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.788 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.788 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.788 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.788 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.788 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.788 22:56:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.788 22:56:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.788 22:56:14 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:48.788 22:56:14 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:48.788 22:56:14 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:48.788 22:56:14 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:48.788 22:56:14 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:48.788 22:56:14 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:48.788 22:56:14 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:48.788 22:56:14 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:48.788 22:56:15 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:48.788 22:56:15 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:48.788 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:48.788 22:56:15 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:48.788 22:56:15 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:49.049 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:49.049 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:49.049 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:49.049 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:49.049 22:56:15 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:49.049 22:56:15 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:49.049 22:56:15 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.049 22:56:15 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:49.049 22:56:15 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:49.049 22:56:15 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.049 22:56:15 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:49.049 22:56:15 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:49.049 22:56:15 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:49.049 22:56:15 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.049 22:56:15 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:49.049 22:56:15 -- setup/devices.sh@53 -- # local found=0 00:03:49.049 22:56:15 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:49.049 22:56:15 -- setup/devices.sh@56 -- # : 00:03:49.049 22:56:15 -- setup/devices.sh@59 -- # local pci status 00:03:49.049 22:56:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.049 22:56:15 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:49.049 22:56:15 -- setup/devices.sh@47 -- # setup output config 00:03:49.049 22:56:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:49.049 22:56:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:49.989 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.989 22:56:16 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:49.989 22:56:16 -- setup/devices.sh@63 -- # found=1 00:03:49.989 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.250 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:50.251 22:56:16 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:50.251 22:56:16 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:50.251 22:56:16 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:50.251 22:56:16 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:50.251 22:56:16 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:50.251 22:56:16 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:50.251 22:56:16 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:50.251 22:56:16 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:50.251 22:56:16 -- setup/devices.sh@50 -- # local mount_point= 00:03:50.251 22:56:16 -- setup/devices.sh@51 -- # local test_file= 00:03:50.251 22:56:16 -- setup/devices.sh@53 -- # local found=0 00:03:50.251 22:56:16 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:50.251 22:56:16 -- setup/devices.sh@59 -- # local pci status 00:03:50.251 22:56:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.251 22:56:16 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:50.511 22:56:16 -- setup/devices.sh@47 -- # setup output config 00:03:50.511 22:56:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:50.511 22:56:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:51.452 22:56:17 -- setup/devices.sh@63 -- # found=1 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.452 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.452 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.713 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.713 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.713 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.713 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.713 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.713 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.713 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.713 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.713 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.713 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.713 22:56:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.713 22:56:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.713 22:56:18 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:51.713 22:56:18 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:51.713 22:56:18 -- setup/devices.sh@68 -- # return 0 00:03:51.713 22:56:18 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:51.713 22:56:18 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:51.713 22:56:18 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:51.713 22:56:18 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:51.713 22:56:18 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:51.713 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:51.713 00:03:51.713 real 0m6.663s 00:03:51.713 user 0m1.488s 00:03:51.713 sys 0m2.738s 00:03:51.713 22:56:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:51.713 22:56:18 -- common/autotest_common.sh@10 -- # set +x 00:03:51.713 ************************************ 00:03:51.713 END TEST nvme_mount 00:03:51.713 ************************************ 00:03:51.713 22:56:18 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:51.713 22:56:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:51.713 22:56:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:51.713 22:56:18 -- common/autotest_common.sh@10 -- # set +x 00:03:51.713 ************************************ 00:03:51.713 START TEST dm_mount 00:03:51.713 ************************************ 00:03:51.713 22:56:18 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:51.713 22:56:18 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:51.713 22:56:18 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:51.713 22:56:18 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:51.713 22:56:18 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:51.713 22:56:18 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:51.713 22:56:18 -- setup/common.sh@40 -- # local part_no=2 00:03:51.713 22:56:18 -- setup/common.sh@41 -- # local size=1073741824 00:03:51.713 22:56:18 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:51.713 22:56:18 -- setup/common.sh@44 -- # parts=() 00:03:51.713 22:56:18 -- setup/common.sh@44 -- # local parts 00:03:51.713 22:56:18 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:51.713 22:56:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:51.713 22:56:18 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:51.713 22:56:18 -- setup/common.sh@46 -- # (( part++ )) 00:03:51.713 22:56:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:51.713 22:56:18 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:51.713 22:56:18 -- setup/common.sh@46 -- # (( part++ )) 00:03:51.713 22:56:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:51.713 22:56:18 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:51.713 22:56:18 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:51.713 22:56:18 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:53.096 Creating new GPT entries in memory. 00:03:53.096 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:53.096 other utilities. 00:03:53.096 22:56:19 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:53.096 22:56:19 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:53.096 22:56:19 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:53.096 22:56:19 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:53.096 22:56:19 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:54.038 Creating new GPT entries in memory. 00:03:54.038 The operation has completed successfully. 00:03:54.038 22:56:20 -- setup/common.sh@57 -- # (( part++ )) 00:03:54.038 22:56:20 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:54.038 22:56:20 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:54.038 22:56:20 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:54.038 22:56:20 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:54.983 The operation has completed successfully. 00:03:54.983 22:56:21 -- setup/common.sh@57 -- # (( part++ )) 00:03:54.983 22:56:21 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:54.983 22:56:21 -- setup/common.sh@62 -- # wait 72674 00:03:54.983 22:56:21 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:54.983 22:56:21 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.983 22:56:21 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:54.983 22:56:21 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:54.983 22:56:21 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:54.983 22:56:21 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:54.983 22:56:21 -- setup/devices.sh@161 -- # break 00:03:54.983 22:56:21 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:54.983 22:56:21 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:54.983 22:56:21 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:54.983 22:56:21 -- setup/devices.sh@166 -- # dm=dm-0 00:03:54.983 22:56:21 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:54.983 22:56:21 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:54.983 22:56:21 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.983 22:56:21 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:54.983 22:56:21 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.983 22:56:21 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:54.983 22:56:21 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:54.983 22:56:21 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.983 22:56:21 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:54.983 22:56:21 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:54.983 22:56:21 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:54.983 22:56:21 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.983 22:56:21 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:54.983 22:56:21 -- setup/devices.sh@53 -- # local found=0 00:03:54.983 22:56:21 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:54.983 22:56:21 -- setup/devices.sh@56 -- # : 00:03:54.983 22:56:21 -- setup/devices.sh@59 -- # local pci status 00:03:54.983 22:56:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:54.983 22:56:21 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:54.983 22:56:21 -- setup/devices.sh@47 -- # setup output config 00:03:54.983 22:56:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:54.983 22:56:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:56.368 22:56:22 -- setup/devices.sh@63 -- # found=1 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:56.368 22:56:22 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:56.368 22:56:22 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:56.368 22:56:22 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:56.368 22:56:22 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:56.368 22:56:22 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:56.368 22:56:22 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:56.368 22:56:22 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:56.368 22:56:22 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:56.368 22:56:22 -- setup/devices.sh@50 -- # local mount_point= 00:03:56.368 22:56:22 -- setup/devices.sh@51 -- # local test_file= 00:03:56.368 22:56:22 -- setup/devices.sh@53 -- # local found=0 00:03:56.368 22:56:22 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:56.368 22:56:22 -- setup/devices.sh@59 -- # local pci status 00:03:56.368 22:56:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.368 22:56:22 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:56.368 22:56:22 -- setup/devices.sh@47 -- # setup output config 00:03:56.368 22:56:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:56.368 22:56:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:57.751 22:56:23 -- setup/devices.sh@63 -- # found=1 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:57.751 22:56:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.751 22:56:24 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:57.751 22:56:24 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:57.751 22:56:24 -- setup/devices.sh@68 -- # return 0 00:03:57.751 22:56:24 -- setup/devices.sh@187 -- # cleanup_dm 00:03:57.751 22:56:24 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:57.751 22:56:24 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:57.751 22:56:24 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:57.751 22:56:24 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:57.751 22:56:24 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:57.751 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:57.751 22:56:24 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:57.751 22:56:24 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:57.751 00:03:57.751 real 0m5.990s 00:03:57.751 user 0m1.015s 00:03:57.751 sys 0m1.829s 00:03:57.751 22:56:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:57.751 22:56:24 -- common/autotest_common.sh@10 -- # set +x 00:03:57.751 ************************************ 00:03:57.751 END TEST dm_mount 00:03:57.751 ************************************ 00:03:57.751 22:56:24 -- setup/devices.sh@1 -- # cleanup 00:03:57.751 22:56:24 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:57.751 22:56:24 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:57.751 22:56:24 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:57.751 22:56:24 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:57.751 22:56:24 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:57.751 22:56:24 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:58.011 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:58.011 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:58.011 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:58.011 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:58.011 22:56:24 -- setup/devices.sh@12 -- # cleanup_dm 00:03:58.011 22:56:24 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:58.011 22:56:24 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:58.011 22:56:24 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:58.011 22:56:24 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:58.011 22:56:24 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:58.011 22:56:24 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:58.011 00:03:58.011 real 0m14.676s 00:03:58.011 user 0m3.180s 00:03:58.011 sys 0m5.690s 00:03:58.011 22:56:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:58.011 22:56:24 -- common/autotest_common.sh@10 -- # set +x 00:03:58.011 ************************************ 00:03:58.011 END TEST devices 00:03:58.011 ************************************ 00:03:58.271 00:03:58.271 real 0m46.147s 00:03:58.271 user 0m13.456s 00:03:58.271 sys 0m21.139s 00:03:58.271 22:56:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:58.271 22:56:24 -- common/autotest_common.sh@10 -- # set +x 00:03:58.271 ************************************ 00:03:58.271 END TEST setup.sh 00:03:58.271 ************************************ 00:03:58.271 22:56:24 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:59.210 Hugepages 00:03:59.211 node hugesize free / total 00:03:59.211 node0 1048576kB 0 / 0 00:03:59.211 node0 2048kB 2048 / 2048 00:03:59.211 node1 1048576kB 0 / 0 00:03:59.469 node1 2048kB 0 / 0 00:03:59.469 00:03:59.469 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:59.470 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:59.470 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:59.470 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:59.470 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:59.470 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:59.470 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:59.470 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:59.470 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:59.470 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:59.470 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:59.470 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:59.470 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:59.470 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:59.470 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:59.470 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:59.470 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:59.470 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:59.470 22:56:25 -- spdk/autotest.sh@128 -- # uname -s 00:03:59.470 22:56:25 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:59.470 22:56:25 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:59.470 22:56:25 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:00.852 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:00.852 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:00.852 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:00.852 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:00.852 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:00.852 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:00.852 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:00.852 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:00.852 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:00.852 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:00.852 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:00.852 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:00.852 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:00.852 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:00.852 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:00.852 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:01.796 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:01.797 22:56:28 -- common/autotest_common.sh@1527 -- # sleep 1 00:04:02.738 22:56:29 -- common/autotest_common.sh@1528 -- # bdfs=() 00:04:02.738 22:56:29 -- common/autotest_common.sh@1528 -- # local bdfs 00:04:02.738 22:56:29 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:04:02.738 22:56:29 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:04:02.738 22:56:29 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:02.738 22:56:29 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:02.738 22:56:29 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:02.738 22:56:29 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:02.738 22:56:29 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:02.996 22:56:29 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:02.996 22:56:29 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:02.996 22:56:29 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:04.374 Waiting for block devices as requested 00:04:04.374 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:04:04.374 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:04.374 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:04.635 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:04.635 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:04.635 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:04.635 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:04.635 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:04.895 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:04.895 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:04.895 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:05.156 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:05.156 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:05.156 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:05.156 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:05.418 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:05.418 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:05.418 22:56:31 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:05.418 22:56:31 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:05.418 22:56:31 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:05.418 22:56:31 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:05.418 22:56:31 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:05.418 22:56:31 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:05.418 22:56:31 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:05.418 22:56:31 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:05.418 22:56:31 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:05.418 22:56:31 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:05.418 22:56:31 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:05.418 22:56:31 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:05.418 22:56:31 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:05.418 22:56:31 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:05.418 22:56:31 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:05.418 22:56:31 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:05.418 22:56:31 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:05.418 22:56:31 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:05.418 22:56:31 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:05.418 22:56:31 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:05.418 22:56:31 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:05.418 22:56:31 -- common/autotest_common.sh@1552 -- # continue 00:04:05.418 22:56:31 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:05.418 22:56:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:05.418 22:56:31 -- common/autotest_common.sh@10 -- # set +x 00:04:05.418 22:56:31 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:05.418 22:56:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:05.418 22:56:31 -- common/autotest_common.sh@10 -- # set +x 00:04:05.418 22:56:31 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:06.798 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:06.798 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:06.798 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:06.798 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:06.798 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:06.798 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:06.798 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:06.798 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:06.798 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:06.798 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:06.798 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:06.798 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:06.798 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:06.798 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:06.798 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:06.798 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:07.741 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:08.000 22:56:34 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:08.000 22:56:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:08.000 22:56:34 -- common/autotest_common.sh@10 -- # set +x 00:04:08.000 22:56:34 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:08.000 22:56:34 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:08.000 22:56:34 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:08.000 22:56:34 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:08.000 22:56:34 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:08.000 22:56:34 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:08.000 22:56:34 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:08.000 22:56:34 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:08.000 22:56:34 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:08.000 22:56:34 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:08.000 22:56:34 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:08.000 22:56:34 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:08.000 22:56:34 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:08.000 22:56:34 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:08.000 22:56:34 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:08.000 22:56:34 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:08.000 22:56:34 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:08.000 22:56:34 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:08.000 22:56:34 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:08.000 22:56:34 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:08.000 22:56:34 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=78112 00:04:08.000 22:56:34 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:08.000 22:56:34 -- common/autotest_common.sh@1593 -- # waitforlisten 78112 00:04:08.000 22:56:34 -- common/autotest_common.sh@829 -- # '[' -z 78112 ']' 00:04:08.000 22:56:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:08.000 22:56:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:08.000 22:56:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:08.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:08.000 22:56:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:08.000 22:56:34 -- common/autotest_common.sh@10 -- # set +x 00:04:08.000 [2024-11-26 22:56:34.344041] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:08.000 [2024-11-26 22:56:34.344114] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid78112 ] 00:04:08.000 EAL: No free 2048 kB hugepages reported on node 1 00:04:08.260 [2024-11-26 22:56:34.403273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:08.260 [2024-11-26 22:56:34.510648] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:08.260 [2024-11-26 22:56:34.510835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:09.199 22:56:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:09.199 22:56:35 -- common/autotest_common.sh@862 -- # return 0 00:04:09.199 22:56:35 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:09.199 22:56:35 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:09.199 22:56:35 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:12.489 nvme0n1 00:04:12.489 22:56:38 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:12.489 [2024-11-26 22:56:38.604637] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:12.489 [2024-11-26 22:56:38.604682] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:12.490 request: 00:04:12.490 { 00:04:12.490 "nvme_ctrlr_name": "nvme0", 00:04:12.490 "password": "test", 00:04:12.490 "method": "bdev_nvme_opal_revert", 00:04:12.490 "req_id": 1 00:04:12.490 } 00:04:12.490 Got JSON-RPC error response 00:04:12.490 response: 00:04:12.490 { 00:04:12.490 "code": -32603, 00:04:12.490 "message": "Internal error" 00:04:12.490 } 00:04:12.490 22:56:38 -- common/autotest_common.sh@1599 -- # true 00:04:12.490 22:56:38 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:12.490 22:56:38 -- common/autotest_common.sh@1603 -- # killprocess 78112 00:04:12.490 22:56:38 -- common/autotest_common.sh@936 -- # '[' -z 78112 ']' 00:04:12.490 22:56:38 -- common/autotest_common.sh@940 -- # kill -0 78112 00:04:12.490 22:56:38 -- common/autotest_common.sh@941 -- # uname 00:04:12.490 22:56:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:12.490 22:56:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 78112 00:04:12.490 22:56:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:12.490 22:56:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:12.490 22:56:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 78112' 00:04:12.490 killing process with pid 78112 00:04:12.490 22:56:38 -- common/autotest_common.sh@955 -- # kill 78112 00:04:12.490 22:56:38 -- common/autotest_common.sh@960 -- # wait 78112 00:04:14.393 22:56:40 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:14.393 22:56:40 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:14.393 22:56:40 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:14.393 22:56:40 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:14.393 22:56:40 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:14.393 22:56:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:14.393 22:56:40 -- common/autotest_common.sh@10 -- # set +x 00:04:14.393 22:56:40 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:14.393 22:56:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.393 22:56:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.393 22:56:40 -- common/autotest_common.sh@10 -- # set +x 00:04:14.393 ************************************ 00:04:14.393 START TEST env 00:04:14.393 ************************************ 00:04:14.393 22:56:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:14.393 * Looking for test storage... 00:04:14.393 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:14.393 22:56:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:14.393 22:56:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:14.393 22:56:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:14.393 22:56:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:14.393 22:56:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:14.393 22:56:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:14.393 22:56:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:14.393 22:56:40 -- scripts/common.sh@335 -- # IFS=.-: 00:04:14.393 22:56:40 -- scripts/common.sh@335 -- # read -ra ver1 00:04:14.393 22:56:40 -- scripts/common.sh@336 -- # IFS=.-: 00:04:14.393 22:56:40 -- scripts/common.sh@336 -- # read -ra ver2 00:04:14.393 22:56:40 -- scripts/common.sh@337 -- # local 'op=<' 00:04:14.393 22:56:40 -- scripts/common.sh@339 -- # ver1_l=2 00:04:14.393 22:56:40 -- scripts/common.sh@340 -- # ver2_l=1 00:04:14.393 22:56:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:14.393 22:56:40 -- scripts/common.sh@343 -- # case "$op" in 00:04:14.393 22:56:40 -- scripts/common.sh@344 -- # : 1 00:04:14.393 22:56:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:14.393 22:56:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:14.393 22:56:40 -- scripts/common.sh@364 -- # decimal 1 00:04:14.393 22:56:40 -- scripts/common.sh@352 -- # local d=1 00:04:14.393 22:56:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:14.393 22:56:40 -- scripts/common.sh@354 -- # echo 1 00:04:14.393 22:56:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:14.393 22:56:40 -- scripts/common.sh@365 -- # decimal 2 00:04:14.393 22:56:40 -- scripts/common.sh@352 -- # local d=2 00:04:14.393 22:56:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:14.393 22:56:40 -- scripts/common.sh@354 -- # echo 2 00:04:14.393 22:56:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:14.393 22:56:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:14.393 22:56:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:14.393 22:56:40 -- scripts/common.sh@367 -- # return 0 00:04:14.393 22:56:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:14.393 22:56:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:14.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.393 --rc genhtml_branch_coverage=1 00:04:14.393 --rc genhtml_function_coverage=1 00:04:14.393 --rc genhtml_legend=1 00:04:14.393 --rc geninfo_all_blocks=1 00:04:14.393 --rc geninfo_unexecuted_blocks=1 00:04:14.393 00:04:14.393 ' 00:04:14.393 22:56:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:14.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.393 --rc genhtml_branch_coverage=1 00:04:14.393 --rc genhtml_function_coverage=1 00:04:14.393 --rc genhtml_legend=1 00:04:14.393 --rc geninfo_all_blocks=1 00:04:14.393 --rc geninfo_unexecuted_blocks=1 00:04:14.393 00:04:14.393 ' 00:04:14.393 22:56:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:14.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.393 --rc genhtml_branch_coverage=1 00:04:14.393 --rc genhtml_function_coverage=1 00:04:14.393 --rc genhtml_legend=1 00:04:14.393 --rc geninfo_all_blocks=1 00:04:14.393 --rc geninfo_unexecuted_blocks=1 00:04:14.394 00:04:14.394 ' 00:04:14.394 22:56:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:14.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.394 --rc genhtml_branch_coverage=1 00:04:14.394 --rc genhtml_function_coverage=1 00:04:14.394 --rc genhtml_legend=1 00:04:14.394 --rc geninfo_all_blocks=1 00:04:14.394 --rc geninfo_unexecuted_blocks=1 00:04:14.394 00:04:14.394 ' 00:04:14.394 22:56:40 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:14.394 22:56:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.394 22:56:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.394 22:56:40 -- common/autotest_common.sh@10 -- # set +x 00:04:14.394 ************************************ 00:04:14.394 START TEST env_memory 00:04:14.394 ************************************ 00:04:14.394 22:56:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:14.394 00:04:14.394 00:04:14.394 CUnit - A unit testing framework for C - Version 2.1-3 00:04:14.394 http://cunit.sourceforge.net/ 00:04:14.394 00:04:14.394 00:04:14.394 Suite: memory 00:04:14.394 Test: alloc and free memory map ...[2024-11-26 22:56:40.610024] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:14.394 passed 00:04:14.394 Test: mem map translation ...[2024-11-26 22:56:40.630690] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:14.394 [2024-11-26 22:56:40.630710] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:14.394 [2024-11-26 22:56:40.630752] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:14.394 [2024-11-26 22:56:40.630763] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:14.394 passed 00:04:14.394 Test: mem map registration ...[2024-11-26 22:56:40.672012] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:14.394 [2024-11-26 22:56:40.672030] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:14.394 passed 00:04:14.394 Test: mem map adjacent registrations ...passed 00:04:14.394 00:04:14.394 Run Summary: Type Total Ran Passed Failed Inactive 00:04:14.394 suites 1 1 n/a 0 0 00:04:14.394 tests 4 4 4 0 0 00:04:14.394 asserts 152 152 152 0 n/a 00:04:14.394 00:04:14.394 Elapsed time = 0.141 seconds 00:04:14.394 00:04:14.394 real 0m0.149s 00:04:14.394 user 0m0.141s 00:04:14.394 sys 0m0.008s 00:04:14.394 22:56:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:14.394 22:56:40 -- common/autotest_common.sh@10 -- # set +x 00:04:14.394 ************************************ 00:04:14.394 END TEST env_memory 00:04:14.394 ************************************ 00:04:14.394 22:56:40 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:14.394 22:56:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.394 22:56:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.394 22:56:40 -- common/autotest_common.sh@10 -- # set +x 00:04:14.394 ************************************ 00:04:14.394 START TEST env_vtophys 00:04:14.394 ************************************ 00:04:14.394 22:56:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:14.394 EAL: lib.eal log level changed from notice to debug 00:04:14.394 EAL: Detected lcore 0 as core 0 on socket 0 00:04:14.394 EAL: Detected lcore 1 as core 1 on socket 0 00:04:14.394 EAL: Detected lcore 2 as core 2 on socket 0 00:04:14.394 EAL: Detected lcore 3 as core 3 on socket 0 00:04:14.394 EAL: Detected lcore 4 as core 4 on socket 0 00:04:14.394 EAL: Detected lcore 5 as core 5 on socket 0 00:04:14.394 EAL: Detected lcore 6 as core 8 on socket 0 00:04:14.394 EAL: Detected lcore 7 as core 9 on socket 0 00:04:14.394 EAL: Detected lcore 8 as core 10 on socket 0 00:04:14.394 EAL: Detected lcore 9 as core 11 on socket 0 00:04:14.394 EAL: Detected lcore 10 as core 12 on socket 0 00:04:14.394 EAL: Detected lcore 11 as core 13 on socket 0 00:04:14.394 EAL: Detected lcore 12 as core 0 on socket 1 00:04:14.394 EAL: Detected lcore 13 as core 1 on socket 1 00:04:14.394 EAL: Detected lcore 14 as core 2 on socket 1 00:04:14.394 EAL: Detected lcore 15 as core 3 on socket 1 00:04:14.394 EAL: Detected lcore 16 as core 4 on socket 1 00:04:14.394 EAL: Detected lcore 17 as core 5 on socket 1 00:04:14.394 EAL: Detected lcore 18 as core 8 on socket 1 00:04:14.394 EAL: Detected lcore 19 as core 9 on socket 1 00:04:14.394 EAL: Detected lcore 20 as core 10 on socket 1 00:04:14.394 EAL: Detected lcore 21 as core 11 on socket 1 00:04:14.394 EAL: Detected lcore 22 as core 12 on socket 1 00:04:14.394 EAL: Detected lcore 23 as core 13 on socket 1 00:04:14.394 EAL: Detected lcore 24 as core 0 on socket 0 00:04:14.394 EAL: Detected lcore 25 as core 1 on socket 0 00:04:14.394 EAL: Detected lcore 26 as core 2 on socket 0 00:04:14.394 EAL: Detected lcore 27 as core 3 on socket 0 00:04:14.394 EAL: Detected lcore 28 as core 4 on socket 0 00:04:14.394 EAL: Detected lcore 29 as core 5 on socket 0 00:04:14.394 EAL: Detected lcore 30 as core 8 on socket 0 00:04:14.394 EAL: Detected lcore 31 as core 9 on socket 0 00:04:14.394 EAL: Detected lcore 32 as core 10 on socket 0 00:04:14.394 EAL: Detected lcore 33 as core 11 on socket 0 00:04:14.394 EAL: Detected lcore 34 as core 12 on socket 0 00:04:14.394 EAL: Detected lcore 35 as core 13 on socket 0 00:04:14.394 EAL: Detected lcore 36 as core 0 on socket 1 00:04:14.394 EAL: Detected lcore 37 as core 1 on socket 1 00:04:14.394 EAL: Detected lcore 38 as core 2 on socket 1 00:04:14.394 EAL: Detected lcore 39 as core 3 on socket 1 00:04:14.394 EAL: Detected lcore 40 as core 4 on socket 1 00:04:14.394 EAL: Detected lcore 41 as core 5 on socket 1 00:04:14.394 EAL: Detected lcore 42 as core 8 on socket 1 00:04:14.394 EAL: Detected lcore 43 as core 9 on socket 1 00:04:14.394 EAL: Detected lcore 44 as core 10 on socket 1 00:04:14.394 EAL: Detected lcore 45 as core 11 on socket 1 00:04:14.394 EAL: Detected lcore 46 as core 12 on socket 1 00:04:14.394 EAL: Detected lcore 47 as core 13 on socket 1 00:04:14.394 EAL: Maximum logical cores by configuration: 128 00:04:14.394 EAL: Detected CPU lcores: 48 00:04:14.394 EAL: Detected NUMA nodes: 2 00:04:14.394 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:14.394 EAL: Detected shared linkage of DPDK 00:04:14.394 EAL: No shared files mode enabled, IPC will be disabled 00:04:14.654 EAL: Bus pci wants IOVA as 'DC' 00:04:14.654 EAL: Buses did not request a specific IOVA mode. 00:04:14.654 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:14.654 EAL: Selected IOVA mode 'VA' 00:04:14.654 EAL: No free 2048 kB hugepages reported on node 1 00:04:14.654 EAL: Probing VFIO support... 00:04:14.654 EAL: IOMMU type 1 (Type 1) is supported 00:04:14.654 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:14.654 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:14.654 EAL: VFIO support initialized 00:04:14.654 EAL: Ask a virtual area of 0x2e000 bytes 00:04:14.654 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:14.654 EAL: Setting up physically contiguous memory... 00:04:14.654 EAL: Setting maximum number of open files to 524288 00:04:14.654 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:14.654 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:14.654 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:14.654 EAL: Ask a virtual area of 0x61000 bytes 00:04:14.654 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:14.654 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:14.654 EAL: Ask a virtual area of 0x400000000 bytes 00:04:14.654 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:14.654 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:14.654 EAL: Ask a virtual area of 0x61000 bytes 00:04:14.654 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:14.654 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:14.654 EAL: Ask a virtual area of 0x400000000 bytes 00:04:14.654 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:14.654 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:14.654 EAL: Ask a virtual area of 0x61000 bytes 00:04:14.655 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:14.655 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:14.655 EAL: Ask a virtual area of 0x400000000 bytes 00:04:14.655 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:14.655 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:14.655 EAL: Ask a virtual area of 0x61000 bytes 00:04:14.655 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:14.655 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:14.655 EAL: Ask a virtual area of 0x400000000 bytes 00:04:14.655 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:14.655 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:14.655 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:14.655 EAL: Ask a virtual area of 0x61000 bytes 00:04:14.655 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:14.655 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:14.655 EAL: Ask a virtual area of 0x400000000 bytes 00:04:14.655 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:14.655 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:14.655 EAL: Ask a virtual area of 0x61000 bytes 00:04:14.655 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:14.655 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:14.655 EAL: Ask a virtual area of 0x400000000 bytes 00:04:14.655 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:14.655 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:14.655 EAL: Ask a virtual area of 0x61000 bytes 00:04:14.655 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:14.655 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:14.655 EAL: Ask a virtual area of 0x400000000 bytes 00:04:14.655 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:14.655 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:14.655 EAL: Ask a virtual area of 0x61000 bytes 00:04:14.655 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:14.655 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:14.655 EAL: Ask a virtual area of 0x400000000 bytes 00:04:14.655 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:14.655 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:14.655 EAL: Hugepages will be freed exactly as allocated. 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: TSC frequency is ~2700000 KHz 00:04:14.655 EAL: Main lcore 0 is ready (tid=7fbce237ea00;cpuset=[0]) 00:04:14.655 EAL: Trying to obtain current memory policy. 00:04:14.655 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.655 EAL: Restoring previous memory policy: 0 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was expanded by 2MB 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:14.655 EAL: Mem event callback 'spdk:(nil)' registered 00:04:14.655 00:04:14.655 00:04:14.655 CUnit - A unit testing framework for C - Version 2.1-3 00:04:14.655 http://cunit.sourceforge.net/ 00:04:14.655 00:04:14.655 00:04:14.655 Suite: components_suite 00:04:14.655 Test: vtophys_malloc_test ...passed 00:04:14.655 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:14.655 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.655 EAL: Restoring previous memory policy: 4 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was expanded by 4MB 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was shrunk by 4MB 00:04:14.655 EAL: Trying to obtain current memory policy. 00:04:14.655 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.655 EAL: Restoring previous memory policy: 4 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was expanded by 6MB 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was shrunk by 6MB 00:04:14.655 EAL: Trying to obtain current memory policy. 00:04:14.655 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.655 EAL: Restoring previous memory policy: 4 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was expanded by 10MB 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was shrunk by 10MB 00:04:14.655 EAL: Trying to obtain current memory policy. 00:04:14.655 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.655 EAL: Restoring previous memory policy: 4 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was expanded by 18MB 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was shrunk by 18MB 00:04:14.655 EAL: Trying to obtain current memory policy. 00:04:14.655 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.655 EAL: Restoring previous memory policy: 4 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was expanded by 34MB 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was shrunk by 34MB 00:04:14.655 EAL: Trying to obtain current memory policy. 00:04:14.655 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.655 EAL: Restoring previous memory policy: 4 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was expanded by 66MB 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was shrunk by 66MB 00:04:14.655 EAL: Trying to obtain current memory policy. 00:04:14.655 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.655 EAL: Restoring previous memory policy: 4 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.655 EAL: Heap on socket 0 was expanded by 130MB 00:04:14.655 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.655 EAL: request: mp_malloc_sync 00:04:14.655 EAL: No shared files mode enabled, IPC is disabled 00:04:14.656 EAL: Heap on socket 0 was shrunk by 130MB 00:04:14.656 EAL: Trying to obtain current memory policy. 00:04:14.656 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.656 EAL: Restoring previous memory policy: 4 00:04:14.656 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.656 EAL: request: mp_malloc_sync 00:04:14.656 EAL: No shared files mode enabled, IPC is disabled 00:04:14.656 EAL: Heap on socket 0 was expanded by 258MB 00:04:14.915 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.915 EAL: request: mp_malloc_sync 00:04:14.915 EAL: No shared files mode enabled, IPC is disabled 00:04:14.915 EAL: Heap on socket 0 was shrunk by 258MB 00:04:14.915 EAL: Trying to obtain current memory policy. 00:04:14.915 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.915 EAL: Restoring previous memory policy: 4 00:04:14.915 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.915 EAL: request: mp_malloc_sync 00:04:14.915 EAL: No shared files mode enabled, IPC is disabled 00:04:14.915 EAL: Heap on socket 0 was expanded by 514MB 00:04:15.174 EAL: Calling mem event callback 'spdk:(nil)' 00:04:15.174 EAL: request: mp_malloc_sync 00:04:15.174 EAL: No shared files mode enabled, IPC is disabled 00:04:15.174 EAL: Heap on socket 0 was shrunk by 514MB 00:04:15.174 EAL: Trying to obtain current memory policy. 00:04:15.174 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:15.433 EAL: Restoring previous memory policy: 4 00:04:15.433 EAL: Calling mem event callback 'spdk:(nil)' 00:04:15.433 EAL: request: mp_malloc_sync 00:04:15.433 EAL: No shared files mode enabled, IPC is disabled 00:04:15.433 EAL: Heap on socket 0 was expanded by 1026MB 00:04:15.692 EAL: Calling mem event callback 'spdk:(nil)' 00:04:15.951 EAL: request: mp_malloc_sync 00:04:15.951 EAL: No shared files mode enabled, IPC is disabled 00:04:15.951 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:15.951 passed 00:04:15.951 00:04:15.951 Run Summary: Type Total Ran Passed Failed Inactive 00:04:15.951 suites 1 1 n/a 0 0 00:04:15.951 tests 2 2 2 0 0 00:04:15.951 asserts 497 497 497 0 n/a 00:04:15.951 00:04:15.951 Elapsed time = 1.316 seconds 00:04:15.951 EAL: Calling mem event callback 'spdk:(nil)' 00:04:15.951 EAL: request: mp_malloc_sync 00:04:15.951 EAL: No shared files mode enabled, IPC is disabled 00:04:15.951 EAL: Heap on socket 0 was shrunk by 2MB 00:04:15.951 EAL: No shared files mode enabled, IPC is disabled 00:04:15.951 EAL: No shared files mode enabled, IPC is disabled 00:04:15.951 EAL: No shared files mode enabled, IPC is disabled 00:04:15.951 00:04:15.951 real 0m1.422s 00:04:15.951 user 0m0.830s 00:04:15.951 sys 0m0.560s 00:04:15.951 22:56:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.951 22:56:42 -- common/autotest_common.sh@10 -- # set +x 00:04:15.951 ************************************ 00:04:15.951 END TEST env_vtophys 00:04:15.951 ************************************ 00:04:15.951 22:56:42 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:15.951 22:56:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.951 22:56:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.951 22:56:42 -- common/autotest_common.sh@10 -- # set +x 00:04:15.951 ************************************ 00:04:15.951 START TEST env_pci 00:04:15.951 ************************************ 00:04:15.951 22:56:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:15.951 00:04:15.951 00:04:15.951 CUnit - A unit testing framework for C - Version 2.1-3 00:04:15.951 http://cunit.sourceforge.net/ 00:04:15.951 00:04:15.951 00:04:15.951 Suite: pci 00:04:15.952 Test: pci_hook ...[2024-11-26 22:56:42.211821] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 79151 has claimed it 00:04:15.952 EAL: Cannot find device (10000:00:01.0) 00:04:15.952 EAL: Failed to attach device on primary process 00:04:15.952 passed 00:04:15.952 00:04:15.952 Run Summary: Type Total Ran Passed Failed Inactive 00:04:15.952 suites 1 1 n/a 0 0 00:04:15.952 tests 1 1 1 0 0 00:04:15.952 asserts 25 25 25 0 n/a 00:04:15.952 00:04:15.952 Elapsed time = 0.022 seconds 00:04:15.952 00:04:15.952 real 0m0.035s 00:04:15.952 user 0m0.012s 00:04:15.952 sys 0m0.023s 00:04:15.952 22:56:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.952 22:56:42 -- common/autotest_common.sh@10 -- # set +x 00:04:15.952 ************************************ 00:04:15.952 END TEST env_pci 00:04:15.952 ************************************ 00:04:15.952 22:56:42 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:15.952 22:56:42 -- env/env.sh@15 -- # uname 00:04:15.952 22:56:42 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:15.952 22:56:42 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:15.952 22:56:42 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:15.952 22:56:42 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:15.952 22:56:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.952 22:56:42 -- common/autotest_common.sh@10 -- # set +x 00:04:15.952 ************************************ 00:04:15.952 START TEST env_dpdk_post_init 00:04:15.952 ************************************ 00:04:15.952 22:56:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:15.952 EAL: Detected CPU lcores: 48 00:04:15.952 EAL: Detected NUMA nodes: 2 00:04:15.952 EAL: Detected shared linkage of DPDK 00:04:15.952 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:15.952 EAL: Selected IOVA mode 'VA' 00:04:15.952 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.952 EAL: VFIO support initialized 00:04:15.952 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:16.213 EAL: Using IOMMU type 1 (Type 1) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:16.213 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:17.156 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:20.442 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:20.442 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:20.442 Starting DPDK initialization... 00:04:20.442 Starting SPDK post initialization... 00:04:20.442 SPDK NVMe probe 00:04:20.442 Attaching to 0000:88:00.0 00:04:20.442 Attached to 0000:88:00.0 00:04:20.442 Cleaning up... 00:04:20.442 00:04:20.442 real 0m4.408s 00:04:20.442 user 0m3.267s 00:04:20.442 sys 0m0.194s 00:04:20.442 22:56:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:20.442 22:56:46 -- common/autotest_common.sh@10 -- # set +x 00:04:20.442 ************************************ 00:04:20.442 END TEST env_dpdk_post_init 00:04:20.442 ************************************ 00:04:20.442 22:56:46 -- env/env.sh@26 -- # uname 00:04:20.442 22:56:46 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:20.442 22:56:46 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:20.442 22:56:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.442 22:56:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.442 22:56:46 -- common/autotest_common.sh@10 -- # set +x 00:04:20.442 ************************************ 00:04:20.442 START TEST env_mem_callbacks 00:04:20.442 ************************************ 00:04:20.442 22:56:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:20.442 EAL: Detected CPU lcores: 48 00:04:20.442 EAL: Detected NUMA nodes: 2 00:04:20.442 EAL: Detected shared linkage of DPDK 00:04:20.442 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:20.442 EAL: Selected IOVA mode 'VA' 00:04:20.442 EAL: No free 2048 kB hugepages reported on node 1 00:04:20.442 EAL: VFIO support initialized 00:04:20.442 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:20.442 00:04:20.442 00:04:20.442 CUnit - A unit testing framework for C - Version 2.1-3 00:04:20.442 http://cunit.sourceforge.net/ 00:04:20.442 00:04:20.442 00:04:20.442 Suite: memory 00:04:20.442 Test: test ... 00:04:20.442 register 0x200000200000 2097152 00:04:20.442 malloc 3145728 00:04:20.442 register 0x200000400000 4194304 00:04:20.442 buf 0x200000500000 len 3145728 PASSED 00:04:20.442 malloc 64 00:04:20.442 buf 0x2000004fff40 len 64 PASSED 00:04:20.442 malloc 4194304 00:04:20.442 register 0x200000800000 6291456 00:04:20.442 buf 0x200000a00000 len 4194304 PASSED 00:04:20.442 free 0x200000500000 3145728 00:04:20.442 free 0x2000004fff40 64 00:04:20.442 unregister 0x200000400000 4194304 PASSED 00:04:20.442 free 0x200000a00000 4194304 00:04:20.442 unregister 0x200000800000 6291456 PASSED 00:04:20.442 malloc 8388608 00:04:20.442 register 0x200000400000 10485760 00:04:20.442 buf 0x200000600000 len 8388608 PASSED 00:04:20.442 free 0x200000600000 8388608 00:04:20.442 unregister 0x200000400000 10485760 PASSED 00:04:20.442 passed 00:04:20.442 00:04:20.442 Run Summary: Type Total Ran Passed Failed Inactive 00:04:20.442 suites 1 1 n/a 0 0 00:04:20.442 tests 1 1 1 0 0 00:04:20.442 asserts 15 15 15 0 n/a 00:04:20.442 00:04:20.442 Elapsed time = 0.005 seconds 00:04:20.442 00:04:20.442 real 0m0.045s 00:04:20.442 user 0m0.010s 00:04:20.442 sys 0m0.034s 00:04:20.442 22:56:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:20.442 22:56:46 -- common/autotest_common.sh@10 -- # set +x 00:04:20.442 ************************************ 00:04:20.442 END TEST env_mem_callbacks 00:04:20.442 ************************************ 00:04:20.442 00:04:20.442 real 0m6.333s 00:04:20.442 user 0m4.414s 00:04:20.442 sys 0m0.968s 00:04:20.442 22:56:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:20.442 22:56:46 -- common/autotest_common.sh@10 -- # set +x 00:04:20.442 ************************************ 00:04:20.442 END TEST env 00:04:20.442 ************************************ 00:04:20.442 22:56:46 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:20.442 22:56:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.442 22:56:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.442 22:56:46 -- common/autotest_common.sh@10 -- # set +x 00:04:20.442 ************************************ 00:04:20.442 START TEST rpc 00:04:20.442 ************************************ 00:04:20.442 22:56:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:20.702 * Looking for test storage... 00:04:20.702 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:20.702 22:56:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:20.702 22:56:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:20.702 22:56:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:20.702 22:56:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:20.702 22:56:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:20.702 22:56:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:20.702 22:56:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:20.702 22:56:46 -- scripts/common.sh@335 -- # IFS=.-: 00:04:20.702 22:56:46 -- scripts/common.sh@335 -- # read -ra ver1 00:04:20.702 22:56:46 -- scripts/common.sh@336 -- # IFS=.-: 00:04:20.702 22:56:46 -- scripts/common.sh@336 -- # read -ra ver2 00:04:20.702 22:56:46 -- scripts/common.sh@337 -- # local 'op=<' 00:04:20.702 22:56:46 -- scripts/common.sh@339 -- # ver1_l=2 00:04:20.702 22:56:46 -- scripts/common.sh@340 -- # ver2_l=1 00:04:20.702 22:56:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:20.702 22:56:46 -- scripts/common.sh@343 -- # case "$op" in 00:04:20.702 22:56:46 -- scripts/common.sh@344 -- # : 1 00:04:20.702 22:56:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:20.702 22:56:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:20.702 22:56:46 -- scripts/common.sh@364 -- # decimal 1 00:04:20.702 22:56:46 -- scripts/common.sh@352 -- # local d=1 00:04:20.702 22:56:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:20.702 22:56:46 -- scripts/common.sh@354 -- # echo 1 00:04:20.702 22:56:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:20.702 22:56:46 -- scripts/common.sh@365 -- # decimal 2 00:04:20.702 22:56:46 -- scripts/common.sh@352 -- # local d=2 00:04:20.702 22:56:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:20.702 22:56:46 -- scripts/common.sh@354 -- # echo 2 00:04:20.702 22:56:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:20.702 22:56:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:20.702 22:56:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:20.702 22:56:46 -- scripts/common.sh@367 -- # return 0 00:04:20.702 22:56:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:20.702 22:56:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:20.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.702 --rc genhtml_branch_coverage=1 00:04:20.702 --rc genhtml_function_coverage=1 00:04:20.702 --rc genhtml_legend=1 00:04:20.702 --rc geninfo_all_blocks=1 00:04:20.702 --rc geninfo_unexecuted_blocks=1 00:04:20.702 00:04:20.702 ' 00:04:20.702 22:56:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:20.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.702 --rc genhtml_branch_coverage=1 00:04:20.702 --rc genhtml_function_coverage=1 00:04:20.702 --rc genhtml_legend=1 00:04:20.702 --rc geninfo_all_blocks=1 00:04:20.702 --rc geninfo_unexecuted_blocks=1 00:04:20.702 00:04:20.702 ' 00:04:20.702 22:56:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:20.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.702 --rc genhtml_branch_coverage=1 00:04:20.702 --rc genhtml_function_coverage=1 00:04:20.702 --rc genhtml_legend=1 00:04:20.703 --rc geninfo_all_blocks=1 00:04:20.703 --rc geninfo_unexecuted_blocks=1 00:04:20.703 00:04:20.703 ' 00:04:20.703 22:56:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:20.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.703 --rc genhtml_branch_coverage=1 00:04:20.703 --rc genhtml_function_coverage=1 00:04:20.703 --rc genhtml_legend=1 00:04:20.703 --rc geninfo_all_blocks=1 00:04:20.703 --rc geninfo_unexecuted_blocks=1 00:04:20.703 00:04:20.703 ' 00:04:20.703 22:56:46 -- rpc/rpc.sh@65 -- # spdk_pid=79827 00:04:20.703 22:56:46 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:20.703 22:56:46 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:20.703 22:56:46 -- rpc/rpc.sh@67 -- # waitforlisten 79827 00:04:20.703 22:56:46 -- common/autotest_common.sh@829 -- # '[' -z 79827 ']' 00:04:20.703 22:56:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:20.703 22:56:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:20.703 22:56:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:20.703 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:20.703 22:56:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:20.703 22:56:46 -- common/autotest_common.sh@10 -- # set +x 00:04:20.703 [2024-11-26 22:56:46.970365] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:20.703 [2024-11-26 22:56:46.970450] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid79827 ] 00:04:20.703 EAL: No free 2048 kB hugepages reported on node 1 00:04:20.703 [2024-11-26 22:56:47.026578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:20.962 [2024-11-26 22:56:47.131294] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:20.962 [2024-11-26 22:56:47.131435] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:20.962 [2024-11-26 22:56:47.131455] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 79827' to capture a snapshot of events at runtime. 00:04:20.962 [2024-11-26 22:56:47.131467] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid79827 for offline analysis/debug. 00:04:20.962 [2024-11-26 22:56:47.131497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:21.530 22:56:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:21.530 22:56:47 -- common/autotest_common.sh@862 -- # return 0 00:04:21.530 22:56:47 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:21.530 22:56:47 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:21.530 22:56:47 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:21.530 22:56:47 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:21.530 22:56:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:21.530 22:56:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:21.530 22:56:47 -- common/autotest_common.sh@10 -- # set +x 00:04:21.530 ************************************ 00:04:21.530 START TEST rpc_integrity 00:04:21.530 ************************************ 00:04:21.530 22:56:47 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:21.530 22:56:47 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:21.530 22:56:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.530 22:56:47 -- common/autotest_common.sh@10 -- # set +x 00:04:21.790 22:56:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.790 22:56:47 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:21.790 22:56:47 -- rpc/rpc.sh@13 -- # jq length 00:04:21.790 22:56:47 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:21.790 22:56:47 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:21.790 22:56:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.790 22:56:47 -- common/autotest_common.sh@10 -- # set +x 00:04:21.790 22:56:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.790 22:56:47 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:21.790 22:56:47 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:21.790 22:56:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.790 22:56:47 -- common/autotest_common.sh@10 -- # set +x 00:04:21.790 22:56:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.790 22:56:47 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:21.790 { 00:04:21.790 "name": "Malloc0", 00:04:21.790 "aliases": [ 00:04:21.790 "51fd61d5-71f5-4587-8a5b-e77eb8cd62f5" 00:04:21.790 ], 00:04:21.790 "product_name": "Malloc disk", 00:04:21.790 "block_size": 512, 00:04:21.790 "num_blocks": 16384, 00:04:21.790 "uuid": "51fd61d5-71f5-4587-8a5b-e77eb8cd62f5", 00:04:21.790 "assigned_rate_limits": { 00:04:21.790 "rw_ios_per_sec": 0, 00:04:21.790 "rw_mbytes_per_sec": 0, 00:04:21.790 "r_mbytes_per_sec": 0, 00:04:21.790 "w_mbytes_per_sec": 0 00:04:21.790 }, 00:04:21.790 "claimed": false, 00:04:21.790 "zoned": false, 00:04:21.790 "supported_io_types": { 00:04:21.790 "read": true, 00:04:21.790 "write": true, 00:04:21.790 "unmap": true, 00:04:21.790 "write_zeroes": true, 00:04:21.791 "flush": true, 00:04:21.791 "reset": true, 00:04:21.791 "compare": false, 00:04:21.791 "compare_and_write": false, 00:04:21.791 "abort": true, 00:04:21.791 "nvme_admin": false, 00:04:21.791 "nvme_io": false 00:04:21.791 }, 00:04:21.791 "memory_domains": [ 00:04:21.791 { 00:04:21.791 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:21.791 "dma_device_type": 2 00:04:21.791 } 00:04:21.791 ], 00:04:21.791 "driver_specific": {} 00:04:21.791 } 00:04:21.791 ]' 00:04:21.791 22:56:47 -- rpc/rpc.sh@17 -- # jq length 00:04:21.791 22:56:48 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:21.791 22:56:48 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:21.791 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 [2024-11-26 22:56:48.018834] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:21.791 [2024-11-26 22:56:48.018892] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:21.791 [2024-11-26 22:56:48.018915] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x232ecb0 00:04:21.791 [2024-11-26 22:56:48.018928] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:21.791 [2024-11-26 22:56:48.020170] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:21.791 [2024-11-26 22:56:48.020197] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:21.791 Passthru0 00:04:21.791 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.791 22:56:48 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:21.791 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.791 22:56:48 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:21.791 { 00:04:21.791 "name": "Malloc0", 00:04:21.791 "aliases": [ 00:04:21.791 "51fd61d5-71f5-4587-8a5b-e77eb8cd62f5" 00:04:21.791 ], 00:04:21.791 "product_name": "Malloc disk", 00:04:21.791 "block_size": 512, 00:04:21.791 "num_blocks": 16384, 00:04:21.791 "uuid": "51fd61d5-71f5-4587-8a5b-e77eb8cd62f5", 00:04:21.791 "assigned_rate_limits": { 00:04:21.791 "rw_ios_per_sec": 0, 00:04:21.791 "rw_mbytes_per_sec": 0, 00:04:21.791 "r_mbytes_per_sec": 0, 00:04:21.791 "w_mbytes_per_sec": 0 00:04:21.791 }, 00:04:21.791 "claimed": true, 00:04:21.791 "claim_type": "exclusive_write", 00:04:21.791 "zoned": false, 00:04:21.791 "supported_io_types": { 00:04:21.791 "read": true, 00:04:21.791 "write": true, 00:04:21.791 "unmap": true, 00:04:21.791 "write_zeroes": true, 00:04:21.791 "flush": true, 00:04:21.791 "reset": true, 00:04:21.791 "compare": false, 00:04:21.791 "compare_and_write": false, 00:04:21.791 "abort": true, 00:04:21.791 "nvme_admin": false, 00:04:21.791 "nvme_io": false 00:04:21.791 }, 00:04:21.791 "memory_domains": [ 00:04:21.791 { 00:04:21.791 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:21.791 "dma_device_type": 2 00:04:21.791 } 00:04:21.791 ], 00:04:21.791 "driver_specific": {} 00:04:21.791 }, 00:04:21.791 { 00:04:21.791 "name": "Passthru0", 00:04:21.791 "aliases": [ 00:04:21.791 "a1d98c38-4026-540c-98f2-b1521549216e" 00:04:21.791 ], 00:04:21.791 "product_name": "passthru", 00:04:21.791 "block_size": 512, 00:04:21.791 "num_blocks": 16384, 00:04:21.791 "uuid": "a1d98c38-4026-540c-98f2-b1521549216e", 00:04:21.791 "assigned_rate_limits": { 00:04:21.791 "rw_ios_per_sec": 0, 00:04:21.791 "rw_mbytes_per_sec": 0, 00:04:21.791 "r_mbytes_per_sec": 0, 00:04:21.791 "w_mbytes_per_sec": 0 00:04:21.791 }, 00:04:21.791 "claimed": false, 00:04:21.791 "zoned": false, 00:04:21.791 "supported_io_types": { 00:04:21.791 "read": true, 00:04:21.791 "write": true, 00:04:21.791 "unmap": true, 00:04:21.791 "write_zeroes": true, 00:04:21.791 "flush": true, 00:04:21.791 "reset": true, 00:04:21.791 "compare": false, 00:04:21.791 "compare_and_write": false, 00:04:21.791 "abort": true, 00:04:21.791 "nvme_admin": false, 00:04:21.791 "nvme_io": false 00:04:21.791 }, 00:04:21.791 "memory_domains": [ 00:04:21.791 { 00:04:21.791 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:21.791 "dma_device_type": 2 00:04:21.791 } 00:04:21.791 ], 00:04:21.791 "driver_specific": { 00:04:21.791 "passthru": { 00:04:21.791 "name": "Passthru0", 00:04:21.791 "base_bdev_name": "Malloc0" 00:04:21.791 } 00:04:21.791 } 00:04:21.791 } 00:04:21.791 ]' 00:04:21.791 22:56:48 -- rpc/rpc.sh@21 -- # jq length 00:04:21.791 22:56:48 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:21.791 22:56:48 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:21.791 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.791 22:56:48 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:21.791 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.791 22:56:48 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:21.791 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.791 22:56:48 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:21.791 22:56:48 -- rpc/rpc.sh@26 -- # jq length 00:04:21.791 22:56:48 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:21.791 00:04:21.791 real 0m0.207s 00:04:21.791 user 0m0.136s 00:04:21.791 sys 0m0.015s 00:04:21.791 22:56:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 ************************************ 00:04:21.791 END TEST rpc_integrity 00:04:21.791 ************************************ 00:04:21.791 22:56:48 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:21.791 22:56:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:21.791 22:56:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 ************************************ 00:04:21.791 START TEST rpc_plugins 00:04:21.791 ************************************ 00:04:21.791 22:56:48 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:21.791 22:56:48 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:21.791 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.791 22:56:48 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:21.791 22:56:48 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:21.791 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:21.791 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.791 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:21.791 22:56:48 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:21.791 { 00:04:21.792 "name": "Malloc1", 00:04:21.792 "aliases": [ 00:04:21.792 "166c61ef-1fff-462d-8dd2-a209274d10f6" 00:04:21.792 ], 00:04:21.792 "product_name": "Malloc disk", 00:04:21.792 "block_size": 4096, 00:04:21.792 "num_blocks": 256, 00:04:21.792 "uuid": "166c61ef-1fff-462d-8dd2-a209274d10f6", 00:04:21.792 "assigned_rate_limits": { 00:04:21.792 "rw_ios_per_sec": 0, 00:04:21.792 "rw_mbytes_per_sec": 0, 00:04:21.792 "r_mbytes_per_sec": 0, 00:04:21.792 "w_mbytes_per_sec": 0 00:04:21.792 }, 00:04:21.792 "claimed": false, 00:04:21.792 "zoned": false, 00:04:21.792 "supported_io_types": { 00:04:21.792 "read": true, 00:04:21.792 "write": true, 00:04:21.792 "unmap": true, 00:04:21.792 "write_zeroes": true, 00:04:21.792 "flush": true, 00:04:21.792 "reset": true, 00:04:21.792 "compare": false, 00:04:21.792 "compare_and_write": false, 00:04:21.792 "abort": true, 00:04:21.792 "nvme_admin": false, 00:04:21.792 "nvme_io": false 00:04:21.792 }, 00:04:21.792 "memory_domains": [ 00:04:21.792 { 00:04:21.792 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:21.792 "dma_device_type": 2 00:04:21.792 } 00:04:21.792 ], 00:04:21.792 "driver_specific": {} 00:04:21.792 } 00:04:21.792 ]' 00:04:21.792 22:56:48 -- rpc/rpc.sh@32 -- # jq length 00:04:22.051 22:56:48 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:22.051 22:56:48 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:22.051 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.051 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.051 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.051 22:56:48 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:22.051 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.051 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.051 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.051 22:56:48 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:22.051 22:56:48 -- rpc/rpc.sh@36 -- # jq length 00:04:22.051 22:56:48 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:22.051 00:04:22.051 real 0m0.105s 00:04:22.051 user 0m0.067s 00:04:22.051 sys 0m0.011s 00:04:22.051 22:56:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.051 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.051 ************************************ 00:04:22.051 END TEST rpc_plugins 00:04:22.051 ************************************ 00:04:22.051 22:56:48 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:22.051 22:56:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.051 22:56:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.051 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.051 ************************************ 00:04:22.051 START TEST rpc_trace_cmd_test 00:04:22.051 ************************************ 00:04:22.051 22:56:48 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:22.051 22:56:48 -- rpc/rpc.sh@40 -- # local info 00:04:22.051 22:56:48 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:22.051 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.051 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.051 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.051 22:56:48 -- rpc/rpc.sh@42 -- # info='{ 00:04:22.051 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid79827", 00:04:22.051 "tpoint_group_mask": "0x8", 00:04:22.051 "iscsi_conn": { 00:04:22.051 "mask": "0x2", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "scsi": { 00:04:22.051 "mask": "0x4", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "bdev": { 00:04:22.051 "mask": "0x8", 00:04:22.051 "tpoint_mask": "0xffffffffffffffff" 00:04:22.051 }, 00:04:22.051 "nvmf_rdma": { 00:04:22.051 "mask": "0x10", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "nvmf_tcp": { 00:04:22.051 "mask": "0x20", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "ftl": { 00:04:22.051 "mask": "0x40", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "blobfs": { 00:04:22.051 "mask": "0x80", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "dsa": { 00:04:22.051 "mask": "0x200", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "thread": { 00:04:22.051 "mask": "0x400", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "nvme_pcie": { 00:04:22.051 "mask": "0x800", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "iaa": { 00:04:22.051 "mask": "0x1000", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "nvme_tcp": { 00:04:22.051 "mask": "0x2000", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 }, 00:04:22.051 "bdev_nvme": { 00:04:22.051 "mask": "0x4000", 00:04:22.051 "tpoint_mask": "0x0" 00:04:22.051 } 00:04:22.051 }' 00:04:22.051 22:56:48 -- rpc/rpc.sh@43 -- # jq length 00:04:22.051 22:56:48 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:22.051 22:56:48 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:22.051 22:56:48 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:22.051 22:56:48 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:22.051 22:56:48 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:22.051 22:56:48 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:22.051 22:56:48 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:22.051 22:56:48 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:22.310 22:56:48 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:22.310 00:04:22.310 real 0m0.175s 00:04:22.310 user 0m0.154s 00:04:22.310 sys 0m0.015s 00:04:22.310 22:56:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.310 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.310 ************************************ 00:04:22.310 END TEST rpc_trace_cmd_test 00:04:22.310 ************************************ 00:04:22.310 22:56:48 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:22.310 22:56:48 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:22.310 22:56:48 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:22.310 22:56:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.310 22:56:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.310 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.310 ************************************ 00:04:22.310 START TEST rpc_daemon_integrity 00:04:22.310 ************************************ 00:04:22.310 22:56:48 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:22.310 22:56:48 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:22.310 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.310 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.310 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.310 22:56:48 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:22.310 22:56:48 -- rpc/rpc.sh@13 -- # jq length 00:04:22.310 22:56:48 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:22.310 22:56:48 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:22.310 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.310 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.310 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.310 22:56:48 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:22.310 22:56:48 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:22.310 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.310 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.310 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.310 22:56:48 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:22.310 { 00:04:22.310 "name": "Malloc2", 00:04:22.310 "aliases": [ 00:04:22.310 "77de6246-97e0-444f-9072-2292549222da" 00:04:22.310 ], 00:04:22.310 "product_name": "Malloc disk", 00:04:22.310 "block_size": 512, 00:04:22.310 "num_blocks": 16384, 00:04:22.310 "uuid": "77de6246-97e0-444f-9072-2292549222da", 00:04:22.310 "assigned_rate_limits": { 00:04:22.310 "rw_ios_per_sec": 0, 00:04:22.310 "rw_mbytes_per_sec": 0, 00:04:22.310 "r_mbytes_per_sec": 0, 00:04:22.310 "w_mbytes_per_sec": 0 00:04:22.310 }, 00:04:22.310 "claimed": false, 00:04:22.310 "zoned": false, 00:04:22.310 "supported_io_types": { 00:04:22.310 "read": true, 00:04:22.310 "write": true, 00:04:22.310 "unmap": true, 00:04:22.310 "write_zeroes": true, 00:04:22.310 "flush": true, 00:04:22.310 "reset": true, 00:04:22.310 "compare": false, 00:04:22.310 "compare_and_write": false, 00:04:22.310 "abort": true, 00:04:22.310 "nvme_admin": false, 00:04:22.310 "nvme_io": false 00:04:22.310 }, 00:04:22.310 "memory_domains": [ 00:04:22.310 { 00:04:22.310 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:22.310 "dma_device_type": 2 00:04:22.310 } 00:04:22.310 ], 00:04:22.310 "driver_specific": {} 00:04:22.310 } 00:04:22.310 ]' 00:04:22.310 22:56:48 -- rpc/rpc.sh@17 -- # jq length 00:04:22.310 22:56:48 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:22.310 22:56:48 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:22.310 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.310 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.310 [2024-11-26 22:56:48.584482] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:22.310 [2024-11-26 22:56:48.584540] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:22.310 [2024-11-26 22:56:48.584567] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x2330590 00:04:22.310 [2024-11-26 22:56:48.584581] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:22.310 [2024-11-26 22:56:48.585731] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:22.310 [2024-11-26 22:56:48.585756] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:22.310 Passthru0 00:04:22.310 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.310 22:56:48 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:22.310 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.310 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.310 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.310 22:56:48 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:22.310 { 00:04:22.310 "name": "Malloc2", 00:04:22.310 "aliases": [ 00:04:22.310 "77de6246-97e0-444f-9072-2292549222da" 00:04:22.310 ], 00:04:22.310 "product_name": "Malloc disk", 00:04:22.310 "block_size": 512, 00:04:22.310 "num_blocks": 16384, 00:04:22.310 "uuid": "77de6246-97e0-444f-9072-2292549222da", 00:04:22.310 "assigned_rate_limits": { 00:04:22.310 "rw_ios_per_sec": 0, 00:04:22.310 "rw_mbytes_per_sec": 0, 00:04:22.310 "r_mbytes_per_sec": 0, 00:04:22.310 "w_mbytes_per_sec": 0 00:04:22.310 }, 00:04:22.310 "claimed": true, 00:04:22.310 "claim_type": "exclusive_write", 00:04:22.310 "zoned": false, 00:04:22.310 "supported_io_types": { 00:04:22.310 "read": true, 00:04:22.310 "write": true, 00:04:22.310 "unmap": true, 00:04:22.310 "write_zeroes": true, 00:04:22.310 "flush": true, 00:04:22.310 "reset": true, 00:04:22.310 "compare": false, 00:04:22.310 "compare_and_write": false, 00:04:22.310 "abort": true, 00:04:22.310 "nvme_admin": false, 00:04:22.310 "nvme_io": false 00:04:22.310 }, 00:04:22.310 "memory_domains": [ 00:04:22.310 { 00:04:22.310 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:22.310 "dma_device_type": 2 00:04:22.310 } 00:04:22.310 ], 00:04:22.310 "driver_specific": {} 00:04:22.310 }, 00:04:22.310 { 00:04:22.310 "name": "Passthru0", 00:04:22.310 "aliases": [ 00:04:22.310 "1400c9cd-70f7-56ad-974f-5042fa161e9b" 00:04:22.310 ], 00:04:22.310 "product_name": "passthru", 00:04:22.310 "block_size": 512, 00:04:22.310 "num_blocks": 16384, 00:04:22.310 "uuid": "1400c9cd-70f7-56ad-974f-5042fa161e9b", 00:04:22.310 "assigned_rate_limits": { 00:04:22.310 "rw_ios_per_sec": 0, 00:04:22.310 "rw_mbytes_per_sec": 0, 00:04:22.310 "r_mbytes_per_sec": 0, 00:04:22.310 "w_mbytes_per_sec": 0 00:04:22.310 }, 00:04:22.310 "claimed": false, 00:04:22.310 "zoned": false, 00:04:22.310 "supported_io_types": { 00:04:22.310 "read": true, 00:04:22.310 "write": true, 00:04:22.310 "unmap": true, 00:04:22.310 "write_zeroes": true, 00:04:22.310 "flush": true, 00:04:22.310 "reset": true, 00:04:22.310 "compare": false, 00:04:22.310 "compare_and_write": false, 00:04:22.310 "abort": true, 00:04:22.310 "nvme_admin": false, 00:04:22.311 "nvme_io": false 00:04:22.311 }, 00:04:22.311 "memory_domains": [ 00:04:22.311 { 00:04:22.311 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:22.311 "dma_device_type": 2 00:04:22.311 } 00:04:22.311 ], 00:04:22.311 "driver_specific": { 00:04:22.311 "passthru": { 00:04:22.311 "name": "Passthru0", 00:04:22.311 "base_bdev_name": "Malloc2" 00:04:22.311 } 00:04:22.311 } 00:04:22.311 } 00:04:22.311 ]' 00:04:22.311 22:56:48 -- rpc/rpc.sh@21 -- # jq length 00:04:22.311 22:56:48 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:22.311 22:56:48 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:22.311 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.311 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.311 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.311 22:56:48 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:22.311 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.311 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.311 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.311 22:56:48 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:22.311 22:56:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:22.311 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.311 22:56:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:22.311 22:56:48 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:22.311 22:56:48 -- rpc/rpc.sh@26 -- # jq length 00:04:22.311 22:56:48 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:22.311 00:04:22.311 real 0m0.218s 00:04:22.311 user 0m0.138s 00:04:22.311 sys 0m0.023s 00:04:22.569 22:56:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.569 22:56:48 -- common/autotest_common.sh@10 -- # set +x 00:04:22.569 ************************************ 00:04:22.569 END TEST rpc_daemon_integrity 00:04:22.569 ************************************ 00:04:22.569 22:56:48 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:22.569 22:56:48 -- rpc/rpc.sh@84 -- # killprocess 79827 00:04:22.569 22:56:48 -- common/autotest_common.sh@936 -- # '[' -z 79827 ']' 00:04:22.569 22:56:48 -- common/autotest_common.sh@940 -- # kill -0 79827 00:04:22.569 22:56:48 -- common/autotest_common.sh@941 -- # uname 00:04:22.569 22:56:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:22.569 22:56:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 79827 00:04:22.569 22:56:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:22.569 22:56:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:22.569 22:56:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 79827' 00:04:22.569 killing process with pid 79827 00:04:22.569 22:56:48 -- common/autotest_common.sh@955 -- # kill 79827 00:04:22.569 22:56:48 -- common/autotest_common.sh@960 -- # wait 79827 00:04:22.829 00:04:22.829 real 0m2.399s 00:04:22.829 user 0m3.020s 00:04:22.829 sys 0m0.566s 00:04:22.829 22:56:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.829 22:56:49 -- common/autotest_common.sh@10 -- # set +x 00:04:22.829 ************************************ 00:04:22.829 END TEST rpc 00:04:22.829 ************************************ 00:04:22.829 22:56:49 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:22.829 22:56:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.829 22:56:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.829 22:56:49 -- common/autotest_common.sh@10 -- # set +x 00:04:22.829 ************************************ 00:04:22.829 START TEST rpc_client 00:04:22.829 ************************************ 00:04:22.829 22:56:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:23.087 * Looking for test storage... 00:04:23.087 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:23.087 22:56:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:23.087 22:56:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:23.087 22:56:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:23.087 22:56:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:23.087 22:56:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:23.087 22:56:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:23.087 22:56:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:23.087 22:56:49 -- scripts/common.sh@335 -- # IFS=.-: 00:04:23.087 22:56:49 -- scripts/common.sh@335 -- # read -ra ver1 00:04:23.087 22:56:49 -- scripts/common.sh@336 -- # IFS=.-: 00:04:23.087 22:56:49 -- scripts/common.sh@336 -- # read -ra ver2 00:04:23.087 22:56:49 -- scripts/common.sh@337 -- # local 'op=<' 00:04:23.087 22:56:49 -- scripts/common.sh@339 -- # ver1_l=2 00:04:23.087 22:56:49 -- scripts/common.sh@340 -- # ver2_l=1 00:04:23.087 22:56:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:23.087 22:56:49 -- scripts/common.sh@343 -- # case "$op" in 00:04:23.087 22:56:49 -- scripts/common.sh@344 -- # : 1 00:04:23.087 22:56:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:23.087 22:56:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:23.087 22:56:49 -- scripts/common.sh@364 -- # decimal 1 00:04:23.087 22:56:49 -- scripts/common.sh@352 -- # local d=1 00:04:23.087 22:56:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:23.087 22:56:49 -- scripts/common.sh@354 -- # echo 1 00:04:23.087 22:56:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:23.087 22:56:49 -- scripts/common.sh@365 -- # decimal 2 00:04:23.087 22:56:49 -- scripts/common.sh@352 -- # local d=2 00:04:23.087 22:56:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:23.087 22:56:49 -- scripts/common.sh@354 -- # echo 2 00:04:23.087 22:56:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:23.087 22:56:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:23.087 22:56:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:23.087 22:56:49 -- scripts/common.sh@367 -- # return 0 00:04:23.087 22:56:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:23.087 22:56:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:23.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.087 --rc genhtml_branch_coverage=1 00:04:23.087 --rc genhtml_function_coverage=1 00:04:23.087 --rc genhtml_legend=1 00:04:23.087 --rc geninfo_all_blocks=1 00:04:23.087 --rc geninfo_unexecuted_blocks=1 00:04:23.087 00:04:23.087 ' 00:04:23.087 22:56:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:23.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.087 --rc genhtml_branch_coverage=1 00:04:23.087 --rc genhtml_function_coverage=1 00:04:23.087 --rc genhtml_legend=1 00:04:23.087 --rc geninfo_all_blocks=1 00:04:23.087 --rc geninfo_unexecuted_blocks=1 00:04:23.087 00:04:23.087 ' 00:04:23.087 22:56:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:23.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.087 --rc genhtml_branch_coverage=1 00:04:23.087 --rc genhtml_function_coverage=1 00:04:23.087 --rc genhtml_legend=1 00:04:23.087 --rc geninfo_all_blocks=1 00:04:23.088 --rc geninfo_unexecuted_blocks=1 00:04:23.088 00:04:23.088 ' 00:04:23.088 22:56:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:23.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.088 --rc genhtml_branch_coverage=1 00:04:23.088 --rc genhtml_function_coverage=1 00:04:23.088 --rc genhtml_legend=1 00:04:23.088 --rc geninfo_all_blocks=1 00:04:23.088 --rc geninfo_unexecuted_blocks=1 00:04:23.088 00:04:23.088 ' 00:04:23.088 22:56:49 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:23.088 OK 00:04:23.088 22:56:49 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:23.088 00:04:23.088 real 0m0.155s 00:04:23.088 user 0m0.103s 00:04:23.088 sys 0m0.061s 00:04:23.088 22:56:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:23.088 22:56:49 -- common/autotest_common.sh@10 -- # set +x 00:04:23.088 ************************************ 00:04:23.088 END TEST rpc_client 00:04:23.088 ************************************ 00:04:23.088 22:56:49 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:23.088 22:56:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:23.088 22:56:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.088 22:56:49 -- common/autotest_common.sh@10 -- # set +x 00:04:23.088 ************************************ 00:04:23.088 START TEST json_config 00:04:23.088 ************************************ 00:04:23.088 22:56:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:23.088 22:56:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:23.088 22:56:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:23.088 22:56:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:23.347 22:56:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:23.347 22:56:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:23.347 22:56:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:23.347 22:56:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:23.347 22:56:49 -- scripts/common.sh@335 -- # IFS=.-: 00:04:23.347 22:56:49 -- scripts/common.sh@335 -- # read -ra ver1 00:04:23.347 22:56:49 -- scripts/common.sh@336 -- # IFS=.-: 00:04:23.347 22:56:49 -- scripts/common.sh@336 -- # read -ra ver2 00:04:23.347 22:56:49 -- scripts/common.sh@337 -- # local 'op=<' 00:04:23.347 22:56:49 -- scripts/common.sh@339 -- # ver1_l=2 00:04:23.347 22:56:49 -- scripts/common.sh@340 -- # ver2_l=1 00:04:23.347 22:56:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:23.347 22:56:49 -- scripts/common.sh@343 -- # case "$op" in 00:04:23.347 22:56:49 -- scripts/common.sh@344 -- # : 1 00:04:23.347 22:56:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:23.347 22:56:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:23.347 22:56:49 -- scripts/common.sh@364 -- # decimal 1 00:04:23.347 22:56:49 -- scripts/common.sh@352 -- # local d=1 00:04:23.347 22:56:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:23.347 22:56:49 -- scripts/common.sh@354 -- # echo 1 00:04:23.347 22:56:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:23.347 22:56:49 -- scripts/common.sh@365 -- # decimal 2 00:04:23.347 22:56:49 -- scripts/common.sh@352 -- # local d=2 00:04:23.347 22:56:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:23.347 22:56:49 -- scripts/common.sh@354 -- # echo 2 00:04:23.347 22:56:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:23.347 22:56:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:23.347 22:56:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:23.347 22:56:49 -- scripts/common.sh@367 -- # return 0 00:04:23.347 22:56:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:23.347 22:56:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:23.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.347 --rc genhtml_branch_coverage=1 00:04:23.347 --rc genhtml_function_coverage=1 00:04:23.347 --rc genhtml_legend=1 00:04:23.347 --rc geninfo_all_blocks=1 00:04:23.347 --rc geninfo_unexecuted_blocks=1 00:04:23.347 00:04:23.347 ' 00:04:23.347 22:56:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:23.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.347 --rc genhtml_branch_coverage=1 00:04:23.347 --rc genhtml_function_coverage=1 00:04:23.347 --rc genhtml_legend=1 00:04:23.347 --rc geninfo_all_blocks=1 00:04:23.347 --rc geninfo_unexecuted_blocks=1 00:04:23.347 00:04:23.347 ' 00:04:23.347 22:56:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:23.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.347 --rc genhtml_branch_coverage=1 00:04:23.347 --rc genhtml_function_coverage=1 00:04:23.347 --rc genhtml_legend=1 00:04:23.347 --rc geninfo_all_blocks=1 00:04:23.347 --rc geninfo_unexecuted_blocks=1 00:04:23.347 00:04:23.347 ' 00:04:23.347 22:56:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:23.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.347 --rc genhtml_branch_coverage=1 00:04:23.347 --rc genhtml_function_coverage=1 00:04:23.347 --rc genhtml_legend=1 00:04:23.347 --rc geninfo_all_blocks=1 00:04:23.347 --rc geninfo_unexecuted_blocks=1 00:04:23.347 00:04:23.347 ' 00:04:23.347 22:56:49 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:23.347 22:56:49 -- nvmf/common.sh@7 -- # uname -s 00:04:23.347 22:56:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:23.347 22:56:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:23.347 22:56:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:23.347 22:56:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:23.347 22:56:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:23.347 22:56:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:23.347 22:56:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:23.347 22:56:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:23.347 22:56:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:23.347 22:56:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:23.347 22:56:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:23.347 22:56:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:23.347 22:56:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:23.347 22:56:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:23.347 22:56:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:23.347 22:56:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:23.347 22:56:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:23.347 22:56:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:23.347 22:56:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:23.347 22:56:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:23.347 22:56:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:23.347 22:56:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:23.347 22:56:49 -- paths/export.sh@5 -- # export PATH 00:04:23.347 22:56:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:23.347 22:56:49 -- nvmf/common.sh@46 -- # : 0 00:04:23.347 22:56:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:23.347 22:56:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:23.347 22:56:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:23.347 22:56:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:23.347 22:56:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:23.347 22:56:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:23.347 22:56:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:23.347 22:56:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:23.347 22:56:49 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:23.347 22:56:49 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:23.347 22:56:49 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:23.347 22:56:49 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:23.347 22:56:49 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:23.347 22:56:49 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:23.347 22:56:49 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:23.347 22:56:49 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:23.347 22:56:49 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:23.347 22:56:49 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:23.347 22:56:49 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:23.347 22:56:49 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:23.347 22:56:49 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:23.347 22:56:49 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:23.347 22:56:49 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:23.347 INFO: JSON configuration test init 00:04:23.347 22:56:49 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:23.347 22:56:49 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:23.347 22:56:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:23.347 22:56:49 -- common/autotest_common.sh@10 -- # set +x 00:04:23.347 22:56:49 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:23.347 22:56:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:23.347 22:56:49 -- common/autotest_common.sh@10 -- # set +x 00:04:23.347 22:56:49 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:23.347 22:56:49 -- json_config/json_config.sh@98 -- # local app=target 00:04:23.347 22:56:49 -- json_config/json_config.sh@99 -- # shift 00:04:23.347 22:56:49 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:23.347 22:56:49 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:23.347 22:56:49 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:23.347 22:56:49 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:23.347 22:56:49 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:23.347 22:56:49 -- json_config/json_config.sh@111 -- # app_pid[$app]=80325 00:04:23.347 22:56:49 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:23.347 22:56:49 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:23.347 Waiting for target to run... 00:04:23.347 22:56:49 -- json_config/json_config.sh@114 -- # waitforlisten 80325 /var/tmp/spdk_tgt.sock 00:04:23.347 22:56:49 -- common/autotest_common.sh@829 -- # '[' -z 80325 ']' 00:04:23.347 22:56:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:23.347 22:56:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:23.347 22:56:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:23.347 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:23.347 22:56:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:23.347 22:56:49 -- common/autotest_common.sh@10 -- # set +x 00:04:23.347 [2024-11-26 22:56:49.583836] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:23.347 [2024-11-26 22:56:49.583927] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid80325 ] 00:04:23.347 EAL: No free 2048 kB hugepages reported on node 1 00:04:23.915 [2024-11-26 22:56:50.070901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:23.915 [2024-11-26 22:56:50.168276] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:23.915 [2024-11-26 22:56:50.168437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:24.174 22:56:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:24.174 22:56:50 -- common/autotest_common.sh@862 -- # return 0 00:04:24.174 22:56:50 -- json_config/json_config.sh@115 -- # echo '' 00:04:24.174 00:04:24.174 22:56:50 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:24.174 22:56:50 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:24.174 22:56:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:24.174 22:56:50 -- common/autotest_common.sh@10 -- # set +x 00:04:24.174 22:56:50 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:24.174 22:56:50 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:24.174 22:56:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.174 22:56:50 -- common/autotest_common.sh@10 -- # set +x 00:04:24.174 22:56:50 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:24.174 22:56:50 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:24.174 22:56:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:27.462 22:56:53 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:27.462 22:56:53 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:27.462 22:56:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:27.462 22:56:53 -- common/autotest_common.sh@10 -- # set +x 00:04:27.462 22:56:53 -- json_config/json_config.sh@48 -- # local ret=0 00:04:27.462 22:56:53 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:27.462 22:56:53 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:27.462 22:56:53 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:27.462 22:56:53 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:27.462 22:56:53 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:27.720 22:56:53 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:27.721 22:56:53 -- json_config/json_config.sh@51 -- # local get_types 00:04:27.721 22:56:53 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:27.721 22:56:53 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:27.721 22:56:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:27.721 22:56:53 -- common/autotest_common.sh@10 -- # set +x 00:04:27.721 22:56:53 -- json_config/json_config.sh@58 -- # return 0 00:04:27.721 22:56:53 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:27.721 22:56:53 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:27.721 22:56:53 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:27.721 22:56:53 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:27.721 22:56:53 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:27.721 22:56:53 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:27.721 22:56:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:27.721 22:56:53 -- common/autotest_common.sh@10 -- # set +x 00:04:27.721 22:56:53 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:27.721 22:56:54 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:27.721 22:56:54 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:27.721 22:56:54 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:27.721 22:56:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:27.979 MallocForNvmf0 00:04:27.979 22:56:54 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:27.979 22:56:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:28.238 MallocForNvmf1 00:04:28.238 22:56:54 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:28.238 22:56:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:28.496 [2024-11-26 22:56:54.764335] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:28.496 22:56:54 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:28.496 22:56:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:28.754 22:56:55 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:28.754 22:56:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:29.013 22:56:55 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:29.013 22:56:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:29.272 22:56:55 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:29.272 22:56:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:29.531 [2024-11-26 22:56:55.755696] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:29.531 22:56:55 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:29.531 22:56:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:29.531 22:56:55 -- common/autotest_common.sh@10 -- # set +x 00:04:29.531 22:56:55 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:29.531 22:56:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:29.531 22:56:55 -- common/autotest_common.sh@10 -- # set +x 00:04:29.531 22:56:55 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:29.531 22:56:55 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:29.531 22:56:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:29.789 MallocBdevForConfigChangeCheck 00:04:29.789 22:56:56 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:29.789 22:56:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:29.789 22:56:56 -- common/autotest_common.sh@10 -- # set +x 00:04:29.789 22:56:56 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:29.789 22:56:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:30.357 22:56:56 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:30.357 INFO: shutting down applications... 00:04:30.357 22:56:56 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:30.357 22:56:56 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:30.357 22:56:56 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:30.357 22:56:56 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:31.733 Calling clear_iscsi_subsystem 00:04:31.733 Calling clear_nvmf_subsystem 00:04:31.733 Calling clear_nbd_subsystem 00:04:31.733 Calling clear_ublk_subsystem 00:04:31.733 Calling clear_vhost_blk_subsystem 00:04:31.733 Calling clear_vhost_scsi_subsystem 00:04:31.733 Calling clear_scheduler_subsystem 00:04:31.733 Calling clear_bdev_subsystem 00:04:31.733 Calling clear_accel_subsystem 00:04:31.733 Calling clear_vmd_subsystem 00:04:31.733 Calling clear_sock_subsystem 00:04:31.733 Calling clear_iobuf_subsystem 00:04:31.733 22:56:58 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:31.733 22:56:58 -- json_config/json_config.sh@396 -- # count=100 00:04:31.733 22:56:58 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:31.733 22:56:58 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:31.733 22:56:58 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:31.733 22:56:58 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:32.300 22:56:58 -- json_config/json_config.sh@398 -- # break 00:04:32.300 22:56:58 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:32.300 22:56:58 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:32.300 22:56:58 -- json_config/json_config.sh@120 -- # local app=target 00:04:32.300 22:56:58 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:32.300 22:56:58 -- json_config/json_config.sh@124 -- # [[ -n 80325 ]] 00:04:32.300 22:56:58 -- json_config/json_config.sh@127 -- # kill -SIGINT 80325 00:04:32.300 22:56:58 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:32.300 22:56:58 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:32.300 22:56:58 -- json_config/json_config.sh@130 -- # kill -0 80325 00:04:32.300 22:56:58 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:32.869 22:56:58 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:32.869 22:56:58 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:32.869 22:56:58 -- json_config/json_config.sh@130 -- # kill -0 80325 00:04:32.869 22:56:58 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:32.869 22:56:58 -- json_config/json_config.sh@132 -- # break 00:04:32.869 22:56:58 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:32.869 22:56:58 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:32.869 SPDK target shutdown done 00:04:32.869 22:56:58 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:32.869 INFO: relaunching applications... 00:04:32.869 22:56:58 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:32.869 22:56:58 -- json_config/json_config.sh@98 -- # local app=target 00:04:32.869 22:56:58 -- json_config/json_config.sh@99 -- # shift 00:04:32.869 22:56:58 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:32.869 22:56:58 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:32.869 22:56:58 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:32.869 22:56:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:32.869 22:56:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:32.869 22:56:58 -- json_config/json_config.sh@111 -- # app_pid[$app]=81657 00:04:32.869 22:56:58 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:32.869 22:56:58 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:32.869 Waiting for target to run... 00:04:32.869 22:56:58 -- json_config/json_config.sh@114 -- # waitforlisten 81657 /var/tmp/spdk_tgt.sock 00:04:32.869 22:56:58 -- common/autotest_common.sh@829 -- # '[' -z 81657 ']' 00:04:32.869 22:56:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:32.869 22:56:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.869 22:56:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:32.869 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:32.869 22:56:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.869 22:56:58 -- common/autotest_common.sh@10 -- # set +x 00:04:32.869 [2024-11-26 22:56:59.004535] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:32.869 [2024-11-26 22:56:59.004637] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid81657 ] 00:04:32.869 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.439 [2024-11-26 22:56:59.526771] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.439 [2024-11-26 22:56:59.616887] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:33.439 [2024-11-26 22:56:59.617089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.732 [2024-11-26 22:57:02.638087] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:36.732 [2024-11-26 22:57:02.670545] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:36.732 22:57:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:36.732 22:57:02 -- common/autotest_common.sh@862 -- # return 0 00:04:36.732 22:57:02 -- json_config/json_config.sh@115 -- # echo '' 00:04:36.732 00:04:36.732 22:57:02 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:36.732 22:57:02 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:36.732 INFO: Checking if target configuration is the same... 00:04:36.732 22:57:02 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:36.732 22:57:02 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:36.732 22:57:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:36.732 + '[' 2 -ne 2 ']' 00:04:36.732 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:36.732 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:36.732 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:36.732 +++ basename /dev/fd/62 00:04:36.732 ++ mktemp /tmp/62.XXX 00:04:36.732 + tmp_file_1=/tmp/62.qbR 00:04:36.732 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:36.732 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:36.732 + tmp_file_2=/tmp/spdk_tgt_config.json.fW5 00:04:36.732 + ret=0 00:04:36.732 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:36.990 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:36.990 + diff -u /tmp/62.qbR /tmp/spdk_tgt_config.json.fW5 00:04:36.990 + echo 'INFO: JSON config files are the same' 00:04:36.991 INFO: JSON config files are the same 00:04:36.991 + rm /tmp/62.qbR /tmp/spdk_tgt_config.json.fW5 00:04:36.991 + exit 0 00:04:36.991 22:57:03 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:36.991 22:57:03 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:36.991 INFO: changing configuration and checking if this can be detected... 00:04:36.991 22:57:03 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:36.991 22:57:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:37.249 22:57:03 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:37.249 22:57:03 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:37.249 22:57:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:37.249 + '[' 2 -ne 2 ']' 00:04:37.249 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:37.249 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:37.249 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:37.249 +++ basename /dev/fd/62 00:04:37.249 ++ mktemp /tmp/62.XXX 00:04:37.249 + tmp_file_1=/tmp/62.ZW2 00:04:37.249 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:37.249 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:37.249 + tmp_file_2=/tmp/spdk_tgt_config.json.73T 00:04:37.249 + ret=0 00:04:37.249 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:37.817 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:37.817 + diff -u /tmp/62.ZW2 /tmp/spdk_tgt_config.json.73T 00:04:37.817 + ret=1 00:04:37.817 + echo '=== Start of file: /tmp/62.ZW2 ===' 00:04:37.817 + cat /tmp/62.ZW2 00:04:37.817 + echo '=== End of file: /tmp/62.ZW2 ===' 00:04:37.817 + echo '' 00:04:37.817 + echo '=== Start of file: /tmp/spdk_tgt_config.json.73T ===' 00:04:37.817 + cat /tmp/spdk_tgt_config.json.73T 00:04:37.817 + echo '=== End of file: /tmp/spdk_tgt_config.json.73T ===' 00:04:37.817 + echo '' 00:04:37.817 + rm /tmp/62.ZW2 /tmp/spdk_tgt_config.json.73T 00:04:37.817 + exit 1 00:04:37.817 22:57:04 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:37.817 INFO: configuration change detected. 00:04:37.817 22:57:04 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:37.817 22:57:04 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:37.817 22:57:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:37.817 22:57:04 -- common/autotest_common.sh@10 -- # set +x 00:04:37.817 22:57:04 -- json_config/json_config.sh@360 -- # local ret=0 00:04:37.817 22:57:04 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:37.817 22:57:04 -- json_config/json_config.sh@370 -- # [[ -n 81657 ]] 00:04:37.817 22:57:04 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:37.817 22:57:04 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:37.817 22:57:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:37.817 22:57:04 -- common/autotest_common.sh@10 -- # set +x 00:04:37.817 22:57:04 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:37.817 22:57:04 -- json_config/json_config.sh@246 -- # uname -s 00:04:37.817 22:57:04 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:37.817 22:57:04 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:37.817 22:57:04 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:37.817 22:57:04 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:37.817 22:57:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:37.817 22:57:04 -- common/autotest_common.sh@10 -- # set +x 00:04:37.817 22:57:04 -- json_config/json_config.sh@376 -- # killprocess 81657 00:04:37.817 22:57:04 -- common/autotest_common.sh@936 -- # '[' -z 81657 ']' 00:04:37.817 22:57:04 -- common/autotest_common.sh@940 -- # kill -0 81657 00:04:37.817 22:57:04 -- common/autotest_common.sh@941 -- # uname 00:04:37.817 22:57:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:37.817 22:57:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 81657 00:04:37.817 22:57:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:37.817 22:57:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:37.817 22:57:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 81657' 00:04:37.817 killing process with pid 81657 00:04:37.817 22:57:04 -- common/autotest_common.sh@955 -- # kill 81657 00:04:37.817 22:57:04 -- common/autotest_common.sh@960 -- # wait 81657 00:04:39.718 22:57:05 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:39.718 22:57:05 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:39.718 22:57:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:39.718 22:57:05 -- common/autotest_common.sh@10 -- # set +x 00:04:39.718 22:57:05 -- json_config/json_config.sh@381 -- # return 0 00:04:39.718 22:57:05 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:39.718 INFO: Success 00:04:39.718 00:04:39.718 real 0m16.348s 00:04:39.718 user 0m18.716s 00:04:39.718 sys 0m2.274s 00:04:39.718 22:57:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.718 22:57:05 -- common/autotest_common.sh@10 -- # set +x 00:04:39.718 ************************************ 00:04:39.718 END TEST json_config 00:04:39.718 ************************************ 00:04:39.718 22:57:05 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:39.718 22:57:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.718 22:57:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.718 22:57:05 -- common/autotest_common.sh@10 -- # set +x 00:04:39.718 ************************************ 00:04:39.718 START TEST json_config_extra_key 00:04:39.718 ************************************ 00:04:39.718 22:57:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:39.718 22:57:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:39.718 22:57:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:39.718 22:57:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:39.718 22:57:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:39.718 22:57:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:39.718 22:57:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:39.718 22:57:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:39.718 22:57:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:39.718 22:57:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:39.718 22:57:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:39.718 22:57:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:39.718 22:57:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:39.718 22:57:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:39.718 22:57:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:39.718 22:57:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:39.718 22:57:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:39.718 22:57:05 -- scripts/common.sh@344 -- # : 1 00:04:39.718 22:57:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:39.718 22:57:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:39.718 22:57:05 -- scripts/common.sh@364 -- # decimal 1 00:04:39.718 22:57:05 -- scripts/common.sh@352 -- # local d=1 00:04:39.718 22:57:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:39.718 22:57:05 -- scripts/common.sh@354 -- # echo 1 00:04:39.718 22:57:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:39.718 22:57:05 -- scripts/common.sh@365 -- # decimal 2 00:04:39.718 22:57:05 -- scripts/common.sh@352 -- # local d=2 00:04:39.718 22:57:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:39.718 22:57:05 -- scripts/common.sh@354 -- # echo 2 00:04:39.718 22:57:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:39.718 22:57:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:39.718 22:57:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:39.718 22:57:05 -- scripts/common.sh@367 -- # return 0 00:04:39.718 22:57:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:39.718 22:57:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:39.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.718 --rc genhtml_branch_coverage=1 00:04:39.718 --rc genhtml_function_coverage=1 00:04:39.718 --rc genhtml_legend=1 00:04:39.718 --rc geninfo_all_blocks=1 00:04:39.718 --rc geninfo_unexecuted_blocks=1 00:04:39.718 00:04:39.718 ' 00:04:39.718 22:57:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:39.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.718 --rc genhtml_branch_coverage=1 00:04:39.718 --rc genhtml_function_coverage=1 00:04:39.718 --rc genhtml_legend=1 00:04:39.718 --rc geninfo_all_blocks=1 00:04:39.718 --rc geninfo_unexecuted_blocks=1 00:04:39.718 00:04:39.718 ' 00:04:39.718 22:57:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:39.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.718 --rc genhtml_branch_coverage=1 00:04:39.718 --rc genhtml_function_coverage=1 00:04:39.718 --rc genhtml_legend=1 00:04:39.718 --rc geninfo_all_blocks=1 00:04:39.718 --rc geninfo_unexecuted_blocks=1 00:04:39.718 00:04:39.718 ' 00:04:39.718 22:57:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:39.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.718 --rc genhtml_branch_coverage=1 00:04:39.718 --rc genhtml_function_coverage=1 00:04:39.718 --rc genhtml_legend=1 00:04:39.718 --rc geninfo_all_blocks=1 00:04:39.718 --rc geninfo_unexecuted_blocks=1 00:04:39.718 00:04:39.718 ' 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:39.718 22:57:05 -- nvmf/common.sh@7 -- # uname -s 00:04:39.718 22:57:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:39.718 22:57:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:39.718 22:57:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:39.718 22:57:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:39.718 22:57:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:39.718 22:57:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:39.718 22:57:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:39.718 22:57:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:39.718 22:57:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:39.718 22:57:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:39.718 22:57:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:39.718 22:57:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:39.718 22:57:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:39.718 22:57:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:39.718 22:57:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:39.718 22:57:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:39.718 22:57:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:39.718 22:57:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:39.718 22:57:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:39.718 22:57:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:39.718 22:57:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:39.718 22:57:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:39.718 22:57:05 -- paths/export.sh@5 -- # export PATH 00:04:39.718 22:57:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:39.718 22:57:05 -- nvmf/common.sh@46 -- # : 0 00:04:39.718 22:57:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:39.718 22:57:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:39.718 22:57:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:39.718 22:57:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:39.718 22:57:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:39.718 22:57:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:39.718 22:57:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:39.718 22:57:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:39.718 22:57:05 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:39.718 INFO: launching applications... 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=82731 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:39.719 Waiting for target to run... 00:04:39.719 22:57:05 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 82731 /var/tmp/spdk_tgt.sock 00:04:39.719 22:57:05 -- common/autotest_common.sh@829 -- # '[' -z 82731 ']' 00:04:39.719 22:57:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:39.719 22:57:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.719 22:57:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:39.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:39.719 22:57:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.719 22:57:05 -- common/autotest_common.sh@10 -- # set +x 00:04:39.719 [2024-11-26 22:57:05.974499] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:39.719 [2024-11-26 22:57:05.974599] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid82731 ] 00:04:39.719 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.977 [2024-11-26 22:57:06.325464] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:40.236 [2024-11-26 22:57:06.405065] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:40.236 [2024-11-26 22:57:06.405243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.804 22:57:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.804 22:57:06 -- common/autotest_common.sh@862 -- # return 0 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:40.804 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:40.804 INFO: shutting down applications... 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 82731 ]] 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 82731 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@50 -- # kill -0 82731 00:04:40.804 22:57:06 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:41.064 22:57:07 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:41.064 22:57:07 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:41.064 22:57:07 -- json_config/json_config_extra_key.sh@50 -- # kill -0 82731 00:04:41.064 22:57:07 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:41.064 22:57:07 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:41.064 22:57:07 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:41.064 22:57:07 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:41.064 SPDK target shutdown done 00:04:41.064 22:57:07 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:41.064 Success 00:04:41.064 00:04:41.064 real 0m1.675s 00:04:41.064 user 0m1.659s 00:04:41.064 sys 0m0.462s 00:04:41.064 22:57:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.064 22:57:07 -- common/autotest_common.sh@10 -- # set +x 00:04:41.064 ************************************ 00:04:41.064 END TEST json_config_extra_key 00:04:41.064 ************************************ 00:04:41.324 22:57:07 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:41.324 22:57:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.324 22:57:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.324 22:57:07 -- common/autotest_common.sh@10 -- # set +x 00:04:41.324 ************************************ 00:04:41.324 START TEST alias_rpc 00:04:41.324 ************************************ 00:04:41.324 22:57:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:41.324 * Looking for test storage... 00:04:41.324 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:41.324 22:57:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:41.324 22:57:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:41.324 22:57:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:41.324 22:57:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:41.324 22:57:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:41.324 22:57:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:41.324 22:57:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:41.324 22:57:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:41.324 22:57:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:41.324 22:57:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:41.324 22:57:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:41.324 22:57:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:41.324 22:57:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:41.324 22:57:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:41.324 22:57:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:41.324 22:57:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:41.324 22:57:07 -- scripts/common.sh@344 -- # : 1 00:04:41.324 22:57:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:41.324 22:57:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:41.324 22:57:07 -- scripts/common.sh@364 -- # decimal 1 00:04:41.324 22:57:07 -- scripts/common.sh@352 -- # local d=1 00:04:41.324 22:57:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:41.324 22:57:07 -- scripts/common.sh@354 -- # echo 1 00:04:41.324 22:57:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:41.324 22:57:07 -- scripts/common.sh@365 -- # decimal 2 00:04:41.324 22:57:07 -- scripts/common.sh@352 -- # local d=2 00:04:41.324 22:57:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:41.324 22:57:07 -- scripts/common.sh@354 -- # echo 2 00:04:41.324 22:57:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:41.324 22:57:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:41.324 22:57:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:41.324 22:57:07 -- scripts/common.sh@367 -- # return 0 00:04:41.324 22:57:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:41.324 22:57:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:41.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:41.324 --rc genhtml_branch_coverage=1 00:04:41.324 --rc genhtml_function_coverage=1 00:04:41.324 --rc genhtml_legend=1 00:04:41.324 --rc geninfo_all_blocks=1 00:04:41.324 --rc geninfo_unexecuted_blocks=1 00:04:41.324 00:04:41.324 ' 00:04:41.324 22:57:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:41.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:41.324 --rc genhtml_branch_coverage=1 00:04:41.324 --rc genhtml_function_coverage=1 00:04:41.324 --rc genhtml_legend=1 00:04:41.324 --rc geninfo_all_blocks=1 00:04:41.324 --rc geninfo_unexecuted_blocks=1 00:04:41.324 00:04:41.324 ' 00:04:41.324 22:57:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:41.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:41.324 --rc genhtml_branch_coverage=1 00:04:41.324 --rc genhtml_function_coverage=1 00:04:41.324 --rc genhtml_legend=1 00:04:41.324 --rc geninfo_all_blocks=1 00:04:41.324 --rc geninfo_unexecuted_blocks=1 00:04:41.324 00:04:41.324 ' 00:04:41.324 22:57:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:41.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:41.324 --rc genhtml_branch_coverage=1 00:04:41.324 --rc genhtml_function_coverage=1 00:04:41.324 --rc genhtml_legend=1 00:04:41.324 --rc geninfo_all_blocks=1 00:04:41.324 --rc geninfo_unexecuted_blocks=1 00:04:41.324 00:04:41.324 ' 00:04:41.324 22:57:07 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:41.324 22:57:07 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=83165 00:04:41.324 22:57:07 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:41.324 22:57:07 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 83165 00:04:41.324 22:57:07 -- common/autotest_common.sh@829 -- # '[' -z 83165 ']' 00:04:41.324 22:57:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:41.324 22:57:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:41.324 22:57:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:41.324 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:41.324 22:57:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:41.324 22:57:07 -- common/autotest_common.sh@10 -- # set +x 00:04:41.324 [2024-11-26 22:57:07.670347] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:41.324 [2024-11-26 22:57:07.670437] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83165 ] 00:04:41.324 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.585 [2024-11-26 22:57:07.731660] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:41.585 [2024-11-26 22:57:07.852156] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:41.585 [2024-11-26 22:57:07.852323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.521 22:57:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:42.521 22:57:08 -- common/autotest_common.sh@862 -- # return 0 00:04:42.521 22:57:08 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:42.779 22:57:08 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 83165 00:04:42.779 22:57:08 -- common/autotest_common.sh@936 -- # '[' -z 83165 ']' 00:04:42.779 22:57:08 -- common/autotest_common.sh@940 -- # kill -0 83165 00:04:42.779 22:57:08 -- common/autotest_common.sh@941 -- # uname 00:04:42.779 22:57:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:42.779 22:57:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 83165 00:04:42.779 22:57:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:42.779 22:57:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:42.779 22:57:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 83165' 00:04:42.779 killing process with pid 83165 00:04:42.779 22:57:08 -- common/autotest_common.sh@955 -- # kill 83165 00:04:42.779 22:57:08 -- common/autotest_common.sh@960 -- # wait 83165 00:04:43.043 00:04:43.044 real 0m1.917s 00:04:43.044 user 0m2.242s 00:04:43.044 sys 0m0.482s 00:04:43.044 22:57:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.044 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:04:43.044 ************************************ 00:04:43.044 END TEST alias_rpc 00:04:43.044 ************************************ 00:04:43.044 22:57:09 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:43.044 22:57:09 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:43.044 22:57:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.044 22:57:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.044 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:04:43.044 ************************************ 00:04:43.044 START TEST spdkcli_tcp 00:04:43.044 ************************************ 00:04:43.044 22:57:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:43.309 * Looking for test storage... 00:04:43.309 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:43.309 22:57:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:43.309 22:57:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:43.309 22:57:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:43.309 22:57:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:43.309 22:57:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:43.309 22:57:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:43.309 22:57:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:43.309 22:57:09 -- scripts/common.sh@335 -- # IFS=.-: 00:04:43.309 22:57:09 -- scripts/common.sh@335 -- # read -ra ver1 00:04:43.309 22:57:09 -- scripts/common.sh@336 -- # IFS=.-: 00:04:43.309 22:57:09 -- scripts/common.sh@336 -- # read -ra ver2 00:04:43.309 22:57:09 -- scripts/common.sh@337 -- # local 'op=<' 00:04:43.309 22:57:09 -- scripts/common.sh@339 -- # ver1_l=2 00:04:43.309 22:57:09 -- scripts/common.sh@340 -- # ver2_l=1 00:04:43.309 22:57:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:43.309 22:57:09 -- scripts/common.sh@343 -- # case "$op" in 00:04:43.309 22:57:09 -- scripts/common.sh@344 -- # : 1 00:04:43.309 22:57:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:43.309 22:57:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:43.309 22:57:09 -- scripts/common.sh@364 -- # decimal 1 00:04:43.309 22:57:09 -- scripts/common.sh@352 -- # local d=1 00:04:43.309 22:57:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:43.309 22:57:09 -- scripts/common.sh@354 -- # echo 1 00:04:43.309 22:57:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:43.309 22:57:09 -- scripts/common.sh@365 -- # decimal 2 00:04:43.309 22:57:09 -- scripts/common.sh@352 -- # local d=2 00:04:43.309 22:57:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:43.309 22:57:09 -- scripts/common.sh@354 -- # echo 2 00:04:43.309 22:57:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:43.309 22:57:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:43.309 22:57:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:43.309 22:57:09 -- scripts/common.sh@367 -- # return 0 00:04:43.309 22:57:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:43.309 22:57:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:43.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.309 --rc genhtml_branch_coverage=1 00:04:43.309 --rc genhtml_function_coverage=1 00:04:43.309 --rc genhtml_legend=1 00:04:43.309 --rc geninfo_all_blocks=1 00:04:43.309 --rc geninfo_unexecuted_blocks=1 00:04:43.309 00:04:43.309 ' 00:04:43.309 22:57:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:43.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.309 --rc genhtml_branch_coverage=1 00:04:43.309 --rc genhtml_function_coverage=1 00:04:43.309 --rc genhtml_legend=1 00:04:43.309 --rc geninfo_all_blocks=1 00:04:43.309 --rc geninfo_unexecuted_blocks=1 00:04:43.309 00:04:43.309 ' 00:04:43.309 22:57:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:43.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.309 --rc genhtml_branch_coverage=1 00:04:43.309 --rc genhtml_function_coverage=1 00:04:43.309 --rc genhtml_legend=1 00:04:43.309 --rc geninfo_all_blocks=1 00:04:43.309 --rc geninfo_unexecuted_blocks=1 00:04:43.309 00:04:43.309 ' 00:04:43.309 22:57:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:43.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.309 --rc genhtml_branch_coverage=1 00:04:43.309 --rc genhtml_function_coverage=1 00:04:43.309 --rc genhtml_legend=1 00:04:43.309 --rc geninfo_all_blocks=1 00:04:43.309 --rc geninfo_unexecuted_blocks=1 00:04:43.309 00:04:43.309 ' 00:04:43.309 22:57:09 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:43.309 22:57:09 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:43.310 22:57:09 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:43.310 22:57:09 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:43.310 22:57:09 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:43.310 22:57:09 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:43.310 22:57:09 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:43.310 22:57:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:43.310 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:04:43.310 22:57:09 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=83766 00:04:43.310 22:57:09 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:43.310 22:57:09 -- spdkcli/tcp.sh@27 -- # waitforlisten 83766 00:04:43.310 22:57:09 -- common/autotest_common.sh@829 -- # '[' -z 83766 ']' 00:04:43.310 22:57:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:43.310 22:57:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:43.310 22:57:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:43.310 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:43.310 22:57:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:43.310 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:04:43.310 [2024-11-26 22:57:09.619282] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.310 [2024-11-26 22:57:09.619378] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83766 ] 00:04:43.310 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.310 [2024-11-26 22:57:09.676889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:43.569 [2024-11-26 22:57:09.787619] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:43.569 [2024-11-26 22:57:09.787820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:43.569 [2024-11-26 22:57:09.787825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.506 22:57:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:44.506 22:57:10 -- common/autotest_common.sh@862 -- # return 0 00:04:44.506 22:57:10 -- spdkcli/tcp.sh@31 -- # socat_pid=83907 00:04:44.506 22:57:10 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:44.506 22:57:10 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:44.506 [ 00:04:44.506 "bdev_malloc_delete", 00:04:44.506 "bdev_malloc_create", 00:04:44.506 "bdev_null_resize", 00:04:44.506 "bdev_null_delete", 00:04:44.506 "bdev_null_create", 00:04:44.506 "bdev_nvme_cuse_unregister", 00:04:44.506 "bdev_nvme_cuse_register", 00:04:44.506 "bdev_opal_new_user", 00:04:44.506 "bdev_opal_set_lock_state", 00:04:44.506 "bdev_opal_delete", 00:04:44.506 "bdev_opal_get_info", 00:04:44.506 "bdev_opal_create", 00:04:44.506 "bdev_nvme_opal_revert", 00:04:44.506 "bdev_nvme_opal_init", 00:04:44.506 "bdev_nvme_send_cmd", 00:04:44.506 "bdev_nvme_get_path_iostat", 00:04:44.506 "bdev_nvme_get_mdns_discovery_info", 00:04:44.506 "bdev_nvme_stop_mdns_discovery", 00:04:44.506 "bdev_nvme_start_mdns_discovery", 00:04:44.506 "bdev_nvme_set_multipath_policy", 00:04:44.506 "bdev_nvme_set_preferred_path", 00:04:44.506 "bdev_nvme_get_io_paths", 00:04:44.506 "bdev_nvme_remove_error_injection", 00:04:44.506 "bdev_nvme_add_error_injection", 00:04:44.506 "bdev_nvme_get_discovery_info", 00:04:44.506 "bdev_nvme_stop_discovery", 00:04:44.506 "bdev_nvme_start_discovery", 00:04:44.506 "bdev_nvme_get_controller_health_info", 00:04:44.506 "bdev_nvme_disable_controller", 00:04:44.506 "bdev_nvme_enable_controller", 00:04:44.506 "bdev_nvme_reset_controller", 00:04:44.506 "bdev_nvme_get_transport_statistics", 00:04:44.506 "bdev_nvme_apply_firmware", 00:04:44.506 "bdev_nvme_detach_controller", 00:04:44.506 "bdev_nvme_get_controllers", 00:04:44.506 "bdev_nvme_attach_controller", 00:04:44.506 "bdev_nvme_set_hotplug", 00:04:44.506 "bdev_nvme_set_options", 00:04:44.506 "bdev_passthru_delete", 00:04:44.506 "bdev_passthru_create", 00:04:44.506 "bdev_lvol_grow_lvstore", 00:04:44.506 "bdev_lvol_get_lvols", 00:04:44.506 "bdev_lvol_get_lvstores", 00:04:44.506 "bdev_lvol_delete", 00:04:44.506 "bdev_lvol_set_read_only", 00:04:44.506 "bdev_lvol_resize", 00:04:44.506 "bdev_lvol_decouple_parent", 00:04:44.506 "bdev_lvol_inflate", 00:04:44.506 "bdev_lvol_rename", 00:04:44.506 "bdev_lvol_clone_bdev", 00:04:44.506 "bdev_lvol_clone", 00:04:44.506 "bdev_lvol_snapshot", 00:04:44.506 "bdev_lvol_create", 00:04:44.506 "bdev_lvol_delete_lvstore", 00:04:44.506 "bdev_lvol_rename_lvstore", 00:04:44.506 "bdev_lvol_create_lvstore", 00:04:44.506 "bdev_raid_set_options", 00:04:44.506 "bdev_raid_remove_base_bdev", 00:04:44.506 "bdev_raid_add_base_bdev", 00:04:44.506 "bdev_raid_delete", 00:04:44.506 "bdev_raid_create", 00:04:44.506 "bdev_raid_get_bdevs", 00:04:44.506 "bdev_error_inject_error", 00:04:44.506 "bdev_error_delete", 00:04:44.506 "bdev_error_create", 00:04:44.506 "bdev_split_delete", 00:04:44.506 "bdev_split_create", 00:04:44.506 "bdev_delay_delete", 00:04:44.506 "bdev_delay_create", 00:04:44.506 "bdev_delay_update_latency", 00:04:44.506 "bdev_zone_block_delete", 00:04:44.506 "bdev_zone_block_create", 00:04:44.506 "blobfs_create", 00:04:44.506 "blobfs_detect", 00:04:44.506 "blobfs_set_cache_size", 00:04:44.506 "bdev_aio_delete", 00:04:44.506 "bdev_aio_rescan", 00:04:44.506 "bdev_aio_create", 00:04:44.506 "bdev_ftl_set_property", 00:04:44.506 "bdev_ftl_get_properties", 00:04:44.506 "bdev_ftl_get_stats", 00:04:44.506 "bdev_ftl_unmap", 00:04:44.506 "bdev_ftl_unload", 00:04:44.506 "bdev_ftl_delete", 00:04:44.506 "bdev_ftl_load", 00:04:44.506 "bdev_ftl_create", 00:04:44.506 "bdev_virtio_attach_controller", 00:04:44.506 "bdev_virtio_scsi_get_devices", 00:04:44.506 "bdev_virtio_detach_controller", 00:04:44.506 "bdev_virtio_blk_set_hotplug", 00:04:44.506 "bdev_iscsi_delete", 00:04:44.506 "bdev_iscsi_create", 00:04:44.506 "bdev_iscsi_set_options", 00:04:44.506 "accel_error_inject_error", 00:04:44.506 "ioat_scan_accel_module", 00:04:44.506 "dsa_scan_accel_module", 00:04:44.506 "iaa_scan_accel_module", 00:04:44.506 "iscsi_set_options", 00:04:44.506 "iscsi_get_auth_groups", 00:04:44.506 "iscsi_auth_group_remove_secret", 00:04:44.506 "iscsi_auth_group_add_secret", 00:04:44.506 "iscsi_delete_auth_group", 00:04:44.506 "iscsi_create_auth_group", 00:04:44.506 "iscsi_set_discovery_auth", 00:04:44.506 "iscsi_get_options", 00:04:44.506 "iscsi_target_node_request_logout", 00:04:44.506 "iscsi_target_node_set_redirect", 00:04:44.506 "iscsi_target_node_set_auth", 00:04:44.506 "iscsi_target_node_add_lun", 00:04:44.506 "iscsi_get_connections", 00:04:44.506 "iscsi_portal_group_set_auth", 00:04:44.506 "iscsi_start_portal_group", 00:04:44.506 "iscsi_delete_portal_group", 00:04:44.506 "iscsi_create_portal_group", 00:04:44.506 "iscsi_get_portal_groups", 00:04:44.506 "iscsi_delete_target_node", 00:04:44.506 "iscsi_target_node_remove_pg_ig_maps", 00:04:44.506 "iscsi_target_node_add_pg_ig_maps", 00:04:44.507 "iscsi_create_target_node", 00:04:44.507 "iscsi_get_target_nodes", 00:04:44.507 "iscsi_delete_initiator_group", 00:04:44.507 "iscsi_initiator_group_remove_initiators", 00:04:44.507 "iscsi_initiator_group_add_initiators", 00:04:44.507 "iscsi_create_initiator_group", 00:04:44.507 "iscsi_get_initiator_groups", 00:04:44.507 "nvmf_set_crdt", 00:04:44.507 "nvmf_set_config", 00:04:44.507 "nvmf_set_max_subsystems", 00:04:44.507 "nvmf_subsystem_get_listeners", 00:04:44.507 "nvmf_subsystem_get_qpairs", 00:04:44.507 "nvmf_subsystem_get_controllers", 00:04:44.507 "nvmf_get_stats", 00:04:44.507 "nvmf_get_transports", 00:04:44.507 "nvmf_create_transport", 00:04:44.507 "nvmf_get_targets", 00:04:44.507 "nvmf_delete_target", 00:04:44.507 "nvmf_create_target", 00:04:44.507 "nvmf_subsystem_allow_any_host", 00:04:44.507 "nvmf_subsystem_remove_host", 00:04:44.507 "nvmf_subsystem_add_host", 00:04:44.507 "nvmf_subsystem_remove_ns", 00:04:44.507 "nvmf_subsystem_add_ns", 00:04:44.507 "nvmf_subsystem_listener_set_ana_state", 00:04:44.507 "nvmf_discovery_get_referrals", 00:04:44.507 "nvmf_discovery_remove_referral", 00:04:44.507 "nvmf_discovery_add_referral", 00:04:44.507 "nvmf_subsystem_remove_listener", 00:04:44.507 "nvmf_subsystem_add_listener", 00:04:44.507 "nvmf_delete_subsystem", 00:04:44.507 "nvmf_create_subsystem", 00:04:44.507 "nvmf_get_subsystems", 00:04:44.507 "env_dpdk_get_mem_stats", 00:04:44.507 "nbd_get_disks", 00:04:44.507 "nbd_stop_disk", 00:04:44.507 "nbd_start_disk", 00:04:44.507 "ublk_recover_disk", 00:04:44.507 "ublk_get_disks", 00:04:44.507 "ublk_stop_disk", 00:04:44.507 "ublk_start_disk", 00:04:44.507 "ublk_destroy_target", 00:04:44.507 "ublk_create_target", 00:04:44.507 "virtio_blk_create_transport", 00:04:44.507 "virtio_blk_get_transports", 00:04:44.507 "vhost_controller_set_coalescing", 00:04:44.507 "vhost_get_controllers", 00:04:44.507 "vhost_delete_controller", 00:04:44.507 "vhost_create_blk_controller", 00:04:44.507 "vhost_scsi_controller_remove_target", 00:04:44.507 "vhost_scsi_controller_add_target", 00:04:44.507 "vhost_start_scsi_controller", 00:04:44.507 "vhost_create_scsi_controller", 00:04:44.507 "thread_set_cpumask", 00:04:44.507 "framework_get_scheduler", 00:04:44.507 "framework_set_scheduler", 00:04:44.507 "framework_get_reactors", 00:04:44.507 "thread_get_io_channels", 00:04:44.507 "thread_get_pollers", 00:04:44.507 "thread_get_stats", 00:04:44.507 "framework_monitor_context_switch", 00:04:44.507 "spdk_kill_instance", 00:04:44.507 "log_enable_timestamps", 00:04:44.507 "log_get_flags", 00:04:44.507 "log_clear_flag", 00:04:44.507 "log_set_flag", 00:04:44.507 "log_get_level", 00:04:44.507 "log_set_level", 00:04:44.507 "log_get_print_level", 00:04:44.507 "log_set_print_level", 00:04:44.507 "framework_enable_cpumask_locks", 00:04:44.507 "framework_disable_cpumask_locks", 00:04:44.507 "framework_wait_init", 00:04:44.507 "framework_start_init", 00:04:44.507 "scsi_get_devices", 00:04:44.507 "bdev_get_histogram", 00:04:44.507 "bdev_enable_histogram", 00:04:44.507 "bdev_set_qos_limit", 00:04:44.507 "bdev_set_qd_sampling_period", 00:04:44.507 "bdev_get_bdevs", 00:04:44.507 "bdev_reset_iostat", 00:04:44.507 "bdev_get_iostat", 00:04:44.507 "bdev_examine", 00:04:44.507 "bdev_wait_for_examine", 00:04:44.507 "bdev_set_options", 00:04:44.507 "notify_get_notifications", 00:04:44.507 "notify_get_types", 00:04:44.507 "accel_get_stats", 00:04:44.507 "accel_set_options", 00:04:44.507 "accel_set_driver", 00:04:44.507 "accel_crypto_key_destroy", 00:04:44.507 "accel_crypto_keys_get", 00:04:44.507 "accel_crypto_key_create", 00:04:44.507 "accel_assign_opc", 00:04:44.507 "accel_get_module_info", 00:04:44.507 "accel_get_opc_assignments", 00:04:44.507 "vmd_rescan", 00:04:44.507 "vmd_remove_device", 00:04:44.507 "vmd_enable", 00:04:44.507 "sock_set_default_impl", 00:04:44.507 "sock_impl_set_options", 00:04:44.507 "sock_impl_get_options", 00:04:44.507 "iobuf_get_stats", 00:04:44.507 "iobuf_set_options", 00:04:44.507 "framework_get_pci_devices", 00:04:44.507 "framework_get_config", 00:04:44.507 "framework_get_subsystems", 00:04:44.507 "trace_get_info", 00:04:44.507 "trace_get_tpoint_group_mask", 00:04:44.507 "trace_disable_tpoint_group", 00:04:44.507 "trace_enable_tpoint_group", 00:04:44.507 "trace_clear_tpoint_mask", 00:04:44.507 "trace_set_tpoint_mask", 00:04:44.507 "spdk_get_version", 00:04:44.507 "rpc_get_methods" 00:04:44.507 ] 00:04:44.507 22:57:10 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:44.507 22:57:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:44.507 22:57:10 -- common/autotest_common.sh@10 -- # set +x 00:04:44.507 22:57:10 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:44.507 22:57:10 -- spdkcli/tcp.sh@38 -- # killprocess 83766 00:04:44.507 22:57:10 -- common/autotest_common.sh@936 -- # '[' -z 83766 ']' 00:04:44.507 22:57:10 -- common/autotest_common.sh@940 -- # kill -0 83766 00:04:44.507 22:57:10 -- common/autotest_common.sh@941 -- # uname 00:04:44.507 22:57:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:44.507 22:57:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 83766 00:04:44.766 22:57:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:44.766 22:57:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:44.766 22:57:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 83766' 00:04:44.766 killing process with pid 83766 00:04:44.766 22:57:10 -- common/autotest_common.sh@955 -- # kill 83766 00:04:44.766 22:57:10 -- common/autotest_common.sh@960 -- # wait 83766 00:04:45.025 00:04:45.025 real 0m1.895s 00:04:45.025 user 0m3.603s 00:04:45.025 sys 0m0.518s 00:04:45.025 22:57:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.025 22:57:11 -- common/autotest_common.sh@10 -- # set +x 00:04:45.025 ************************************ 00:04:45.025 END TEST spdkcli_tcp 00:04:45.025 ************************************ 00:04:45.025 22:57:11 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:45.025 22:57:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.025 22:57:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.025 22:57:11 -- common/autotest_common.sh@10 -- # set +x 00:04:45.025 ************************************ 00:04:45.025 START TEST dpdk_mem_utility 00:04:45.025 ************************************ 00:04:45.025 22:57:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:45.025 * Looking for test storage... 00:04:45.025 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:45.025 22:57:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:45.025 22:57:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:45.025 22:57:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:45.284 22:57:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:45.284 22:57:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:45.284 22:57:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:45.284 22:57:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:45.284 22:57:11 -- scripts/common.sh@335 -- # IFS=.-: 00:04:45.284 22:57:11 -- scripts/common.sh@335 -- # read -ra ver1 00:04:45.284 22:57:11 -- scripts/common.sh@336 -- # IFS=.-: 00:04:45.284 22:57:11 -- scripts/common.sh@336 -- # read -ra ver2 00:04:45.284 22:57:11 -- scripts/common.sh@337 -- # local 'op=<' 00:04:45.284 22:57:11 -- scripts/common.sh@339 -- # ver1_l=2 00:04:45.284 22:57:11 -- scripts/common.sh@340 -- # ver2_l=1 00:04:45.284 22:57:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:45.284 22:57:11 -- scripts/common.sh@343 -- # case "$op" in 00:04:45.284 22:57:11 -- scripts/common.sh@344 -- # : 1 00:04:45.284 22:57:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:45.284 22:57:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:45.284 22:57:11 -- scripts/common.sh@364 -- # decimal 1 00:04:45.284 22:57:11 -- scripts/common.sh@352 -- # local d=1 00:04:45.284 22:57:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:45.284 22:57:11 -- scripts/common.sh@354 -- # echo 1 00:04:45.284 22:57:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:45.284 22:57:11 -- scripts/common.sh@365 -- # decimal 2 00:04:45.284 22:57:11 -- scripts/common.sh@352 -- # local d=2 00:04:45.284 22:57:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:45.284 22:57:11 -- scripts/common.sh@354 -- # echo 2 00:04:45.284 22:57:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:45.284 22:57:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:45.284 22:57:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:45.284 22:57:11 -- scripts/common.sh@367 -- # return 0 00:04:45.284 22:57:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:45.284 22:57:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:45.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.284 --rc genhtml_branch_coverage=1 00:04:45.284 --rc genhtml_function_coverage=1 00:04:45.284 --rc genhtml_legend=1 00:04:45.284 --rc geninfo_all_blocks=1 00:04:45.284 --rc geninfo_unexecuted_blocks=1 00:04:45.284 00:04:45.284 ' 00:04:45.284 22:57:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:45.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.284 --rc genhtml_branch_coverage=1 00:04:45.284 --rc genhtml_function_coverage=1 00:04:45.284 --rc genhtml_legend=1 00:04:45.284 --rc geninfo_all_blocks=1 00:04:45.284 --rc geninfo_unexecuted_blocks=1 00:04:45.284 00:04:45.284 ' 00:04:45.284 22:57:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:45.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.284 --rc genhtml_branch_coverage=1 00:04:45.284 --rc genhtml_function_coverage=1 00:04:45.284 --rc genhtml_legend=1 00:04:45.284 --rc geninfo_all_blocks=1 00:04:45.284 --rc geninfo_unexecuted_blocks=1 00:04:45.284 00:04:45.284 ' 00:04:45.284 22:57:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:45.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.284 --rc genhtml_branch_coverage=1 00:04:45.284 --rc genhtml_function_coverage=1 00:04:45.284 --rc genhtml_legend=1 00:04:45.284 --rc geninfo_all_blocks=1 00:04:45.284 --rc geninfo_unexecuted_blocks=1 00:04:45.284 00:04:45.284 ' 00:04:45.284 22:57:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:45.284 22:57:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=84114 00:04:45.284 22:57:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:45.284 22:57:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 84114 00:04:45.284 22:57:11 -- common/autotest_common.sh@829 -- # '[' -z 84114 ']' 00:04:45.284 22:57:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:45.284 22:57:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:45.284 22:57:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:45.284 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:45.284 22:57:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:45.284 22:57:11 -- common/autotest_common.sh@10 -- # set +x 00:04:45.284 [2024-11-26 22:57:11.533501] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.284 [2024-11-26 22:57:11.533601] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84114 ] 00:04:45.284 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.284 [2024-11-26 22:57:11.589095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.543 [2024-11-26 22:57:11.692591] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:45.543 [2024-11-26 22:57:11.692765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.110 22:57:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:46.110 22:57:12 -- common/autotest_common.sh@862 -- # return 0 00:04:46.110 22:57:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:46.110 22:57:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:46.110 22:57:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.110 22:57:12 -- common/autotest_common.sh@10 -- # set +x 00:04:46.110 { 00:04:46.110 "filename": "/tmp/spdk_mem_dump.txt" 00:04:46.110 } 00:04:46.110 22:57:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:46.110 22:57:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:46.369 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:46.369 1 heaps totaling size 814.000000 MiB 00:04:46.369 size: 814.000000 MiB heap id: 0 00:04:46.369 end heaps---------- 00:04:46.369 8 mempools totaling size 598.116089 MiB 00:04:46.369 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:46.369 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:46.369 size: 84.521057 MiB name: bdev_io_84114 00:04:46.369 size: 51.011292 MiB name: evtpool_84114 00:04:46.369 size: 50.003479 MiB name: msgpool_84114 00:04:46.369 size: 21.763794 MiB name: PDU_Pool 00:04:46.369 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:46.369 size: 0.026123 MiB name: Session_Pool 00:04:46.369 end mempools------- 00:04:46.369 6 memzones totaling size 4.142822 MiB 00:04:46.369 size: 1.000366 MiB name: RG_ring_0_84114 00:04:46.369 size: 1.000366 MiB name: RG_ring_1_84114 00:04:46.369 size: 1.000366 MiB name: RG_ring_4_84114 00:04:46.369 size: 1.000366 MiB name: RG_ring_5_84114 00:04:46.369 size: 0.125366 MiB name: RG_ring_2_84114 00:04:46.369 size: 0.015991 MiB name: RG_ring_3_84114 00:04:46.369 end memzones------- 00:04:46.369 22:57:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:46.369 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:46.369 list of free elements. size: 12.519348 MiB 00:04:46.369 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:46.369 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:46.369 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:46.369 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:46.369 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:46.369 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:46.369 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:46.369 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:46.369 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:46.369 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:46.369 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:46.369 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:46.369 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:46.369 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:46.369 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:46.369 list of standard malloc elements. size: 199.218079 MiB 00:04:46.369 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:46.369 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:46.369 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:46.369 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:46.369 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:46.369 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:46.369 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:46.369 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:46.369 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:46.369 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:46.369 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:46.369 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:46.369 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:46.369 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:46.369 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:46.369 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:46.369 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:46.369 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:46.369 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:46.369 list of memzone associated elements. size: 602.262573 MiB 00:04:46.369 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:46.369 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:46.369 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:46.369 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:46.369 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:46.369 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_84114_0 00:04:46.369 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:46.369 associated memzone info: size: 48.002930 MiB name: MP_evtpool_84114_0 00:04:46.369 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:46.369 associated memzone info: size: 48.002930 MiB name: MP_msgpool_84114_0 00:04:46.369 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:46.369 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:46.369 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:46.369 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:46.369 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:46.369 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_84114 00:04:46.369 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:46.369 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_84114 00:04:46.369 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:46.369 associated memzone info: size: 1.007996 MiB name: MP_evtpool_84114 00:04:46.369 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:46.369 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:46.369 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:46.369 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:46.369 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:46.369 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:46.369 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:46.369 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:46.369 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:46.369 associated memzone info: size: 1.000366 MiB name: RG_ring_0_84114 00:04:46.369 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:46.369 associated memzone info: size: 1.000366 MiB name: RG_ring_1_84114 00:04:46.369 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:46.369 associated memzone info: size: 1.000366 MiB name: RG_ring_4_84114 00:04:46.369 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:46.369 associated memzone info: size: 1.000366 MiB name: RG_ring_5_84114 00:04:46.369 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:46.369 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_84114 00:04:46.369 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:46.369 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:46.369 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:46.369 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:46.369 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:46.369 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:46.369 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:46.369 associated memzone info: size: 0.125366 MiB name: RG_ring_2_84114 00:04:46.369 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:46.369 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:46.369 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:46.369 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:46.369 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:46.369 associated memzone info: size: 0.015991 MiB name: RG_ring_3_84114 00:04:46.369 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:46.369 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:46.370 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:46.370 associated memzone info: size: 0.000183 MiB name: MP_msgpool_84114 00:04:46.370 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:46.370 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_84114 00:04:46.370 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:46.370 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:46.370 22:57:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:46.370 22:57:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 84114 00:04:46.370 22:57:12 -- common/autotest_common.sh@936 -- # '[' -z 84114 ']' 00:04:46.370 22:57:12 -- common/autotest_common.sh@940 -- # kill -0 84114 00:04:46.370 22:57:12 -- common/autotest_common.sh@941 -- # uname 00:04:46.370 22:57:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:46.370 22:57:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 84114 00:04:46.370 22:57:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:46.370 22:57:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:46.370 22:57:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 84114' 00:04:46.370 killing process with pid 84114 00:04:46.370 22:57:12 -- common/autotest_common.sh@955 -- # kill 84114 00:04:46.370 22:57:12 -- common/autotest_common.sh@960 -- # wait 84114 00:04:46.938 00:04:46.938 real 0m1.741s 00:04:46.938 user 0m1.934s 00:04:46.938 sys 0m0.437s 00:04:46.939 22:57:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.939 22:57:13 -- common/autotest_common.sh@10 -- # set +x 00:04:46.939 ************************************ 00:04:46.939 END TEST dpdk_mem_utility 00:04:46.939 ************************************ 00:04:46.939 22:57:13 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:46.939 22:57:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.939 22:57:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.939 22:57:13 -- common/autotest_common.sh@10 -- # set +x 00:04:46.939 ************************************ 00:04:46.939 START TEST event 00:04:46.939 ************************************ 00:04:46.939 22:57:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:46.939 * Looking for test storage... 00:04:46.939 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:46.939 22:57:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:46.939 22:57:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:46.939 22:57:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:46.939 22:57:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:46.939 22:57:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:46.939 22:57:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:46.939 22:57:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:46.939 22:57:13 -- scripts/common.sh@335 -- # IFS=.-: 00:04:46.939 22:57:13 -- scripts/common.sh@335 -- # read -ra ver1 00:04:46.939 22:57:13 -- scripts/common.sh@336 -- # IFS=.-: 00:04:46.939 22:57:13 -- scripts/common.sh@336 -- # read -ra ver2 00:04:46.939 22:57:13 -- scripts/common.sh@337 -- # local 'op=<' 00:04:46.939 22:57:13 -- scripts/common.sh@339 -- # ver1_l=2 00:04:46.939 22:57:13 -- scripts/common.sh@340 -- # ver2_l=1 00:04:46.939 22:57:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:46.939 22:57:13 -- scripts/common.sh@343 -- # case "$op" in 00:04:46.939 22:57:13 -- scripts/common.sh@344 -- # : 1 00:04:46.939 22:57:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:46.939 22:57:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:46.939 22:57:13 -- scripts/common.sh@364 -- # decimal 1 00:04:46.939 22:57:13 -- scripts/common.sh@352 -- # local d=1 00:04:46.939 22:57:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:46.939 22:57:13 -- scripts/common.sh@354 -- # echo 1 00:04:46.939 22:57:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:46.939 22:57:13 -- scripts/common.sh@365 -- # decimal 2 00:04:46.939 22:57:13 -- scripts/common.sh@352 -- # local d=2 00:04:46.939 22:57:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:46.939 22:57:13 -- scripts/common.sh@354 -- # echo 2 00:04:46.939 22:57:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:46.939 22:57:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:46.939 22:57:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:46.939 22:57:13 -- scripts/common.sh@367 -- # return 0 00:04:46.939 22:57:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:46.939 22:57:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:46.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.939 --rc genhtml_branch_coverage=1 00:04:46.939 --rc genhtml_function_coverage=1 00:04:46.939 --rc genhtml_legend=1 00:04:46.939 --rc geninfo_all_blocks=1 00:04:46.939 --rc geninfo_unexecuted_blocks=1 00:04:46.939 00:04:46.939 ' 00:04:46.939 22:57:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:46.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.939 --rc genhtml_branch_coverage=1 00:04:46.939 --rc genhtml_function_coverage=1 00:04:46.939 --rc genhtml_legend=1 00:04:46.939 --rc geninfo_all_blocks=1 00:04:46.939 --rc geninfo_unexecuted_blocks=1 00:04:46.939 00:04:46.939 ' 00:04:46.939 22:57:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:46.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.939 --rc genhtml_branch_coverage=1 00:04:46.939 --rc genhtml_function_coverage=1 00:04:46.939 --rc genhtml_legend=1 00:04:46.939 --rc geninfo_all_blocks=1 00:04:46.939 --rc geninfo_unexecuted_blocks=1 00:04:46.939 00:04:46.939 ' 00:04:46.939 22:57:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:46.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.939 --rc genhtml_branch_coverage=1 00:04:46.939 --rc genhtml_function_coverage=1 00:04:46.939 --rc genhtml_legend=1 00:04:46.939 --rc geninfo_all_blocks=1 00:04:46.939 --rc geninfo_unexecuted_blocks=1 00:04:46.939 00:04:46.939 ' 00:04:46.939 22:57:13 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:46.939 22:57:13 -- bdev/nbd_common.sh@6 -- # set -e 00:04:46.939 22:57:13 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:46.939 22:57:13 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:46.939 22:57:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.939 22:57:13 -- common/autotest_common.sh@10 -- # set +x 00:04:46.939 ************************************ 00:04:46.939 START TEST event_perf 00:04:46.939 ************************************ 00:04:46.939 22:57:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:46.939 Running I/O for 1 seconds...[2024-11-26 22:57:13.285427] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.939 [2024-11-26 22:57:13.285507] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84314 ] 00:04:46.939 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.199 [2024-11-26 22:57:13.343804] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:47.199 [2024-11-26 22:57:13.464434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:47.199 [2024-11-26 22:57:13.464499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:47.199 [2024-11-26 22:57:13.464559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:47.199 [2024-11-26 22:57:13.464563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.576 Running I/O for 1 seconds... 00:04:48.576 lcore 0: 230412 00:04:48.576 lcore 1: 230411 00:04:48.576 lcore 2: 230411 00:04:48.576 lcore 3: 230411 00:04:48.576 done. 00:04:48.576 00:04:48.576 real 0m1.309s 00:04:48.576 user 0m4.221s 00:04:48.576 sys 0m0.084s 00:04:48.577 22:57:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.577 22:57:14 -- common/autotest_common.sh@10 -- # set +x 00:04:48.577 ************************************ 00:04:48.577 END TEST event_perf 00:04:48.577 ************************************ 00:04:48.577 22:57:14 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:48.577 22:57:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:48.577 22:57:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.577 22:57:14 -- common/autotest_common.sh@10 -- # set +x 00:04:48.577 ************************************ 00:04:48.577 START TEST event_reactor 00:04:48.577 ************************************ 00:04:48.577 22:57:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:48.577 [2024-11-26 22:57:14.620098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:48.577 [2024-11-26 22:57:14.620185] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84608 ] 00:04:48.577 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.577 [2024-11-26 22:57:14.678144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:48.577 [2024-11-26 22:57:14.779451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.515 test_start 00:04:49.515 oneshot 00:04:49.515 tick 100 00:04:49.515 tick 100 00:04:49.515 tick 250 00:04:49.515 tick 100 00:04:49.515 tick 100 00:04:49.515 tick 100 00:04:49.515 tick 250 00:04:49.515 tick 500 00:04:49.515 tick 100 00:04:49.515 tick 100 00:04:49.515 tick 250 00:04:49.515 tick 100 00:04:49.515 tick 100 00:04:49.515 test_end 00:04:49.515 00:04:49.515 real 0m1.284s 00:04:49.515 user 0m1.208s 00:04:49.515 sys 0m0.072s 00:04:49.515 22:57:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.515 22:57:15 -- common/autotest_common.sh@10 -- # set +x 00:04:49.515 ************************************ 00:04:49.515 END TEST event_reactor 00:04:49.515 ************************************ 00:04:49.774 22:57:15 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:49.774 22:57:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:49.774 22:57:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.774 22:57:15 -- common/autotest_common.sh@10 -- # set +x 00:04:49.774 ************************************ 00:04:49.774 START TEST event_reactor_perf 00:04:49.774 ************************************ 00:04:49.774 22:57:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:49.774 [2024-11-26 22:57:15.934068] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:49.774 [2024-11-26 22:57:15.934157] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84762 ] 00:04:49.774 EAL: No free 2048 kB hugepages reported on node 1 00:04:49.774 [2024-11-26 22:57:15.992641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:49.774 [2024-11-26 22:57:16.091449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.151 test_start 00:04:51.151 test_end 00:04:51.151 Performance: 438333 events per second 00:04:51.151 00:04:51.151 real 0m1.284s 00:04:51.151 user 0m1.207s 00:04:51.151 sys 0m0.071s 00:04:51.151 22:57:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.151 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.151 ************************************ 00:04:51.151 END TEST event_reactor_perf 00:04:51.151 ************************************ 00:04:51.151 22:57:17 -- event/event.sh@49 -- # uname -s 00:04:51.151 22:57:17 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:51.151 22:57:17 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:51.151 22:57:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.151 22:57:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.151 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.151 ************************************ 00:04:51.151 START TEST event_scheduler 00:04:51.151 ************************************ 00:04:51.151 22:57:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:51.151 * Looking for test storage... 00:04:51.151 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:51.151 22:57:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:51.151 22:57:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:51.151 22:57:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:51.151 22:57:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:51.151 22:57:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:51.151 22:57:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:51.151 22:57:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:51.151 22:57:17 -- scripts/common.sh@335 -- # IFS=.-: 00:04:51.151 22:57:17 -- scripts/common.sh@335 -- # read -ra ver1 00:04:51.151 22:57:17 -- scripts/common.sh@336 -- # IFS=.-: 00:04:51.151 22:57:17 -- scripts/common.sh@336 -- # read -ra ver2 00:04:51.151 22:57:17 -- scripts/common.sh@337 -- # local 'op=<' 00:04:51.151 22:57:17 -- scripts/common.sh@339 -- # ver1_l=2 00:04:51.151 22:57:17 -- scripts/common.sh@340 -- # ver2_l=1 00:04:51.151 22:57:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:51.151 22:57:17 -- scripts/common.sh@343 -- # case "$op" in 00:04:51.151 22:57:17 -- scripts/common.sh@344 -- # : 1 00:04:51.151 22:57:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:51.151 22:57:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:51.151 22:57:17 -- scripts/common.sh@364 -- # decimal 1 00:04:51.151 22:57:17 -- scripts/common.sh@352 -- # local d=1 00:04:51.151 22:57:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:51.151 22:57:17 -- scripts/common.sh@354 -- # echo 1 00:04:51.151 22:57:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:51.151 22:57:17 -- scripts/common.sh@365 -- # decimal 2 00:04:51.151 22:57:17 -- scripts/common.sh@352 -- # local d=2 00:04:51.151 22:57:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:51.151 22:57:17 -- scripts/common.sh@354 -- # echo 2 00:04:51.151 22:57:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:51.151 22:57:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:51.151 22:57:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:51.151 22:57:17 -- scripts/common.sh@367 -- # return 0 00:04:51.151 22:57:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:51.151 22:57:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:51.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.151 --rc genhtml_branch_coverage=1 00:04:51.151 --rc genhtml_function_coverage=1 00:04:51.151 --rc genhtml_legend=1 00:04:51.151 --rc geninfo_all_blocks=1 00:04:51.151 --rc geninfo_unexecuted_blocks=1 00:04:51.151 00:04:51.151 ' 00:04:51.152 22:57:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:51.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.152 --rc genhtml_branch_coverage=1 00:04:51.152 --rc genhtml_function_coverage=1 00:04:51.152 --rc genhtml_legend=1 00:04:51.152 --rc geninfo_all_blocks=1 00:04:51.152 --rc geninfo_unexecuted_blocks=1 00:04:51.152 00:04:51.152 ' 00:04:51.152 22:57:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:51.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.152 --rc genhtml_branch_coverage=1 00:04:51.152 --rc genhtml_function_coverage=1 00:04:51.152 --rc genhtml_legend=1 00:04:51.152 --rc geninfo_all_blocks=1 00:04:51.152 --rc geninfo_unexecuted_blocks=1 00:04:51.152 00:04:51.152 ' 00:04:51.152 22:57:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:51.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.152 --rc genhtml_branch_coverage=1 00:04:51.152 --rc genhtml_function_coverage=1 00:04:51.152 --rc genhtml_legend=1 00:04:51.152 --rc geninfo_all_blocks=1 00:04:51.152 --rc geninfo_unexecuted_blocks=1 00:04:51.152 00:04:51.152 ' 00:04:51.152 22:57:17 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:51.152 22:57:17 -- scheduler/scheduler.sh@35 -- # scheduler_pid=84951 00:04:51.152 22:57:17 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:51.152 22:57:17 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:51.152 22:57:17 -- scheduler/scheduler.sh@37 -- # waitforlisten 84951 00:04:51.152 22:57:17 -- common/autotest_common.sh@829 -- # '[' -z 84951 ']' 00:04:51.152 22:57:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:51.152 22:57:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.152 22:57:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:51.152 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:51.152 22:57:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.152 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.152 [2024-11-26 22:57:17.419640] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.152 [2024-11-26 22:57:17.419733] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84951 ] 00:04:51.152 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.152 [2024-11-26 22:57:17.477207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:51.412 [2024-11-26 22:57:17.590920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.412 [2024-11-26 22:57:17.590977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:51.412 [2024-11-26 22:57:17.591046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:51.412 [2024-11-26 22:57:17.591049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:51.412 22:57:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:51.412 22:57:17 -- common/autotest_common.sh@862 -- # return 0 00:04:51.412 22:57:17 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:51.412 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.412 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.412 POWER: Env isn't set yet! 00:04:51.412 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:51.412 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:51.412 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:51.412 POWER: Cannot get available frequencies of lcore 0 00:04:51.412 POWER: Attempting to initialise PSTAT power management... 00:04:51.412 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:51.412 POWER: Initialized successfully for lcore 0 power management 00:04:51.412 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:51.412 POWER: Initialized successfully for lcore 1 power management 00:04:51.412 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:51.412 POWER: Initialized successfully for lcore 2 power management 00:04:51.412 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:51.412 POWER: Initialized successfully for lcore 3 power management 00:04:51.412 [2024-11-26 22:57:17.682799] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:51.412 [2024-11-26 22:57:17.682820] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:51.412 [2024-11-26 22:57:17.682832] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:51.412 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.412 22:57:17 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:51.412 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.412 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.412 [2024-11-26 22:57:17.787096] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:51.412 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.412 22:57:17 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:51.412 22:57:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.412 22:57:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.412 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.412 ************************************ 00:04:51.412 START TEST scheduler_create_thread 00:04:51.412 ************************************ 00:04:51.412 22:57:17 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:51.412 22:57:17 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:51.412 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.412 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 2 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 3 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 4 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 5 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 6 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 7 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 8 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 9 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 10 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:51.671 22:57:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.671 22:57:17 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:51.671 22:57:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:51.671 22:57:17 -- common/autotest_common.sh@10 -- # set +x 00:04:53.047 22:57:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:53.047 22:57:19 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:53.047 22:57:19 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:53.047 22:57:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:53.047 22:57:19 -- common/autotest_common.sh@10 -- # set +x 00:04:54.422 22:57:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.422 00:04:54.422 real 0m2.621s 00:04:54.422 user 0m0.013s 00:04:54.422 sys 0m0.002s 00:04:54.422 22:57:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.422 22:57:20 -- common/autotest_common.sh@10 -- # set +x 00:04:54.422 ************************************ 00:04:54.422 END TEST scheduler_create_thread 00:04:54.422 ************************************ 00:04:54.422 22:57:20 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:54.422 22:57:20 -- scheduler/scheduler.sh@46 -- # killprocess 84951 00:04:54.422 22:57:20 -- common/autotest_common.sh@936 -- # '[' -z 84951 ']' 00:04:54.422 22:57:20 -- common/autotest_common.sh@940 -- # kill -0 84951 00:04:54.422 22:57:20 -- common/autotest_common.sh@941 -- # uname 00:04:54.422 22:57:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:54.422 22:57:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 84951 00:04:54.422 22:57:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:54.422 22:57:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:54.422 22:57:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 84951' 00:04:54.422 killing process with pid 84951 00:04:54.422 22:57:20 -- common/autotest_common.sh@955 -- # kill 84951 00:04:54.422 22:57:20 -- common/autotest_common.sh@960 -- # wait 84951 00:04:54.681 [2024-11-26 22:57:20.894541] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:54.681 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:54.681 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:54.681 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:54.681 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:54.681 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:54.681 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:54.681 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:54.681 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:54.940 00:04:54.940 real 0m3.936s 00:04:54.940 user 0m5.893s 00:04:54.940 sys 0m0.347s 00:04:54.940 22:57:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.940 22:57:21 -- common/autotest_common.sh@10 -- # set +x 00:04:54.940 ************************************ 00:04:54.940 END TEST event_scheduler 00:04:54.940 ************************************ 00:04:54.940 22:57:21 -- event/event.sh@51 -- # modprobe -n nbd 00:04:54.940 22:57:21 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:54.940 22:57:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:54.940 22:57:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.940 22:57:21 -- common/autotest_common.sh@10 -- # set +x 00:04:54.940 ************************************ 00:04:54.940 START TEST app_repeat 00:04:54.940 ************************************ 00:04:54.940 22:57:21 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:54.940 22:57:21 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.940 22:57:21 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.940 22:57:21 -- event/event.sh@13 -- # local nbd_list 00:04:54.940 22:57:21 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:54.940 22:57:21 -- event/event.sh@14 -- # local bdev_list 00:04:54.940 22:57:21 -- event/event.sh@15 -- # local repeat_times=4 00:04:54.940 22:57:21 -- event/event.sh@17 -- # modprobe nbd 00:04:54.940 22:57:21 -- event/event.sh@19 -- # repeat_pid=85433 00:04:54.940 22:57:21 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:54.940 22:57:21 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:54.940 22:57:21 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 85433' 00:04:54.940 Process app_repeat pid: 85433 00:04:54.940 22:57:21 -- event/event.sh@23 -- # for i in {0..2} 00:04:54.940 22:57:21 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:54.940 spdk_app_start Round 0 00:04:54.940 22:57:21 -- event/event.sh@25 -- # waitforlisten 85433 /var/tmp/spdk-nbd.sock 00:04:54.940 22:57:21 -- common/autotest_common.sh@829 -- # '[' -z 85433 ']' 00:04:54.940 22:57:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:54.940 22:57:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:54.940 22:57:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:54.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:54.940 22:57:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:54.940 22:57:21 -- common/autotest_common.sh@10 -- # set +x 00:04:54.940 [2024-11-26 22:57:21.227709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:54.940 [2024-11-26 22:57:21.227789] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85433 ] 00:04:54.940 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.940 [2024-11-26 22:57:21.288933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:55.200 [2024-11-26 22:57:21.405488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:55.200 [2024-11-26 22:57:21.405494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.136 22:57:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:56.136 22:57:22 -- common/autotest_common.sh@862 -- # return 0 00:04:56.136 22:57:22 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:56.136 Malloc0 00:04:56.136 22:57:22 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:56.395 Malloc1 00:04:56.395 22:57:22 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@12 -- # local i 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.395 22:57:22 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:56.655 /dev/nbd0 00:04:56.655 22:57:23 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:56.655 22:57:23 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:56.655 22:57:23 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:56.655 22:57:23 -- common/autotest_common.sh@867 -- # local i 00:04:56.655 22:57:23 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:56.655 22:57:23 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:56.655 22:57:23 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:56.655 22:57:23 -- common/autotest_common.sh@871 -- # break 00:04:56.655 22:57:23 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:56.655 22:57:23 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:56.655 22:57:23 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:56.655 1+0 records in 00:04:56.655 1+0 records out 00:04:56.655 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000145956 s, 28.1 MB/s 00:04:56.655 22:57:23 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:56.914 22:57:23 -- common/autotest_common.sh@884 -- # size=4096 00:04:56.914 22:57:23 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:56.914 22:57:23 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:56.914 22:57:23 -- common/autotest_common.sh@887 -- # return 0 00:04:56.914 22:57:23 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:56.914 22:57:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.914 22:57:23 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:56.914 /dev/nbd1 00:04:57.173 22:57:23 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:57.173 22:57:23 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:57.173 22:57:23 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:57.173 22:57:23 -- common/autotest_common.sh@867 -- # local i 00:04:57.173 22:57:23 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:57.173 22:57:23 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:57.173 22:57:23 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:57.173 22:57:23 -- common/autotest_common.sh@871 -- # break 00:04:57.173 22:57:23 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:57.173 22:57:23 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:57.173 22:57:23 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:57.173 1+0 records in 00:04:57.173 1+0 records out 00:04:57.173 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000191136 s, 21.4 MB/s 00:04:57.173 22:57:23 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.173 22:57:23 -- common/autotest_common.sh@884 -- # size=4096 00:04:57.173 22:57:23 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.173 22:57:23 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:57.173 22:57:23 -- common/autotest_common.sh@887 -- # return 0 00:04:57.173 22:57:23 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:57.173 22:57:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.173 22:57:23 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:57.173 22:57:23 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.173 22:57:23 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:57.432 { 00:04:57.432 "nbd_device": "/dev/nbd0", 00:04:57.432 "bdev_name": "Malloc0" 00:04:57.432 }, 00:04:57.432 { 00:04:57.432 "nbd_device": "/dev/nbd1", 00:04:57.432 "bdev_name": "Malloc1" 00:04:57.432 } 00:04:57.432 ]' 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:57.432 { 00:04:57.432 "nbd_device": "/dev/nbd0", 00:04:57.432 "bdev_name": "Malloc0" 00:04:57.432 }, 00:04:57.432 { 00:04:57.432 "nbd_device": "/dev/nbd1", 00:04:57.432 "bdev_name": "Malloc1" 00:04:57.432 } 00:04:57.432 ]' 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:57.432 /dev/nbd1' 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:57.432 /dev/nbd1' 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@65 -- # count=2 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@95 -- # count=2 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:57.432 22:57:23 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:57.433 256+0 records in 00:04:57.433 256+0 records out 00:04:57.433 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0046197 s, 227 MB/s 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:57.433 256+0 records in 00:04:57.433 256+0 records out 00:04:57.433 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255726 s, 41.0 MB/s 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:57.433 256+0 records in 00:04:57.433 256+0 records out 00:04:57.433 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256887 s, 40.8 MB/s 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@51 -- # local i 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.433 22:57:23 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@41 -- # break 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@45 -- # return 0 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.691 22:57:23 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@41 -- # break 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@45 -- # return 0 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.949 22:57:24 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@65 -- # true 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@65 -- # count=0 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@104 -- # count=0 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:58.207 22:57:24 -- bdev/nbd_common.sh@109 -- # return 0 00:04:58.207 22:57:24 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:58.466 22:57:24 -- event/event.sh@35 -- # sleep 3 00:04:59.035 [2024-11-26 22:57:25.131098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:59.035 [2024-11-26 22:57:25.245392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:59.035 [2024-11-26 22:57:25.245391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.035 [2024-11-26 22:57:25.307082] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:59.035 [2024-11-26 22:57:25.307172] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:01.566 22:57:27 -- event/event.sh@23 -- # for i in {0..2} 00:05:01.566 22:57:27 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:01.566 spdk_app_start Round 1 00:05:01.566 22:57:27 -- event/event.sh@25 -- # waitforlisten 85433 /var/tmp/spdk-nbd.sock 00:05:01.566 22:57:27 -- common/autotest_common.sh@829 -- # '[' -z 85433 ']' 00:05:01.566 22:57:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:01.566 22:57:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:01.566 22:57:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:01.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:01.566 22:57:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:01.566 22:57:27 -- common/autotest_common.sh@10 -- # set +x 00:05:01.824 22:57:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:01.824 22:57:28 -- common/autotest_common.sh@862 -- # return 0 00:05:01.824 22:57:28 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:02.083 Malloc0 00:05:02.083 22:57:28 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:02.343 Malloc1 00:05:02.343 22:57:28 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@12 -- # local i 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.343 22:57:28 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:02.601 /dev/nbd0 00:05:02.601 22:57:28 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:02.601 22:57:28 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:02.601 22:57:28 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:02.601 22:57:28 -- common/autotest_common.sh@867 -- # local i 00:05:02.601 22:57:28 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:02.602 22:57:28 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:02.602 22:57:28 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:02.602 22:57:28 -- common/autotest_common.sh@871 -- # break 00:05:02.602 22:57:28 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:02.602 22:57:28 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:02.602 22:57:28 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:02.602 1+0 records in 00:05:02.602 1+0 records out 00:05:02.602 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209129 s, 19.6 MB/s 00:05:02.602 22:57:28 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.602 22:57:28 -- common/autotest_common.sh@884 -- # size=4096 00:05:02.602 22:57:28 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.602 22:57:28 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:02.602 22:57:28 -- common/autotest_common.sh@887 -- # return 0 00:05:02.602 22:57:28 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:02.602 22:57:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.602 22:57:28 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:02.861 /dev/nbd1 00:05:02.861 22:57:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:02.861 22:57:29 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:02.861 22:57:29 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:02.861 22:57:29 -- common/autotest_common.sh@867 -- # local i 00:05:02.861 22:57:29 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:02.861 22:57:29 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:02.861 22:57:29 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:02.861 22:57:29 -- common/autotest_common.sh@871 -- # break 00:05:02.861 22:57:29 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:02.861 22:57:29 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:02.861 22:57:29 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:02.861 1+0 records in 00:05:02.861 1+0 records out 00:05:02.861 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000171057 s, 23.9 MB/s 00:05:02.861 22:57:29 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.861 22:57:29 -- common/autotest_common.sh@884 -- # size=4096 00:05:02.861 22:57:29 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.861 22:57:29 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:02.861 22:57:29 -- common/autotest_common.sh@887 -- # return 0 00:05:02.861 22:57:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:02.861 22:57:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.861 22:57:29 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:02.861 22:57:29 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.861 22:57:29 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:03.119 22:57:29 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:03.119 { 00:05:03.119 "nbd_device": "/dev/nbd0", 00:05:03.119 "bdev_name": "Malloc0" 00:05:03.119 }, 00:05:03.119 { 00:05:03.119 "nbd_device": "/dev/nbd1", 00:05:03.119 "bdev_name": "Malloc1" 00:05:03.119 } 00:05:03.119 ]' 00:05:03.119 22:57:29 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:03.119 { 00:05:03.119 "nbd_device": "/dev/nbd0", 00:05:03.119 "bdev_name": "Malloc0" 00:05:03.119 }, 00:05:03.119 { 00:05:03.119 "nbd_device": "/dev/nbd1", 00:05:03.119 "bdev_name": "Malloc1" 00:05:03.119 } 00:05:03.119 ]' 00:05:03.119 22:57:29 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:03.378 /dev/nbd1' 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:03.378 /dev/nbd1' 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@65 -- # count=2 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@95 -- # count=2 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:03.378 256+0 records in 00:05:03.378 256+0 records out 00:05:03.378 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00507755 s, 207 MB/s 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:03.378 256+0 records in 00:05:03.378 256+0 records out 00:05:03.378 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193607 s, 54.2 MB/s 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:03.378 256+0 records in 00:05:03.378 256+0 records out 00:05:03.378 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270207 s, 38.8 MB/s 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@51 -- # local i 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:03.378 22:57:29 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@41 -- # break 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@45 -- # return 0 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:03.637 22:57:29 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:03.896 22:57:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:03.896 22:57:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@41 -- # break 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@45 -- # return 0 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.897 22:57:30 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@65 -- # true 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@65 -- # count=0 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@104 -- # count=0 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:04.155 22:57:30 -- bdev/nbd_common.sh@109 -- # return 0 00:05:04.155 22:57:30 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:04.414 22:57:30 -- event/event.sh@35 -- # sleep 3 00:05:04.673 [2024-11-26 22:57:31.039062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:04.932 [2024-11-26 22:57:31.155929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:04.932 [2024-11-26 22:57:31.155934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.932 [2024-11-26 22:57:31.217955] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:04.932 [2024-11-26 22:57:31.218034] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:07.465 22:57:33 -- event/event.sh@23 -- # for i in {0..2} 00:05:07.465 22:57:33 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:07.465 spdk_app_start Round 2 00:05:07.465 22:57:33 -- event/event.sh@25 -- # waitforlisten 85433 /var/tmp/spdk-nbd.sock 00:05:07.465 22:57:33 -- common/autotest_common.sh@829 -- # '[' -z 85433 ']' 00:05:07.465 22:57:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:07.465 22:57:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:07.465 22:57:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:07.465 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:07.465 22:57:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:07.465 22:57:33 -- common/autotest_common.sh@10 -- # set +x 00:05:07.724 22:57:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:07.724 22:57:34 -- common/autotest_common.sh@862 -- # return 0 00:05:07.724 22:57:34 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:07.983 Malloc0 00:05:07.983 22:57:34 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:08.243 Malloc1 00:05:08.243 22:57:34 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@12 -- # local i 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.243 22:57:34 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:08.502 /dev/nbd0 00:05:08.502 22:57:34 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:08.502 22:57:34 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:08.502 22:57:34 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:08.502 22:57:34 -- common/autotest_common.sh@867 -- # local i 00:05:08.502 22:57:34 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:08.502 22:57:34 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:08.502 22:57:34 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:08.502 22:57:34 -- common/autotest_common.sh@871 -- # break 00:05:08.502 22:57:34 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:08.502 22:57:34 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:08.502 22:57:34 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:08.502 1+0 records in 00:05:08.502 1+0 records out 00:05:08.502 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000185291 s, 22.1 MB/s 00:05:08.502 22:57:34 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.502 22:57:34 -- common/autotest_common.sh@884 -- # size=4096 00:05:08.502 22:57:34 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.502 22:57:34 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:08.502 22:57:34 -- common/autotest_common.sh@887 -- # return 0 00:05:08.502 22:57:34 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:08.502 22:57:34 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.502 22:57:34 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:08.760 /dev/nbd1 00:05:08.760 22:57:35 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:08.760 22:57:35 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:08.760 22:57:35 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:08.760 22:57:35 -- common/autotest_common.sh@867 -- # local i 00:05:08.760 22:57:35 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:08.760 22:57:35 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:08.760 22:57:35 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:08.760 22:57:35 -- common/autotest_common.sh@871 -- # break 00:05:08.760 22:57:35 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:08.760 22:57:35 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:08.760 22:57:35 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:08.760 1+0 records in 00:05:08.760 1+0 records out 00:05:08.760 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0001647 s, 24.9 MB/s 00:05:08.760 22:57:35 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.760 22:57:35 -- common/autotest_common.sh@884 -- # size=4096 00:05:08.760 22:57:35 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.760 22:57:35 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:08.760 22:57:35 -- common/autotest_common.sh@887 -- # return 0 00:05:08.760 22:57:35 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:08.760 22:57:35 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.760 22:57:35 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:08.760 22:57:35 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.760 22:57:35 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:09.018 22:57:35 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:09.018 { 00:05:09.018 "nbd_device": "/dev/nbd0", 00:05:09.018 "bdev_name": "Malloc0" 00:05:09.018 }, 00:05:09.018 { 00:05:09.018 "nbd_device": "/dev/nbd1", 00:05:09.018 "bdev_name": "Malloc1" 00:05:09.018 } 00:05:09.018 ]' 00:05:09.018 22:57:35 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:09.018 { 00:05:09.018 "nbd_device": "/dev/nbd0", 00:05:09.018 "bdev_name": "Malloc0" 00:05:09.018 }, 00:05:09.018 { 00:05:09.018 "nbd_device": "/dev/nbd1", 00:05:09.018 "bdev_name": "Malloc1" 00:05:09.018 } 00:05:09.018 ]' 00:05:09.018 22:57:35 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:09.018 22:57:35 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:09.018 /dev/nbd1' 00:05:09.018 22:57:35 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:09.018 /dev/nbd1' 00:05:09.018 22:57:35 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@65 -- # count=2 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@95 -- # count=2 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:09.019 22:57:35 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:09.277 256+0 records in 00:05:09.277 256+0 records out 00:05:09.277 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00468267 s, 224 MB/s 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:09.277 256+0 records in 00:05:09.277 256+0 records out 00:05:09.277 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255997 s, 41.0 MB/s 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:09.277 256+0 records in 00:05:09.277 256+0 records out 00:05:09.277 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225445 s, 46.5 MB/s 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@51 -- # local i 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:09.277 22:57:35 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@41 -- # break 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@45 -- # return 0 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:09.536 22:57:35 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@41 -- # break 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@45 -- # return 0 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.795 22:57:36 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@65 -- # true 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@65 -- # count=0 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@104 -- # count=0 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:10.054 22:57:36 -- bdev/nbd_common.sh@109 -- # return 0 00:05:10.054 22:57:36 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:10.313 22:57:36 -- event/event.sh@35 -- # sleep 3 00:05:10.572 [2024-11-26 22:57:36.891402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:10.831 [2024-11-26 22:57:37.007613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:10.831 [2024-11-26 22:57:37.007618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.831 [2024-11-26 22:57:37.068101] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:10.831 [2024-11-26 22:57:37.068168] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:13.392 22:57:39 -- event/event.sh@38 -- # waitforlisten 85433 /var/tmp/spdk-nbd.sock 00:05:13.392 22:57:39 -- common/autotest_common.sh@829 -- # '[' -z 85433 ']' 00:05:13.392 22:57:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:13.392 22:57:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:13.392 22:57:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:13.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:13.392 22:57:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:13.392 22:57:39 -- common/autotest_common.sh@10 -- # set +x 00:05:13.650 22:57:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.650 22:57:39 -- common/autotest_common.sh@862 -- # return 0 00:05:13.650 22:57:39 -- event/event.sh@39 -- # killprocess 85433 00:05:13.650 22:57:39 -- common/autotest_common.sh@936 -- # '[' -z 85433 ']' 00:05:13.650 22:57:39 -- common/autotest_common.sh@940 -- # kill -0 85433 00:05:13.650 22:57:39 -- common/autotest_common.sh@941 -- # uname 00:05:13.650 22:57:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:13.650 22:57:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 85433 00:05:13.650 22:57:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:13.650 22:57:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:13.650 22:57:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 85433' 00:05:13.650 killing process with pid 85433 00:05:13.650 22:57:39 -- common/autotest_common.sh@955 -- # kill 85433 00:05:13.650 22:57:39 -- common/autotest_common.sh@960 -- # wait 85433 00:05:13.909 spdk_app_start is called in Round 0. 00:05:13.909 Shutdown signal received, stop current app iteration 00:05:13.909 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:13.909 spdk_app_start is called in Round 1. 00:05:13.909 Shutdown signal received, stop current app iteration 00:05:13.909 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:13.909 spdk_app_start is called in Round 2. 00:05:13.909 Shutdown signal received, stop current app iteration 00:05:13.909 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:13.909 spdk_app_start is called in Round 3. 00:05:13.909 Shutdown signal received, stop current app iteration 00:05:13.909 22:57:40 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:13.909 22:57:40 -- event/event.sh@42 -- # return 0 00:05:13.909 00:05:13.909 real 0m18.964s 00:05:13.909 user 0m41.295s 00:05:13.909 sys 0m3.202s 00:05:13.909 22:57:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.909 22:57:40 -- common/autotest_common.sh@10 -- # set +x 00:05:13.909 ************************************ 00:05:13.909 END TEST app_repeat 00:05:13.909 ************************************ 00:05:13.909 22:57:40 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:13.909 22:57:40 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:13.909 22:57:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.909 22:57:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.909 22:57:40 -- common/autotest_common.sh@10 -- # set +x 00:05:13.909 ************************************ 00:05:13.909 START TEST cpu_locks 00:05:13.909 ************************************ 00:05:13.909 22:57:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:13.909 * Looking for test storage... 00:05:13.909 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:13.909 22:57:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:13.909 22:57:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:13.909 22:57:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:14.167 22:57:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:14.167 22:57:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:14.167 22:57:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:14.167 22:57:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:14.167 22:57:40 -- scripts/common.sh@335 -- # IFS=.-: 00:05:14.167 22:57:40 -- scripts/common.sh@335 -- # read -ra ver1 00:05:14.167 22:57:40 -- scripts/common.sh@336 -- # IFS=.-: 00:05:14.167 22:57:40 -- scripts/common.sh@336 -- # read -ra ver2 00:05:14.167 22:57:40 -- scripts/common.sh@337 -- # local 'op=<' 00:05:14.167 22:57:40 -- scripts/common.sh@339 -- # ver1_l=2 00:05:14.167 22:57:40 -- scripts/common.sh@340 -- # ver2_l=1 00:05:14.167 22:57:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:14.167 22:57:40 -- scripts/common.sh@343 -- # case "$op" in 00:05:14.167 22:57:40 -- scripts/common.sh@344 -- # : 1 00:05:14.167 22:57:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:14.167 22:57:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:14.167 22:57:40 -- scripts/common.sh@364 -- # decimal 1 00:05:14.167 22:57:40 -- scripts/common.sh@352 -- # local d=1 00:05:14.167 22:57:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:14.167 22:57:40 -- scripts/common.sh@354 -- # echo 1 00:05:14.167 22:57:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:14.167 22:57:40 -- scripts/common.sh@365 -- # decimal 2 00:05:14.167 22:57:40 -- scripts/common.sh@352 -- # local d=2 00:05:14.167 22:57:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:14.167 22:57:40 -- scripts/common.sh@354 -- # echo 2 00:05:14.167 22:57:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:14.167 22:57:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:14.167 22:57:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:14.167 22:57:40 -- scripts/common.sh@367 -- # return 0 00:05:14.167 22:57:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:14.167 22:57:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:14.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.167 --rc genhtml_branch_coverage=1 00:05:14.167 --rc genhtml_function_coverage=1 00:05:14.167 --rc genhtml_legend=1 00:05:14.167 --rc geninfo_all_blocks=1 00:05:14.167 --rc geninfo_unexecuted_blocks=1 00:05:14.167 00:05:14.167 ' 00:05:14.167 22:57:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:14.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.167 --rc genhtml_branch_coverage=1 00:05:14.167 --rc genhtml_function_coverage=1 00:05:14.167 --rc genhtml_legend=1 00:05:14.167 --rc geninfo_all_blocks=1 00:05:14.167 --rc geninfo_unexecuted_blocks=1 00:05:14.167 00:05:14.167 ' 00:05:14.167 22:57:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:14.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.167 --rc genhtml_branch_coverage=1 00:05:14.167 --rc genhtml_function_coverage=1 00:05:14.167 --rc genhtml_legend=1 00:05:14.167 --rc geninfo_all_blocks=1 00:05:14.167 --rc geninfo_unexecuted_blocks=1 00:05:14.167 00:05:14.167 ' 00:05:14.167 22:57:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:14.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.167 --rc genhtml_branch_coverage=1 00:05:14.167 --rc genhtml_function_coverage=1 00:05:14.167 --rc genhtml_legend=1 00:05:14.167 --rc geninfo_all_blocks=1 00:05:14.167 --rc geninfo_unexecuted_blocks=1 00:05:14.167 00:05:14.167 ' 00:05:14.167 22:57:40 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:14.167 22:57:40 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:14.167 22:57:40 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:14.167 22:57:40 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:14.167 22:57:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.167 22:57:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.167 22:57:40 -- common/autotest_common.sh@10 -- # set +x 00:05:14.167 ************************************ 00:05:14.167 START TEST default_locks 00:05:14.167 ************************************ 00:05:14.167 22:57:40 -- common/autotest_common.sh@1114 -- # default_locks 00:05:14.167 22:57:40 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=88065 00:05:14.167 22:57:40 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:14.167 22:57:40 -- event/cpu_locks.sh@47 -- # waitforlisten 88065 00:05:14.167 22:57:40 -- common/autotest_common.sh@829 -- # '[' -z 88065 ']' 00:05:14.167 22:57:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.167 22:57:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.167 22:57:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.167 22:57:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.167 22:57:40 -- common/autotest_common.sh@10 -- # set +x 00:05:14.167 [2024-11-26 22:57:40.395276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.167 [2024-11-26 22:57:40.395379] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88065 ] 00:05:14.167 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.167 [2024-11-26 22:57:40.460095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.425 [2024-11-26 22:57:40.573974] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.425 [2024-11-26 22:57:40.574143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.991 22:57:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:14.991 22:57:41 -- common/autotest_common.sh@862 -- # return 0 00:05:14.991 22:57:41 -- event/cpu_locks.sh@49 -- # locks_exist 88065 00:05:14.991 22:57:41 -- event/cpu_locks.sh@22 -- # lslocks -p 88065 00:05:14.991 22:57:41 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:15.250 lslocks: write error 00:05:15.250 22:57:41 -- event/cpu_locks.sh@50 -- # killprocess 88065 00:05:15.250 22:57:41 -- common/autotest_common.sh@936 -- # '[' -z 88065 ']' 00:05:15.250 22:57:41 -- common/autotest_common.sh@940 -- # kill -0 88065 00:05:15.250 22:57:41 -- common/autotest_common.sh@941 -- # uname 00:05:15.250 22:57:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:15.250 22:57:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88065 00:05:15.508 22:57:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:15.508 22:57:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:15.508 22:57:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88065' 00:05:15.508 killing process with pid 88065 00:05:15.508 22:57:41 -- common/autotest_common.sh@955 -- # kill 88065 00:05:15.508 22:57:41 -- common/autotest_common.sh@960 -- # wait 88065 00:05:15.767 22:57:42 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 88065 00:05:15.767 22:57:42 -- common/autotest_common.sh@650 -- # local es=0 00:05:15.767 22:57:42 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 88065 00:05:15.767 22:57:42 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:15.767 22:57:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:15.767 22:57:42 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:15.767 22:57:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:15.767 22:57:42 -- common/autotest_common.sh@653 -- # waitforlisten 88065 00:05:15.767 22:57:42 -- common/autotest_common.sh@829 -- # '[' -z 88065 ']' 00:05:15.767 22:57:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:15.767 22:57:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.767 22:57:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:15.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:15.767 22:57:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.767 22:57:42 -- common/autotest_common.sh@10 -- # set +x 00:05:15.767 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (88065) - No such process 00:05:15.767 ERROR: process (pid: 88065) is no longer running 00:05:15.767 22:57:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.767 22:57:42 -- common/autotest_common.sh@862 -- # return 1 00:05:15.767 22:57:42 -- common/autotest_common.sh@653 -- # es=1 00:05:15.767 22:57:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:15.767 22:57:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:15.767 22:57:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:15.767 22:57:42 -- event/cpu_locks.sh@54 -- # no_locks 00:05:15.767 22:57:42 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:15.767 22:57:42 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:15.767 22:57:42 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:15.767 00:05:15.767 real 0m1.761s 00:05:15.767 user 0m1.910s 00:05:15.767 sys 0m0.541s 00:05:15.767 22:57:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:15.767 22:57:42 -- common/autotest_common.sh@10 -- # set +x 00:05:15.767 ************************************ 00:05:15.767 END TEST default_locks 00:05:15.767 ************************************ 00:05:15.767 22:57:42 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:15.767 22:57:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:15.767 22:57:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:15.767 22:57:42 -- common/autotest_common.sh@10 -- # set +x 00:05:15.767 ************************************ 00:05:15.767 START TEST default_locks_via_rpc 00:05:15.767 ************************************ 00:05:15.767 22:57:42 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:15.767 22:57:42 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=88270 00:05:15.767 22:57:42 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:15.767 22:57:42 -- event/cpu_locks.sh@63 -- # waitforlisten 88270 00:05:15.767 22:57:42 -- common/autotest_common.sh@829 -- # '[' -z 88270 ']' 00:05:15.767 22:57:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:15.767 22:57:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.767 22:57:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:15.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:15.767 22:57:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.767 22:57:42 -- common/autotest_common.sh@10 -- # set +x 00:05:16.026 [2024-11-26 22:57:42.181912] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.026 [2024-11-26 22:57:42.182005] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88270 ] 00:05:16.026 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.026 [2024-11-26 22:57:42.239764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.026 [2024-11-26 22:57:42.349392] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.026 [2024-11-26 22:57:42.349598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.963 22:57:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.963 22:57:43 -- common/autotest_common.sh@862 -- # return 0 00:05:16.963 22:57:43 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:16.963 22:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:16.963 22:57:43 -- common/autotest_common.sh@10 -- # set +x 00:05:16.963 22:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:16.963 22:57:43 -- event/cpu_locks.sh@67 -- # no_locks 00:05:16.963 22:57:43 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:16.963 22:57:43 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:16.963 22:57:43 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:16.963 22:57:43 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:16.963 22:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:16.963 22:57:43 -- common/autotest_common.sh@10 -- # set +x 00:05:16.963 22:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:16.963 22:57:43 -- event/cpu_locks.sh@71 -- # locks_exist 88270 00:05:16.963 22:57:43 -- event/cpu_locks.sh@22 -- # lslocks -p 88270 00:05:16.963 22:57:43 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:17.221 22:57:43 -- event/cpu_locks.sh@73 -- # killprocess 88270 00:05:17.221 22:57:43 -- common/autotest_common.sh@936 -- # '[' -z 88270 ']' 00:05:17.221 22:57:43 -- common/autotest_common.sh@940 -- # kill -0 88270 00:05:17.221 22:57:43 -- common/autotest_common.sh@941 -- # uname 00:05:17.221 22:57:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:17.222 22:57:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88270 00:05:17.222 22:57:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:17.222 22:57:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:17.222 22:57:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88270' 00:05:17.222 killing process with pid 88270 00:05:17.222 22:57:43 -- common/autotest_common.sh@955 -- # kill 88270 00:05:17.222 22:57:43 -- common/autotest_common.sh@960 -- # wait 88270 00:05:17.481 00:05:17.481 real 0m1.718s 00:05:17.481 user 0m1.876s 00:05:17.481 sys 0m0.544s 00:05:17.481 22:57:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.481 22:57:43 -- common/autotest_common.sh@10 -- # set +x 00:05:17.481 ************************************ 00:05:17.481 END TEST default_locks_via_rpc 00:05:17.481 ************************************ 00:05:17.481 22:57:43 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:17.481 22:57:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:17.481 22:57:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.481 22:57:43 -- common/autotest_common.sh@10 -- # set +x 00:05:17.740 ************************************ 00:05:17.740 START TEST non_locking_app_on_locked_coremask 00:05:17.740 ************************************ 00:05:17.740 22:57:43 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:17.740 22:57:43 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=88564 00:05:17.740 22:57:43 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:17.740 22:57:43 -- event/cpu_locks.sh@81 -- # waitforlisten 88564 /var/tmp/spdk.sock 00:05:17.740 22:57:43 -- common/autotest_common.sh@829 -- # '[' -z 88564 ']' 00:05:17.740 22:57:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:17.740 22:57:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:17.740 22:57:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:17.740 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:17.740 22:57:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:17.740 22:57:43 -- common/autotest_common.sh@10 -- # set +x 00:05:17.740 [2024-11-26 22:57:43.924924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.740 [2024-11-26 22:57:43.925013] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88564 ] 00:05:17.740 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.740 [2024-11-26 22:57:43.986794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.740 [2024-11-26 22:57:44.099576] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.740 [2024-11-26 22:57:44.099755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.677 22:57:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.677 22:57:44 -- common/autotest_common.sh@862 -- # return 0 00:05:18.677 22:57:44 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=88699 00:05:18.677 22:57:44 -- event/cpu_locks.sh@85 -- # waitforlisten 88699 /var/tmp/spdk2.sock 00:05:18.677 22:57:44 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:18.677 22:57:44 -- common/autotest_common.sh@829 -- # '[' -z 88699 ']' 00:05:18.677 22:57:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:18.677 22:57:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.677 22:57:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:18.677 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:18.677 22:57:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.677 22:57:44 -- common/autotest_common.sh@10 -- # set +x 00:05:18.677 [2024-11-26 22:57:44.908190] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.677 [2024-11-26 22:57:44.908268] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88699 ] 00:05:18.677 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.677 [2024-11-26 22:57:44.994697] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:18.677 [2024-11-26 22:57:44.994741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.936 [2024-11-26 22:57:45.221149] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.936 [2024-11-26 22:57:45.221334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.504 22:57:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.504 22:57:45 -- common/autotest_common.sh@862 -- # return 0 00:05:19.504 22:57:45 -- event/cpu_locks.sh@87 -- # locks_exist 88564 00:05:19.504 22:57:45 -- event/cpu_locks.sh@22 -- # lslocks -p 88564 00:05:19.504 22:57:45 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:20.072 lslocks: write error 00:05:20.072 22:57:46 -- event/cpu_locks.sh@89 -- # killprocess 88564 00:05:20.072 22:57:46 -- common/autotest_common.sh@936 -- # '[' -z 88564 ']' 00:05:20.072 22:57:46 -- common/autotest_common.sh@940 -- # kill -0 88564 00:05:20.072 22:57:46 -- common/autotest_common.sh@941 -- # uname 00:05:20.072 22:57:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.072 22:57:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88564 00:05:20.072 22:57:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.072 22:57:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.072 22:57:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88564' 00:05:20.072 killing process with pid 88564 00:05:20.072 22:57:46 -- common/autotest_common.sh@955 -- # kill 88564 00:05:20.072 22:57:46 -- common/autotest_common.sh@960 -- # wait 88564 00:05:21.009 22:57:47 -- event/cpu_locks.sh@90 -- # killprocess 88699 00:05:21.009 22:57:47 -- common/autotest_common.sh@936 -- # '[' -z 88699 ']' 00:05:21.009 22:57:47 -- common/autotest_common.sh@940 -- # kill -0 88699 00:05:21.009 22:57:47 -- common/autotest_common.sh@941 -- # uname 00:05:21.009 22:57:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.009 22:57:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88699 00:05:21.009 22:57:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.009 22:57:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.009 22:57:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88699' 00:05:21.009 killing process with pid 88699 00:05:21.009 22:57:47 -- common/autotest_common.sh@955 -- # kill 88699 00:05:21.009 22:57:47 -- common/autotest_common.sh@960 -- # wait 88699 00:05:21.577 00:05:21.577 real 0m3.834s 00:05:21.577 user 0m4.214s 00:05:21.577 sys 0m1.033s 00:05:21.577 22:57:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.577 22:57:47 -- common/autotest_common.sh@10 -- # set +x 00:05:21.577 ************************************ 00:05:21.577 END TEST non_locking_app_on_locked_coremask 00:05:21.577 ************************************ 00:05:21.577 22:57:47 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:21.577 22:57:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:21.577 22:57:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.577 22:57:47 -- common/autotest_common.sh@10 -- # set +x 00:05:21.577 ************************************ 00:05:21.577 START TEST locking_app_on_unlocked_coremask 00:05:21.577 ************************************ 00:05:21.577 22:57:47 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:21.577 22:57:47 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=89016 00:05:21.577 22:57:47 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:21.577 22:57:47 -- event/cpu_locks.sh@99 -- # waitforlisten 89016 /var/tmp/spdk.sock 00:05:21.577 22:57:47 -- common/autotest_common.sh@829 -- # '[' -z 89016 ']' 00:05:21.577 22:57:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:21.577 22:57:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.577 22:57:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:21.577 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:21.577 22:57:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.577 22:57:47 -- common/autotest_common.sh@10 -- # set +x 00:05:21.577 [2024-11-26 22:57:47.786550] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.577 [2024-11-26 22:57:47.786632] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89016 ] 00:05:21.577 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.577 [2024-11-26 22:57:47.848131] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:21.577 [2024-11-26 22:57:47.848176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.577 [2024-11-26 22:57:47.962699] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.577 [2024-11-26 22:57:47.962885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.514 22:57:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.514 22:57:48 -- common/autotest_common.sh@862 -- # return 0 00:05:22.514 22:57:48 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=89152 00:05:22.514 22:57:48 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:22.514 22:57:48 -- event/cpu_locks.sh@103 -- # waitforlisten 89152 /var/tmp/spdk2.sock 00:05:22.514 22:57:48 -- common/autotest_common.sh@829 -- # '[' -z 89152 ']' 00:05:22.514 22:57:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:22.514 22:57:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.514 22:57:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:22.514 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:22.514 22:57:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.514 22:57:48 -- common/autotest_common.sh@10 -- # set +x 00:05:22.514 [2024-11-26 22:57:48.775344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.514 [2024-11-26 22:57:48.775418] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89152 ] 00:05:22.514 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.514 [2024-11-26 22:57:48.871190] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.773 [2024-11-26 22:57:49.106756] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.773 [2024-11-26 22:57:49.106942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.339 22:57:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.339 22:57:49 -- common/autotest_common.sh@862 -- # return 0 00:05:23.339 22:57:49 -- event/cpu_locks.sh@105 -- # locks_exist 89152 00:05:23.339 22:57:49 -- event/cpu_locks.sh@22 -- # lslocks -p 89152 00:05:23.339 22:57:49 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:23.906 lslocks: write error 00:05:23.906 22:57:50 -- event/cpu_locks.sh@107 -- # killprocess 89016 00:05:23.906 22:57:50 -- common/autotest_common.sh@936 -- # '[' -z 89016 ']' 00:05:23.906 22:57:50 -- common/autotest_common.sh@940 -- # kill -0 89016 00:05:23.906 22:57:50 -- common/autotest_common.sh@941 -- # uname 00:05:23.906 22:57:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.164 22:57:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89016 00:05:24.164 22:57:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.164 22:57:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.164 22:57:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89016' 00:05:24.164 killing process with pid 89016 00:05:24.164 22:57:50 -- common/autotest_common.sh@955 -- # kill 89016 00:05:24.164 22:57:50 -- common/autotest_common.sh@960 -- # wait 89016 00:05:25.100 22:57:51 -- event/cpu_locks.sh@108 -- # killprocess 89152 00:05:25.100 22:57:51 -- common/autotest_common.sh@936 -- # '[' -z 89152 ']' 00:05:25.100 22:57:51 -- common/autotest_common.sh@940 -- # kill -0 89152 00:05:25.100 22:57:51 -- common/autotest_common.sh@941 -- # uname 00:05:25.100 22:57:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:25.100 22:57:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89152 00:05:25.100 22:57:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:25.100 22:57:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:25.100 22:57:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89152' 00:05:25.100 killing process with pid 89152 00:05:25.100 22:57:51 -- common/autotest_common.sh@955 -- # kill 89152 00:05:25.100 22:57:51 -- common/autotest_common.sh@960 -- # wait 89152 00:05:25.360 00:05:25.360 real 0m4.003s 00:05:25.360 user 0m4.365s 00:05:25.360 sys 0m1.082s 00:05:25.360 22:57:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.360 22:57:51 -- common/autotest_common.sh@10 -- # set +x 00:05:25.360 ************************************ 00:05:25.360 END TEST locking_app_on_unlocked_coremask 00:05:25.360 ************************************ 00:05:25.619 22:57:51 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:25.619 22:57:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:25.619 22:57:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.619 22:57:51 -- common/autotest_common.sh@10 -- # set +x 00:05:25.619 ************************************ 00:05:25.619 START TEST locking_app_on_locked_coremask 00:05:25.619 ************************************ 00:05:25.619 22:57:51 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:25.619 22:57:51 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=89593 00:05:25.619 22:57:51 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:25.619 22:57:51 -- event/cpu_locks.sh@116 -- # waitforlisten 89593 /var/tmp/spdk.sock 00:05:25.619 22:57:51 -- common/autotest_common.sh@829 -- # '[' -z 89593 ']' 00:05:25.619 22:57:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:25.619 22:57:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:25.619 22:57:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:25.619 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:25.619 22:57:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:25.619 22:57:51 -- common/autotest_common.sh@10 -- # set +x 00:05:25.619 [2024-11-26 22:57:51.817223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.619 [2024-11-26 22:57:51.817313] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89593 ] 00:05:25.619 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.620 [2024-11-26 22:57:51.878910] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.620 [2024-11-26 22:57:51.990883] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.620 [2024-11-26 22:57:51.991070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.557 22:57:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.557 22:57:52 -- common/autotest_common.sh@862 -- # return 0 00:05:26.557 22:57:52 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=89732 00:05:26.557 22:57:52 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 89732 /var/tmp/spdk2.sock 00:05:26.557 22:57:52 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:26.557 22:57:52 -- common/autotest_common.sh@650 -- # local es=0 00:05:26.557 22:57:52 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 89732 /var/tmp/spdk2.sock 00:05:26.557 22:57:52 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:26.557 22:57:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.557 22:57:52 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:26.557 22:57:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.557 22:57:52 -- common/autotest_common.sh@653 -- # waitforlisten 89732 /var/tmp/spdk2.sock 00:05:26.557 22:57:52 -- common/autotest_common.sh@829 -- # '[' -z 89732 ']' 00:05:26.557 22:57:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:26.557 22:57:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.557 22:57:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:26.557 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:26.557 22:57:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.557 22:57:52 -- common/autotest_common.sh@10 -- # set +x 00:05:26.557 [2024-11-26 22:57:52.815556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.557 [2024-11-26 22:57:52.815634] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89732 ] 00:05:26.557 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.557 [2024-11-26 22:57:52.907335] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 89593 has claimed it. 00:05:26.557 [2024-11-26 22:57:52.907393] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:27.492 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (89732) - No such process 00:05:27.492 ERROR: process (pid: 89732) is no longer running 00:05:27.492 22:57:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.492 22:57:53 -- common/autotest_common.sh@862 -- # return 1 00:05:27.492 22:57:53 -- common/autotest_common.sh@653 -- # es=1 00:05:27.492 22:57:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:27.492 22:57:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:27.492 22:57:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:27.492 22:57:53 -- event/cpu_locks.sh@122 -- # locks_exist 89593 00:05:27.492 22:57:53 -- event/cpu_locks.sh@22 -- # lslocks -p 89593 00:05:27.492 22:57:53 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:27.492 lslocks: write error 00:05:27.492 22:57:53 -- event/cpu_locks.sh@124 -- # killprocess 89593 00:05:27.492 22:57:53 -- common/autotest_common.sh@936 -- # '[' -z 89593 ']' 00:05:27.492 22:57:53 -- common/autotest_common.sh@940 -- # kill -0 89593 00:05:27.492 22:57:53 -- common/autotest_common.sh@941 -- # uname 00:05:27.492 22:57:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.492 22:57:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89593 00:05:27.752 22:57:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.752 22:57:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.752 22:57:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89593' 00:05:27.752 killing process with pid 89593 00:05:27.752 22:57:53 -- common/autotest_common.sh@955 -- # kill 89593 00:05:27.752 22:57:53 -- common/autotest_common.sh@960 -- # wait 89593 00:05:28.011 00:05:28.011 real 0m2.603s 00:05:28.011 user 0m2.980s 00:05:28.011 sys 0m0.660s 00:05:28.011 22:57:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.011 22:57:54 -- common/autotest_common.sh@10 -- # set +x 00:05:28.011 ************************************ 00:05:28.011 END TEST locking_app_on_locked_coremask 00:05:28.011 ************************************ 00:05:28.011 22:57:54 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:28.011 22:57:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.011 22:57:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.011 22:57:54 -- common/autotest_common.sh@10 -- # set +x 00:05:28.011 ************************************ 00:05:28.011 START TEST locking_overlapped_coremask 00:05:28.011 ************************************ 00:05:28.011 22:57:54 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:28.011 22:57:54 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=89905 00:05:28.011 22:57:54 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:28.011 22:57:54 -- event/cpu_locks.sh@133 -- # waitforlisten 89905 /var/tmp/spdk.sock 00:05:28.011 22:57:54 -- common/autotest_common.sh@829 -- # '[' -z 89905 ']' 00:05:28.011 22:57:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.011 22:57:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.011 22:57:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.011 22:57:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.011 22:57:54 -- common/autotest_common.sh@10 -- # set +x 00:05:28.270 [2024-11-26 22:57:54.444769] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.270 [2024-11-26 22:57:54.444880] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89905 ] 00:05:28.270 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.270 [2024-11-26 22:57:54.502500] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:28.270 [2024-11-26 22:57:54.610226] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:28.270 [2024-11-26 22:57:54.610424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:28.270 [2024-11-26 22:57:54.610482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:28.270 [2024-11-26 22:57:54.610485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.206 22:57:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.206 22:57:55 -- common/autotest_common.sh@862 -- # return 0 00:05:29.206 22:57:55 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=90047 00:05:29.206 22:57:55 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 90047 /var/tmp/spdk2.sock 00:05:29.206 22:57:55 -- common/autotest_common.sh@650 -- # local es=0 00:05:29.206 22:57:55 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:29.206 22:57:55 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 90047 /var/tmp/spdk2.sock 00:05:29.206 22:57:55 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:29.206 22:57:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.206 22:57:55 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:29.206 22:57:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.206 22:57:55 -- common/autotest_common.sh@653 -- # waitforlisten 90047 /var/tmp/spdk2.sock 00:05:29.206 22:57:55 -- common/autotest_common.sh@829 -- # '[' -z 90047 ']' 00:05:29.206 22:57:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:29.206 22:57:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.206 22:57:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:29.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:29.206 22:57:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.206 22:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:29.206 [2024-11-26 22:57:55.457704] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.206 [2024-11-26 22:57:55.457777] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90047 ] 00:05:29.206 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.206 [2024-11-26 22:57:55.546257] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 89905 has claimed it. 00:05:29.206 [2024-11-26 22:57:55.546318] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:29.773 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (90047) - No such process 00:05:29.773 ERROR: process (pid: 90047) is no longer running 00:05:29.773 22:57:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.773 22:57:56 -- common/autotest_common.sh@862 -- # return 1 00:05:29.773 22:57:56 -- common/autotest_common.sh@653 -- # es=1 00:05:29.773 22:57:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:29.773 22:57:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:29.773 22:57:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:29.773 22:57:56 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:29.773 22:57:56 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:29.773 22:57:56 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:29.773 22:57:56 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:29.773 22:57:56 -- event/cpu_locks.sh@141 -- # killprocess 89905 00:05:29.773 22:57:56 -- common/autotest_common.sh@936 -- # '[' -z 89905 ']' 00:05:29.773 22:57:56 -- common/autotest_common.sh@940 -- # kill -0 89905 00:05:29.773 22:57:56 -- common/autotest_common.sh@941 -- # uname 00:05:29.773 22:57:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.773 22:57:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89905 00:05:30.031 22:57:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:30.031 22:57:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:30.031 22:57:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89905' 00:05:30.031 killing process with pid 89905 00:05:30.031 22:57:56 -- common/autotest_common.sh@955 -- # kill 89905 00:05:30.031 22:57:56 -- common/autotest_common.sh@960 -- # wait 89905 00:05:30.292 00:05:30.292 real 0m2.244s 00:05:30.292 user 0m6.374s 00:05:30.292 sys 0m0.475s 00:05:30.292 22:57:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.292 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:30.292 ************************************ 00:05:30.292 END TEST locking_overlapped_coremask 00:05:30.292 ************************************ 00:05:30.292 22:57:56 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:30.292 22:57:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:30.292 22:57:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.292 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:30.292 ************************************ 00:05:30.292 START TEST locking_overlapped_coremask_via_rpc 00:05:30.292 ************************************ 00:05:30.292 22:57:56 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:30.292 22:57:56 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=90213 00:05:30.292 22:57:56 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:30.292 22:57:56 -- event/cpu_locks.sh@149 -- # waitforlisten 90213 /var/tmp/spdk.sock 00:05:30.292 22:57:56 -- common/autotest_common.sh@829 -- # '[' -z 90213 ']' 00:05:30.292 22:57:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:30.292 22:57:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:30.292 22:57:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:30.292 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:30.292 22:57:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:30.292 22:57:56 -- common/autotest_common.sh@10 -- # set +x 00:05:30.551 [2024-11-26 22:57:56.719785] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.551 [2024-11-26 22:57:56.719877] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90213 ] 00:05:30.551 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.551 [2024-11-26 22:57:56.781175] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:30.551 [2024-11-26 22:57:56.781218] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:30.551 [2024-11-26 22:57:56.894809] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:30.551 [2024-11-26 22:57:56.895017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:30.551 [2024-11-26 22:57:56.895087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:30.551 [2024-11-26 22:57:56.895090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.487 22:57:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:31.487 22:57:57 -- common/autotest_common.sh@862 -- # return 0 00:05:31.487 22:57:57 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=90355 00:05:31.487 22:57:57 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:31.487 22:57:57 -- event/cpu_locks.sh@153 -- # waitforlisten 90355 /var/tmp/spdk2.sock 00:05:31.487 22:57:57 -- common/autotest_common.sh@829 -- # '[' -z 90355 ']' 00:05:31.487 22:57:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:31.487 22:57:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:31.487 22:57:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:31.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:31.487 22:57:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:31.487 22:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:31.487 [2024-11-26 22:57:57.705550] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.487 [2024-11-26 22:57:57.705626] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90355 ] 00:05:31.487 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.487 [2024-11-26 22:57:57.795641] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:31.487 [2024-11-26 22:57:57.795682] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:31.746 [2024-11-26 22:57:58.013488] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.746 [2024-11-26 22:57:58.017721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:31.746 [2024-11-26 22:57:58.017780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:31.746 [2024-11-26 22:57:58.017782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:32.314 22:57:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.314 22:57:58 -- common/autotest_common.sh@862 -- # return 0 00:05:32.314 22:57:58 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:32.314 22:57:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.314 22:57:58 -- common/autotest_common.sh@10 -- # set +x 00:05:32.314 22:57:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.314 22:57:58 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:32.314 22:57:58 -- common/autotest_common.sh@650 -- # local es=0 00:05:32.314 22:57:58 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:32.314 22:57:58 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:32.314 22:57:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:32.314 22:57:58 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:32.314 22:57:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:32.314 22:57:58 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:32.314 22:57:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.314 22:57:58 -- common/autotest_common.sh@10 -- # set +x 00:05:32.314 [2024-11-26 22:57:58.668619] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 90213 has claimed it. 00:05:32.314 request: 00:05:32.314 { 00:05:32.314 "method": "framework_enable_cpumask_locks", 00:05:32.314 "req_id": 1 00:05:32.314 } 00:05:32.314 Got JSON-RPC error response 00:05:32.314 response: 00:05:32.314 { 00:05:32.314 "code": -32603, 00:05:32.314 "message": "Failed to claim CPU core: 2" 00:05:32.314 } 00:05:32.314 22:57:58 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:32.314 22:57:58 -- common/autotest_common.sh@653 -- # es=1 00:05:32.314 22:57:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:32.314 22:57:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:32.314 22:57:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:32.314 22:57:58 -- event/cpu_locks.sh@158 -- # waitforlisten 90213 /var/tmp/spdk.sock 00:05:32.314 22:57:58 -- common/autotest_common.sh@829 -- # '[' -z 90213 ']' 00:05:32.314 22:57:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:32.314 22:57:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:32.314 22:57:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:32.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:32.314 22:57:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:32.314 22:57:58 -- common/autotest_common.sh@10 -- # set +x 00:05:32.573 22:57:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.573 22:57:58 -- common/autotest_common.sh@862 -- # return 0 00:05:32.573 22:57:58 -- event/cpu_locks.sh@159 -- # waitforlisten 90355 /var/tmp/spdk2.sock 00:05:32.573 22:57:58 -- common/autotest_common.sh@829 -- # '[' -z 90355 ']' 00:05:32.573 22:57:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:32.573 22:57:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:32.573 22:57:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:32.573 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:32.573 22:57:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:32.573 22:57:58 -- common/autotest_common.sh@10 -- # set +x 00:05:32.832 22:57:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.832 22:57:59 -- common/autotest_common.sh@862 -- # return 0 00:05:32.832 22:57:59 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:32.832 22:57:59 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:32.832 22:57:59 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:32.832 22:57:59 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:32.832 00:05:32.832 real 0m2.512s 00:05:32.832 user 0m1.228s 00:05:32.832 sys 0m0.206s 00:05:32.832 22:57:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.832 22:57:59 -- common/autotest_common.sh@10 -- # set +x 00:05:32.832 ************************************ 00:05:32.832 END TEST locking_overlapped_coremask_via_rpc 00:05:32.832 ************************************ 00:05:32.832 22:57:59 -- event/cpu_locks.sh@174 -- # cleanup 00:05:32.832 22:57:59 -- event/cpu_locks.sh@15 -- # [[ -z 90213 ]] 00:05:32.832 22:57:59 -- event/cpu_locks.sh@15 -- # killprocess 90213 00:05:32.832 22:57:59 -- common/autotest_common.sh@936 -- # '[' -z 90213 ']' 00:05:32.832 22:57:59 -- common/autotest_common.sh@940 -- # kill -0 90213 00:05:32.832 22:57:59 -- common/autotest_common.sh@941 -- # uname 00:05:32.832 22:57:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:32.832 22:57:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 90213 00:05:33.090 22:57:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:33.090 22:57:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:33.090 22:57:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 90213' 00:05:33.090 killing process with pid 90213 00:05:33.090 22:57:59 -- common/autotest_common.sh@955 -- # kill 90213 00:05:33.090 22:57:59 -- common/autotest_common.sh@960 -- # wait 90213 00:05:33.349 22:57:59 -- event/cpu_locks.sh@16 -- # [[ -z 90355 ]] 00:05:33.349 22:57:59 -- event/cpu_locks.sh@16 -- # killprocess 90355 00:05:33.349 22:57:59 -- common/autotest_common.sh@936 -- # '[' -z 90355 ']' 00:05:33.349 22:57:59 -- common/autotest_common.sh@940 -- # kill -0 90355 00:05:33.349 22:57:59 -- common/autotest_common.sh@941 -- # uname 00:05:33.349 22:57:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:33.349 22:57:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 90355 00:05:33.349 22:57:59 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:33.349 22:57:59 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:33.349 22:57:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 90355' 00:05:33.349 killing process with pid 90355 00:05:33.349 22:57:59 -- common/autotest_common.sh@955 -- # kill 90355 00:05:33.349 22:57:59 -- common/autotest_common.sh@960 -- # wait 90355 00:05:33.916 22:58:00 -- event/cpu_locks.sh@18 -- # rm -f 00:05:33.916 22:58:00 -- event/cpu_locks.sh@1 -- # cleanup 00:05:33.916 22:58:00 -- event/cpu_locks.sh@15 -- # [[ -z 90213 ]] 00:05:33.916 22:58:00 -- event/cpu_locks.sh@15 -- # killprocess 90213 00:05:33.916 22:58:00 -- common/autotest_common.sh@936 -- # '[' -z 90213 ']' 00:05:33.916 22:58:00 -- common/autotest_common.sh@940 -- # kill -0 90213 00:05:33.917 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (90213) - No such process 00:05:33.917 22:58:00 -- common/autotest_common.sh@963 -- # echo 'Process with pid 90213 is not found' 00:05:33.917 Process with pid 90213 is not found 00:05:33.917 22:58:00 -- event/cpu_locks.sh@16 -- # [[ -z 90355 ]] 00:05:33.917 22:58:00 -- event/cpu_locks.sh@16 -- # killprocess 90355 00:05:33.917 22:58:00 -- common/autotest_common.sh@936 -- # '[' -z 90355 ']' 00:05:33.917 22:58:00 -- common/autotest_common.sh@940 -- # kill -0 90355 00:05:33.917 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (90355) - No such process 00:05:33.917 22:58:00 -- common/autotest_common.sh@963 -- # echo 'Process with pid 90355 is not found' 00:05:33.917 Process with pid 90355 is not found 00:05:33.917 22:58:00 -- event/cpu_locks.sh@18 -- # rm -f 00:05:33.917 00:05:33.917 real 0m19.995s 00:05:33.917 user 0m35.608s 00:05:33.917 sys 0m5.382s 00:05:33.917 22:58:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.917 22:58:00 -- common/autotest_common.sh@10 -- # set +x 00:05:33.917 ************************************ 00:05:33.917 END TEST cpu_locks 00:05:33.917 ************************************ 00:05:33.917 00:05:33.917 real 0m47.100s 00:05:33.917 user 1m29.612s 00:05:33.917 sys 0m9.343s 00:05:33.917 22:58:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.917 22:58:00 -- common/autotest_common.sh@10 -- # set +x 00:05:33.917 ************************************ 00:05:33.917 END TEST event 00:05:33.917 ************************************ 00:05:33.917 22:58:00 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:33.917 22:58:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.917 22:58:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.917 22:58:00 -- common/autotest_common.sh@10 -- # set +x 00:05:33.917 ************************************ 00:05:33.917 START TEST thread 00:05:33.917 ************************************ 00:05:33.917 22:58:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:33.917 * Looking for test storage... 00:05:33.917 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:33.917 22:58:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.917 22:58:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.917 22:58:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:34.177 22:58:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:34.177 22:58:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:34.177 22:58:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:34.177 22:58:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:34.177 22:58:00 -- scripts/common.sh@335 -- # IFS=.-: 00:05:34.177 22:58:00 -- scripts/common.sh@335 -- # read -ra ver1 00:05:34.177 22:58:00 -- scripts/common.sh@336 -- # IFS=.-: 00:05:34.177 22:58:00 -- scripts/common.sh@336 -- # read -ra ver2 00:05:34.177 22:58:00 -- scripts/common.sh@337 -- # local 'op=<' 00:05:34.177 22:58:00 -- scripts/common.sh@339 -- # ver1_l=2 00:05:34.177 22:58:00 -- scripts/common.sh@340 -- # ver2_l=1 00:05:34.177 22:58:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:34.177 22:58:00 -- scripts/common.sh@343 -- # case "$op" in 00:05:34.177 22:58:00 -- scripts/common.sh@344 -- # : 1 00:05:34.177 22:58:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:34.177 22:58:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:34.177 22:58:00 -- scripts/common.sh@364 -- # decimal 1 00:05:34.177 22:58:00 -- scripts/common.sh@352 -- # local d=1 00:05:34.177 22:58:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:34.177 22:58:00 -- scripts/common.sh@354 -- # echo 1 00:05:34.177 22:58:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:34.177 22:58:00 -- scripts/common.sh@365 -- # decimal 2 00:05:34.177 22:58:00 -- scripts/common.sh@352 -- # local d=2 00:05:34.177 22:58:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:34.177 22:58:00 -- scripts/common.sh@354 -- # echo 2 00:05:34.177 22:58:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:34.177 22:58:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:34.177 22:58:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:34.177 22:58:00 -- scripts/common.sh@367 -- # return 0 00:05:34.177 22:58:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:34.177 22:58:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:34.177 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.177 --rc genhtml_branch_coverage=1 00:05:34.177 --rc genhtml_function_coverage=1 00:05:34.177 --rc genhtml_legend=1 00:05:34.177 --rc geninfo_all_blocks=1 00:05:34.177 --rc geninfo_unexecuted_blocks=1 00:05:34.177 00:05:34.177 ' 00:05:34.177 22:58:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:34.177 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.177 --rc genhtml_branch_coverage=1 00:05:34.177 --rc genhtml_function_coverage=1 00:05:34.177 --rc genhtml_legend=1 00:05:34.177 --rc geninfo_all_blocks=1 00:05:34.177 --rc geninfo_unexecuted_blocks=1 00:05:34.177 00:05:34.177 ' 00:05:34.177 22:58:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:34.177 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.177 --rc genhtml_branch_coverage=1 00:05:34.177 --rc genhtml_function_coverage=1 00:05:34.177 --rc genhtml_legend=1 00:05:34.177 --rc geninfo_all_blocks=1 00:05:34.177 --rc geninfo_unexecuted_blocks=1 00:05:34.177 00:05:34.177 ' 00:05:34.177 22:58:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:34.177 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.177 --rc genhtml_branch_coverage=1 00:05:34.177 --rc genhtml_function_coverage=1 00:05:34.177 --rc genhtml_legend=1 00:05:34.177 --rc geninfo_all_blocks=1 00:05:34.177 --rc geninfo_unexecuted_blocks=1 00:05:34.177 00:05:34.177 ' 00:05:34.177 22:58:00 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:34.177 22:58:00 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:34.177 22:58:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.177 22:58:00 -- common/autotest_common.sh@10 -- # set +x 00:05:34.177 ************************************ 00:05:34.177 START TEST thread_poller_perf 00:05:34.177 ************************************ 00:05:34.177 22:58:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:34.177 [2024-11-26 22:58:00.402295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.177 [2024-11-26 22:58:00.402382] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90739 ] 00:05:34.177 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.177 [2024-11-26 22:58:00.463892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.436 [2024-11-26 22:58:00.581061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.436 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:35.373 [2024-11-26T21:58:01.767Z] ====================================== 00:05:35.373 [2024-11-26T21:58:01.767Z] busy:2711631377 (cyc) 00:05:35.373 [2024-11-26T21:58:01.767Z] total_run_count: 279000 00:05:35.373 [2024-11-26T21:58:01.767Z] tsc_hz: 2700000000 (cyc) 00:05:35.373 [2024-11-26T21:58:01.767Z] ====================================== 00:05:35.373 [2024-11-26T21:58:01.767Z] poller_cost: 9719 (cyc), 3599 (nsec) 00:05:35.373 00:05:35.373 real 0m1.325s 00:05:35.373 user 0m1.228s 00:05:35.373 sys 0m0.089s 00:05:35.373 22:58:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.373 22:58:01 -- common/autotest_common.sh@10 -- # set +x 00:05:35.373 ************************************ 00:05:35.373 END TEST thread_poller_perf 00:05:35.373 ************************************ 00:05:35.373 22:58:01 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:35.373 22:58:01 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:35.373 22:58:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.373 22:58:01 -- common/autotest_common.sh@10 -- # set +x 00:05:35.373 ************************************ 00:05:35.373 START TEST thread_poller_perf 00:05:35.373 ************************************ 00:05:35.373 22:58:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:35.373 [2024-11-26 22:58:01.754495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.373 [2024-11-26 22:58:01.754620] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90935 ] 00:05:35.632 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.632 [2024-11-26 22:58:01.819741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.632 [2024-11-26 22:58:01.933724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.632 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:37.011 [2024-11-26T21:58:03.405Z] ====================================== 00:05:37.011 [2024-11-26T21:58:03.405Z] busy:2703817472 (cyc) 00:05:37.011 [2024-11-26T21:58:03.405Z] total_run_count: 3831000 00:05:37.011 [2024-11-26T21:58:03.405Z] tsc_hz: 2700000000 (cyc) 00:05:37.011 [2024-11-26T21:58:03.405Z] ====================================== 00:05:37.011 [2024-11-26T21:58:03.405Z] poller_cost: 705 (cyc), 261 (nsec) 00:05:37.011 00:05:37.011 real 0m1.313s 00:05:37.011 user 0m1.221s 00:05:37.011 sys 0m0.084s 00:05:37.011 22:58:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.011 22:58:03 -- common/autotest_common.sh@10 -- # set +x 00:05:37.011 ************************************ 00:05:37.011 END TEST thread_poller_perf 00:05:37.011 ************************************ 00:05:37.011 22:58:03 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:37.011 00:05:37.011 real 0m2.835s 00:05:37.011 user 0m2.568s 00:05:37.011 sys 0m0.268s 00:05:37.011 22:58:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.011 22:58:03 -- common/autotest_common.sh@10 -- # set +x 00:05:37.011 ************************************ 00:05:37.011 END TEST thread 00:05:37.011 ************************************ 00:05:37.011 22:58:03 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:37.011 22:58:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:37.011 22:58:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.011 22:58:03 -- common/autotest_common.sh@10 -- # set +x 00:05:37.011 ************************************ 00:05:37.011 START TEST accel 00:05:37.011 ************************************ 00:05:37.011 22:58:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:37.011 * Looking for test storage... 00:05:37.011 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:37.011 22:58:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:37.011 22:58:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:37.011 22:58:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:37.011 22:58:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:37.011 22:58:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:37.011 22:58:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:37.011 22:58:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:37.011 22:58:03 -- scripts/common.sh@335 -- # IFS=.-: 00:05:37.011 22:58:03 -- scripts/common.sh@335 -- # read -ra ver1 00:05:37.011 22:58:03 -- scripts/common.sh@336 -- # IFS=.-: 00:05:37.011 22:58:03 -- scripts/common.sh@336 -- # read -ra ver2 00:05:37.011 22:58:03 -- scripts/common.sh@337 -- # local 'op=<' 00:05:37.011 22:58:03 -- scripts/common.sh@339 -- # ver1_l=2 00:05:37.011 22:58:03 -- scripts/common.sh@340 -- # ver2_l=1 00:05:37.011 22:58:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:37.011 22:58:03 -- scripts/common.sh@343 -- # case "$op" in 00:05:37.011 22:58:03 -- scripts/common.sh@344 -- # : 1 00:05:37.011 22:58:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:37.011 22:58:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:37.011 22:58:03 -- scripts/common.sh@364 -- # decimal 1 00:05:37.011 22:58:03 -- scripts/common.sh@352 -- # local d=1 00:05:37.011 22:58:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:37.011 22:58:03 -- scripts/common.sh@354 -- # echo 1 00:05:37.011 22:58:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:37.011 22:58:03 -- scripts/common.sh@365 -- # decimal 2 00:05:37.011 22:58:03 -- scripts/common.sh@352 -- # local d=2 00:05:37.011 22:58:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:37.011 22:58:03 -- scripts/common.sh@354 -- # echo 2 00:05:37.011 22:58:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:37.011 22:58:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:37.011 22:58:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:37.011 22:58:03 -- scripts/common.sh@367 -- # return 0 00:05:37.011 22:58:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:37.011 22:58:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:37.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.011 --rc genhtml_branch_coverage=1 00:05:37.011 --rc genhtml_function_coverage=1 00:05:37.011 --rc genhtml_legend=1 00:05:37.011 --rc geninfo_all_blocks=1 00:05:37.011 --rc geninfo_unexecuted_blocks=1 00:05:37.011 00:05:37.011 ' 00:05:37.011 22:58:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:37.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.011 --rc genhtml_branch_coverage=1 00:05:37.011 --rc genhtml_function_coverage=1 00:05:37.011 --rc genhtml_legend=1 00:05:37.011 --rc geninfo_all_blocks=1 00:05:37.011 --rc geninfo_unexecuted_blocks=1 00:05:37.011 00:05:37.011 ' 00:05:37.011 22:58:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:37.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.011 --rc genhtml_branch_coverage=1 00:05:37.011 --rc genhtml_function_coverage=1 00:05:37.011 --rc genhtml_legend=1 00:05:37.011 --rc geninfo_all_blocks=1 00:05:37.011 --rc geninfo_unexecuted_blocks=1 00:05:37.011 00:05:37.011 ' 00:05:37.011 22:58:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:37.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:37.011 --rc genhtml_branch_coverage=1 00:05:37.011 --rc genhtml_function_coverage=1 00:05:37.011 --rc genhtml_legend=1 00:05:37.011 --rc geninfo_all_blocks=1 00:05:37.011 --rc geninfo_unexecuted_blocks=1 00:05:37.011 00:05:37.011 ' 00:05:37.011 22:58:03 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:37.012 22:58:03 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:37.012 22:58:03 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:37.012 22:58:03 -- accel/accel.sh@59 -- # spdk_tgt_pid=91226 00:05:37.012 22:58:03 -- accel/accel.sh@60 -- # waitforlisten 91226 00:05:37.012 22:58:03 -- common/autotest_common.sh@829 -- # '[' -z 91226 ']' 00:05:37.012 22:58:03 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:37.012 22:58:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:37.012 22:58:03 -- accel/accel.sh@58 -- # build_accel_config 00:05:37.012 22:58:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:37.012 22:58:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.012 22:58:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:37.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:37.012 22:58:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.012 22:58:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:37.012 22:58:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.012 22:58:03 -- common/autotest_common.sh@10 -- # set +x 00:05:37.012 22:58:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.012 22:58:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.012 22:58:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.012 22:58:03 -- accel/accel.sh@42 -- # jq -r . 00:05:37.012 [2024-11-26 22:58:03.285337] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.012 [2024-11-26 22:58:03.285410] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91226 ] 00:05:37.012 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.012 [2024-11-26 22:58:03.346322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.274 [2024-11-26 22:58:03.460197] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:37.274 [2024-11-26 22:58:03.460374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.841 22:58:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:37.841 22:58:04 -- common/autotest_common.sh@862 -- # return 0 00:05:37.841 22:58:04 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:38.100 22:58:04 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:38.100 22:58:04 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:38.100 22:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:38.100 22:58:04 -- common/autotest_common.sh@10 -- # set +x 00:05:38.100 22:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.100 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.100 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.100 22:58:04 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:38.101 22:58:04 -- accel/accel.sh@64 -- # IFS== 00:05:38.101 22:58:04 -- accel/accel.sh@64 -- # read -r opc module 00:05:38.101 22:58:04 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:38.101 22:58:04 -- accel/accel.sh@67 -- # killprocess 91226 00:05:38.101 22:58:04 -- common/autotest_common.sh@936 -- # '[' -z 91226 ']' 00:05:38.101 22:58:04 -- common/autotest_common.sh@940 -- # kill -0 91226 00:05:38.101 22:58:04 -- common/autotest_common.sh@941 -- # uname 00:05:38.101 22:58:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:38.101 22:58:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 91226 00:05:38.101 22:58:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:38.101 22:58:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:38.101 22:58:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 91226' 00:05:38.101 killing process with pid 91226 00:05:38.101 22:58:04 -- common/autotest_common.sh@955 -- # kill 91226 00:05:38.101 22:58:04 -- common/autotest_common.sh@960 -- # wait 91226 00:05:38.668 22:58:04 -- accel/accel.sh@68 -- # trap - ERR 00:05:38.668 22:58:04 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:38.668 22:58:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:38.668 22:58:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.668 22:58:04 -- common/autotest_common.sh@10 -- # set +x 00:05:38.668 22:58:04 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:38.668 22:58:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:38.668 22:58:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.668 22:58:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.668 22:58:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.668 22:58:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.668 22:58:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.668 22:58:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.668 22:58:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.668 22:58:04 -- accel/accel.sh@42 -- # jq -r . 00:05:38.668 22:58:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.668 22:58:04 -- common/autotest_common.sh@10 -- # set +x 00:05:38.668 22:58:04 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:38.668 22:58:04 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:38.668 22:58:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.668 22:58:04 -- common/autotest_common.sh@10 -- # set +x 00:05:38.668 ************************************ 00:05:38.668 START TEST accel_missing_filename 00:05:38.668 ************************************ 00:05:38.668 22:58:04 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:38.668 22:58:04 -- common/autotest_common.sh@650 -- # local es=0 00:05:38.668 22:58:04 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:38.668 22:58:04 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:38.668 22:58:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:38.668 22:58:04 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:38.668 22:58:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:38.668 22:58:04 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:38.668 22:58:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:38.668 22:58:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.668 22:58:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.668 22:58:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.668 22:58:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.668 22:58:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.668 22:58:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.668 22:58:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.668 22:58:04 -- accel/accel.sh@42 -- # jq -r . 00:05:38.668 [2024-11-26 22:58:04.858866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.668 [2024-11-26 22:58:04.858944] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91396 ] 00:05:38.668 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.668 [2024-11-26 22:58:04.920953] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.668 [2024-11-26 22:58:05.036436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.928 [2024-11-26 22:58:05.098365] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:38.928 [2024-11-26 22:58:05.176466] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:38.928 A filename is required. 00:05:38.928 22:58:05 -- common/autotest_common.sh@653 -- # es=234 00:05:38.928 22:58:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:38.928 22:58:05 -- common/autotest_common.sh@662 -- # es=106 00:05:38.928 22:58:05 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:38.928 22:58:05 -- common/autotest_common.sh@670 -- # es=1 00:05:38.928 22:58:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:38.928 00:05:38.928 real 0m0.451s 00:05:38.928 user 0m0.338s 00:05:38.928 sys 0m0.145s 00:05:38.928 22:58:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.928 22:58:05 -- common/autotest_common.sh@10 -- # set +x 00:05:38.928 ************************************ 00:05:38.928 END TEST accel_missing_filename 00:05:38.928 ************************************ 00:05:38.928 22:58:05 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:38.928 22:58:05 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:38.928 22:58:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.928 22:58:05 -- common/autotest_common.sh@10 -- # set +x 00:05:38.928 ************************************ 00:05:38.928 START TEST accel_compress_verify 00:05:38.928 ************************************ 00:05:38.928 22:58:05 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:38.928 22:58:05 -- common/autotest_common.sh@650 -- # local es=0 00:05:38.928 22:58:05 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:38.928 22:58:05 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:38.928 22:58:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:38.928 22:58:05 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:38.928 22:58:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:38.928 22:58:05 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:38.928 22:58:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:38.928 22:58:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.928 22:58:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.928 22:58:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.928 22:58:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.928 22:58:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.928 22:58:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.928 22:58:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.928 22:58:05 -- accel/accel.sh@42 -- # jq -r . 00:05:39.187 [2024-11-26 22:58:05.331211] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.187 [2024-11-26 22:58:05.331301] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91549 ] 00:05:39.187 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.187 [2024-11-26 22:58:05.392035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.187 [2024-11-26 22:58:05.507552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.187 [2024-11-26 22:58:05.569758] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:39.445 [2024-11-26 22:58:05.654856] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:39.445 00:05:39.445 Compression does not support the verify option, aborting. 00:05:39.445 22:58:05 -- common/autotest_common.sh@653 -- # es=161 00:05:39.445 22:58:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:39.445 22:58:05 -- common/autotest_common.sh@662 -- # es=33 00:05:39.445 22:58:05 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:39.445 22:58:05 -- common/autotest_common.sh@670 -- # es=1 00:05:39.445 22:58:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:39.445 00:05:39.445 real 0m0.462s 00:05:39.445 user 0m0.357s 00:05:39.445 sys 0m0.139s 00:05:39.445 22:58:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.445 22:58:05 -- common/autotest_common.sh@10 -- # set +x 00:05:39.445 ************************************ 00:05:39.445 END TEST accel_compress_verify 00:05:39.445 ************************************ 00:05:39.445 22:58:05 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:39.445 22:58:05 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:39.445 22:58:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.445 22:58:05 -- common/autotest_common.sh@10 -- # set +x 00:05:39.445 ************************************ 00:05:39.445 START TEST accel_wrong_workload 00:05:39.445 ************************************ 00:05:39.445 22:58:05 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:39.445 22:58:05 -- common/autotest_common.sh@650 -- # local es=0 00:05:39.445 22:58:05 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:39.445 22:58:05 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:39.445 22:58:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:39.445 22:58:05 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:39.445 22:58:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:39.445 22:58:05 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:39.445 22:58:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:39.445 22:58:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.445 22:58:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.445 22:58:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.445 22:58:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.445 22:58:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.445 22:58:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.445 22:58:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.445 22:58:05 -- accel/accel.sh@42 -- # jq -r . 00:05:39.445 Unsupported workload type: foobar 00:05:39.445 [2024-11-26 22:58:05.818038] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:39.445 accel_perf options: 00:05:39.445 [-h help message] 00:05:39.445 [-q queue depth per core] 00:05:39.445 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:39.445 [-T number of threads per core 00:05:39.445 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:39.445 [-t time in seconds] 00:05:39.445 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:39.445 [ dif_verify, , dif_generate, dif_generate_copy 00:05:39.445 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:39.445 [-l for compress/decompress workloads, name of uncompressed input file 00:05:39.445 [-S for crc32c workload, use this seed value (default 0) 00:05:39.445 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:39.445 [-f for fill workload, use this BYTE value (default 255) 00:05:39.445 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:39.445 [-y verify result if this switch is on] 00:05:39.445 [-a tasks to allocate per core (default: same value as -q)] 00:05:39.445 Can be used to spread operations across a wider range of memory. 00:05:39.445 22:58:05 -- common/autotest_common.sh@653 -- # es=1 00:05:39.445 22:58:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:39.445 22:58:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:39.445 22:58:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:39.445 00:05:39.445 real 0m0.023s 00:05:39.445 user 0m0.012s 00:05:39.445 sys 0m0.011s 00:05:39.445 22:58:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.445 22:58:05 -- common/autotest_common.sh@10 -- # set +x 00:05:39.445 ************************************ 00:05:39.445 END TEST accel_wrong_workload 00:05:39.445 ************************************ 00:05:39.705 Error: writing output failed: Broken pipe 00:05:39.705 22:58:05 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:39.705 22:58:05 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:39.705 22:58:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.705 22:58:05 -- common/autotest_common.sh@10 -- # set +x 00:05:39.705 ************************************ 00:05:39.705 START TEST accel_negative_buffers 00:05:39.705 ************************************ 00:05:39.705 22:58:05 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:39.705 22:58:05 -- common/autotest_common.sh@650 -- # local es=0 00:05:39.705 22:58:05 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:39.705 22:58:05 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:39.705 22:58:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:39.705 22:58:05 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:39.705 22:58:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:39.705 22:58:05 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:39.705 22:58:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:39.705 22:58:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.705 22:58:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.705 22:58:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.705 22:58:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.705 22:58:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.705 22:58:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.705 22:58:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.705 22:58:05 -- accel/accel.sh@42 -- # jq -r . 00:05:39.705 -x option must be non-negative. 00:05:39.705 [2024-11-26 22:58:05.868349] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:39.705 accel_perf options: 00:05:39.705 [-h help message] 00:05:39.705 [-q queue depth per core] 00:05:39.705 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:39.705 [-T number of threads per core 00:05:39.705 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:39.705 [-t time in seconds] 00:05:39.705 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:39.705 [ dif_verify, , dif_generate, dif_generate_copy 00:05:39.705 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:39.705 [-l for compress/decompress workloads, name of uncompressed input file 00:05:39.705 [-S for crc32c workload, use this seed value (default 0) 00:05:39.705 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:39.705 [-f for fill workload, use this BYTE value (default 255) 00:05:39.705 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:39.705 [-y verify result if this switch is on] 00:05:39.705 [-a tasks to allocate per core (default: same value as -q)] 00:05:39.705 Can be used to spread operations across a wider range of memory. 00:05:39.705 22:58:05 -- common/autotest_common.sh@653 -- # es=1 00:05:39.705 22:58:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:39.705 22:58:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:39.705 22:58:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:39.705 00:05:39.705 real 0m0.025s 00:05:39.705 user 0m0.013s 00:05:39.705 sys 0m0.012s 00:05:39.705 22:58:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.705 22:58:05 -- common/autotest_common.sh@10 -- # set +x 00:05:39.705 ************************************ 00:05:39.705 END TEST accel_negative_buffers 00:05:39.705 ************************************ 00:05:39.705 Error: writing output failed: Broken pipe 00:05:39.705 22:58:05 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:39.705 22:58:05 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:39.705 22:58:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.705 22:58:05 -- common/autotest_common.sh@10 -- # set +x 00:05:39.705 ************************************ 00:05:39.705 START TEST accel_crc32c 00:05:39.705 ************************************ 00:05:39.705 22:58:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:39.705 22:58:05 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.705 22:58:05 -- accel/accel.sh@17 -- # local accel_module 00:05:39.705 22:58:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:39.706 22:58:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:39.706 22:58:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.706 22:58:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.706 22:58:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.706 22:58:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.706 22:58:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.706 22:58:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.706 22:58:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.706 22:58:05 -- accel/accel.sh@42 -- # jq -r . 00:05:39.706 [2024-11-26 22:58:05.910249] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.706 [2024-11-26 22:58:05.910313] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91605 ] 00:05:39.706 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.706 [2024-11-26 22:58:05.970915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.706 [2024-11-26 22:58:06.088018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.083 22:58:07 -- accel/accel.sh@18 -- # out=' 00:05:41.083 SPDK Configuration: 00:05:41.083 Core mask: 0x1 00:05:41.083 00:05:41.083 Accel Perf Configuration: 00:05:41.083 Workload Type: crc32c 00:05:41.083 CRC-32C seed: 32 00:05:41.083 Transfer size: 4096 bytes 00:05:41.083 Vector count 1 00:05:41.083 Module: software 00:05:41.083 Queue depth: 32 00:05:41.083 Allocate depth: 32 00:05:41.083 # threads/core: 1 00:05:41.083 Run time: 1 seconds 00:05:41.083 Verify: Yes 00:05:41.083 00:05:41.083 Running for 1 seconds... 00:05:41.083 00:05:41.083 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:41.083 ------------------------------------------------------------------------------------ 00:05:41.083 0,0 407008/s 1589 MiB/s 0 0 00:05:41.083 ==================================================================================== 00:05:41.083 Total 407008/s 1589 MiB/s 0 0' 00:05:41.083 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.083 22:58:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:41.083 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.083 22:58:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:41.083 22:58:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.083 22:58:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.083 22:58:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.083 22:58:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.083 22:58:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.083 22:58:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.083 22:58:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.083 22:58:07 -- accel/accel.sh@42 -- # jq -r . 00:05:41.083 [2024-11-26 22:58:07.371113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.083 [2024-11-26 22:58:07.371195] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91754 ] 00:05:41.083 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.083 [2024-11-26 22:58:07.432842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.343 [2024-11-26 22:58:07.548094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val= 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val= 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val=0x1 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val= 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val= 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val=crc32c 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val=32 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val= 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val=software 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val=32 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val=32 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val=1 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val=Yes 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val= 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.343 22:58:07 -- accel/accel.sh@21 -- # val= 00:05:41.343 22:58:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # IFS=: 00:05:41.343 22:58:07 -- accel/accel.sh@20 -- # read -r var val 00:05:42.720 22:58:08 -- accel/accel.sh@21 -- # val= 00:05:42.720 22:58:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # IFS=: 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # read -r var val 00:05:42.720 22:58:08 -- accel/accel.sh@21 -- # val= 00:05:42.720 22:58:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # IFS=: 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # read -r var val 00:05:42.720 22:58:08 -- accel/accel.sh@21 -- # val= 00:05:42.720 22:58:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # IFS=: 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # read -r var val 00:05:42.720 22:58:08 -- accel/accel.sh@21 -- # val= 00:05:42.720 22:58:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # IFS=: 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # read -r var val 00:05:42.720 22:58:08 -- accel/accel.sh@21 -- # val= 00:05:42.720 22:58:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # IFS=: 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # read -r var val 00:05:42.720 22:58:08 -- accel/accel.sh@21 -- # val= 00:05:42.720 22:58:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # IFS=: 00:05:42.720 22:58:08 -- accel/accel.sh@20 -- # read -r var val 00:05:42.720 22:58:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.720 22:58:08 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:42.720 22:58:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.720 00:05:42.720 real 0m2.915s 00:05:42.720 user 0m2.619s 00:05:42.720 sys 0m0.288s 00:05:42.720 22:58:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.720 22:58:08 -- common/autotest_common.sh@10 -- # set +x 00:05:42.720 ************************************ 00:05:42.720 END TEST accel_crc32c 00:05:42.720 ************************************ 00:05:42.720 22:58:08 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:42.720 22:58:08 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:42.720 22:58:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.720 22:58:08 -- common/autotest_common.sh@10 -- # set +x 00:05:42.720 ************************************ 00:05:42.720 START TEST accel_crc32c_C2 00:05:42.720 ************************************ 00:05:42.720 22:58:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:42.720 22:58:08 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.720 22:58:08 -- accel/accel.sh@17 -- # local accel_module 00:05:42.720 22:58:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:42.720 22:58:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:42.720 22:58:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.720 22:58:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.720 22:58:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.720 22:58:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.720 22:58:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.720 22:58:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.720 22:58:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.720 22:58:08 -- accel/accel.sh@42 -- # jq -r . 00:05:42.720 [2024-11-26 22:58:08.856652] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.720 [2024-11-26 22:58:08.856739] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92033 ] 00:05:42.720 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.720 [2024-11-26 22:58:08.919439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.720 [2024-11-26 22:58:09.034110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.099 22:58:10 -- accel/accel.sh@18 -- # out=' 00:05:44.099 SPDK Configuration: 00:05:44.099 Core mask: 0x1 00:05:44.099 00:05:44.099 Accel Perf Configuration: 00:05:44.099 Workload Type: crc32c 00:05:44.099 CRC-32C seed: 0 00:05:44.099 Transfer size: 4096 bytes 00:05:44.099 Vector count 2 00:05:44.099 Module: software 00:05:44.099 Queue depth: 32 00:05:44.099 Allocate depth: 32 00:05:44.099 # threads/core: 1 00:05:44.099 Run time: 1 seconds 00:05:44.099 Verify: Yes 00:05:44.099 00:05:44.099 Running for 1 seconds... 00:05:44.099 00:05:44.099 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:44.099 ------------------------------------------------------------------------------------ 00:05:44.099 0,0 315296/s 2463 MiB/s 0 0 00:05:44.099 ==================================================================================== 00:05:44.099 Total 315296/s 1231 MiB/s 0 0' 00:05:44.099 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.099 22:58:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:44.099 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.099 22:58:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:44.099 22:58:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.099 22:58:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.099 22:58:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.099 22:58:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.099 22:58:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.099 22:58:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.099 22:58:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.099 22:58:10 -- accel/accel.sh@42 -- # jq -r . 00:05:44.099 [2024-11-26 22:58:10.325433] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.099 [2024-11-26 22:58:10.325511] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92177 ] 00:05:44.099 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.099 [2024-11-26 22:58:10.390565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.358 [2024-11-26 22:58:10.508010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.358 22:58:10 -- accel/accel.sh@21 -- # val= 00:05:44.358 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.358 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val= 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val=0x1 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val= 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val= 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val=crc32c 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val=0 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val= 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val=software 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val=32 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val=32 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val=1 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val=Yes 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val= 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.359 22:58:10 -- accel/accel.sh@21 -- # val= 00:05:44.359 22:58:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # IFS=: 00:05:44.359 22:58:10 -- accel/accel.sh@20 -- # read -r var val 00:05:45.737 22:58:11 -- accel/accel.sh@21 -- # val= 00:05:45.737 22:58:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # IFS=: 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # read -r var val 00:05:45.737 22:58:11 -- accel/accel.sh@21 -- # val= 00:05:45.737 22:58:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # IFS=: 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # read -r var val 00:05:45.737 22:58:11 -- accel/accel.sh@21 -- # val= 00:05:45.737 22:58:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # IFS=: 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # read -r var val 00:05:45.737 22:58:11 -- accel/accel.sh@21 -- # val= 00:05:45.737 22:58:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # IFS=: 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # read -r var val 00:05:45.737 22:58:11 -- accel/accel.sh@21 -- # val= 00:05:45.737 22:58:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # IFS=: 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # read -r var val 00:05:45.737 22:58:11 -- accel/accel.sh@21 -- # val= 00:05:45.737 22:58:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # IFS=: 00:05:45.737 22:58:11 -- accel/accel.sh@20 -- # read -r var val 00:05:45.737 22:58:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.737 22:58:11 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:45.737 22:58:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.737 00:05:45.737 real 0m2.945s 00:05:45.737 user 0m2.646s 00:05:45.737 sys 0m0.290s 00:05:45.737 22:58:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.737 22:58:11 -- common/autotest_common.sh@10 -- # set +x 00:05:45.737 ************************************ 00:05:45.737 END TEST accel_crc32c_C2 00:05:45.737 ************************************ 00:05:45.737 22:58:11 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:45.737 22:58:11 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:45.737 22:58:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.737 22:58:11 -- common/autotest_common.sh@10 -- # set +x 00:05:45.737 ************************************ 00:05:45.737 START TEST accel_copy 00:05:45.737 ************************************ 00:05:45.737 22:58:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:45.737 22:58:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.737 22:58:11 -- accel/accel.sh@17 -- # local accel_module 00:05:45.737 22:58:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:45.737 22:58:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:45.737 22:58:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.737 22:58:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.737 22:58:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.737 22:58:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.737 22:58:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.737 22:58:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.737 22:58:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.737 22:58:11 -- accel/accel.sh@42 -- # jq -r . 00:05:45.737 [2024-11-26 22:58:11.824355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.737 [2024-11-26 22:58:11.824424] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92336 ] 00:05:45.737 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.737 [2024-11-26 22:58:11.882214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.737 [2024-11-26 22:58:12.004612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.172 22:58:13 -- accel/accel.sh@18 -- # out=' 00:05:47.172 SPDK Configuration: 00:05:47.172 Core mask: 0x1 00:05:47.172 00:05:47.172 Accel Perf Configuration: 00:05:47.172 Workload Type: copy 00:05:47.172 Transfer size: 4096 bytes 00:05:47.172 Vector count 1 00:05:47.172 Module: software 00:05:47.172 Queue depth: 32 00:05:47.172 Allocate depth: 32 00:05:47.172 # threads/core: 1 00:05:47.172 Run time: 1 seconds 00:05:47.172 Verify: Yes 00:05:47.172 00:05:47.172 Running for 1 seconds... 00:05:47.172 00:05:47.172 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:47.172 ------------------------------------------------------------------------------------ 00:05:47.172 0,0 280032/s 1093 MiB/s 0 0 00:05:47.172 ==================================================================================== 00:05:47.172 Total 280032/s 1093 MiB/s 0 0' 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:47.172 22:58:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.172 22:58:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.172 22:58:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.172 22:58:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.172 22:58:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.172 22:58:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.172 22:58:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.172 22:58:13 -- accel/accel.sh@42 -- # jq -r . 00:05:47.172 [2024-11-26 22:58:13.286098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.172 [2024-11-26 22:58:13.286168] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92607 ] 00:05:47.172 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.172 [2024-11-26 22:58:13.347368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.172 [2024-11-26 22:58:13.463884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val= 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val= 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val=0x1 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val= 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val= 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val=copy 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val= 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val=software 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val=32 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val=32 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val=1 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val=Yes 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val= 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.172 22:58:13 -- accel/accel.sh@21 -- # val= 00:05:47.172 22:58:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # IFS=: 00:05:47.172 22:58:13 -- accel/accel.sh@20 -- # read -r var val 00:05:48.607 22:58:14 -- accel/accel.sh@21 -- # val= 00:05:48.607 22:58:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # IFS=: 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # read -r var val 00:05:48.607 22:58:14 -- accel/accel.sh@21 -- # val= 00:05:48.607 22:58:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # IFS=: 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # read -r var val 00:05:48.607 22:58:14 -- accel/accel.sh@21 -- # val= 00:05:48.607 22:58:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # IFS=: 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # read -r var val 00:05:48.607 22:58:14 -- accel/accel.sh@21 -- # val= 00:05:48.607 22:58:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # IFS=: 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # read -r var val 00:05:48.607 22:58:14 -- accel/accel.sh@21 -- # val= 00:05:48.607 22:58:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # IFS=: 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # read -r var val 00:05:48.607 22:58:14 -- accel/accel.sh@21 -- # val= 00:05:48.607 22:58:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # IFS=: 00:05:48.607 22:58:14 -- accel/accel.sh@20 -- # read -r var val 00:05:48.607 22:58:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:48.607 22:58:14 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:48.607 22:58:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:48.607 00:05:48.607 real 0m2.930s 00:05:48.607 user 0m2.639s 00:05:48.607 sys 0m0.281s 00:05:48.607 22:58:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.607 22:58:14 -- common/autotest_common.sh@10 -- # set +x 00:05:48.607 ************************************ 00:05:48.607 END TEST accel_copy 00:05:48.608 ************************************ 00:05:48.608 22:58:14 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:48.608 22:58:14 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:48.608 22:58:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.608 22:58:14 -- common/autotest_common.sh@10 -- # set +x 00:05:48.608 ************************************ 00:05:48.608 START TEST accel_fill 00:05:48.608 ************************************ 00:05:48.608 22:58:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:48.608 22:58:14 -- accel/accel.sh@16 -- # local accel_opc 00:05:48.608 22:58:14 -- accel/accel.sh@17 -- # local accel_module 00:05:48.608 22:58:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:48.608 22:58:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:48.608 22:58:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.608 22:58:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.608 22:58:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.608 22:58:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.608 22:58:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.608 22:58:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.608 22:58:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.608 22:58:14 -- accel/accel.sh@42 -- # jq -r . 00:05:48.608 [2024-11-26 22:58:14.779155] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.608 [2024-11-26 22:58:14.779232] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92768 ] 00:05:48.608 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.608 [2024-11-26 22:58:14.841518] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.608 [2024-11-26 22:58:14.957555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.059 22:58:16 -- accel/accel.sh@18 -- # out=' 00:05:50.059 SPDK Configuration: 00:05:50.059 Core mask: 0x1 00:05:50.059 00:05:50.059 Accel Perf Configuration: 00:05:50.059 Workload Type: fill 00:05:50.059 Fill pattern: 0x80 00:05:50.059 Transfer size: 4096 bytes 00:05:50.059 Vector count 1 00:05:50.059 Module: software 00:05:50.059 Queue depth: 64 00:05:50.059 Allocate depth: 64 00:05:50.059 # threads/core: 1 00:05:50.059 Run time: 1 seconds 00:05:50.059 Verify: Yes 00:05:50.059 00:05:50.059 Running for 1 seconds... 00:05:50.059 00:05:50.059 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.059 ------------------------------------------------------------------------------------ 00:05:50.059 0,0 407552/s 1592 MiB/s 0 0 00:05:50.059 ==================================================================================== 00:05:50.059 Total 407552/s 1592 MiB/s 0 0' 00:05:50.059 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.059 22:58:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:50.059 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.059 22:58:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:50.059 22:58:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.059 22:58:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.059 22:58:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.059 22:58:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.059 22:58:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.059 22:58:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.059 22:58:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.059 22:58:16 -- accel/accel.sh@42 -- # jq -r . 00:05:50.059 [2024-11-26 22:58:16.248576] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.059 [2024-11-26 22:58:16.248658] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92911 ] 00:05:50.059 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.059 [2024-11-26 22:58:16.312767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.059 [2024-11-26 22:58:16.428497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val= 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val= 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val=0x1 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val= 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val= 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val=fill 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val=0x80 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val= 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val=software 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val=64 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val=64 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val=1 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val=Yes 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val= 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.326 22:58:16 -- accel/accel.sh@21 -- # val= 00:05:50.326 22:58:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # IFS=: 00:05:50.326 22:58:16 -- accel/accel.sh@20 -- # read -r var val 00:05:51.325 22:58:17 -- accel/accel.sh@21 -- # val= 00:05:51.326 22:58:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # IFS=: 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # read -r var val 00:05:51.326 22:58:17 -- accel/accel.sh@21 -- # val= 00:05:51.326 22:58:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # IFS=: 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # read -r var val 00:05:51.326 22:58:17 -- accel/accel.sh@21 -- # val= 00:05:51.326 22:58:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # IFS=: 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # read -r var val 00:05:51.326 22:58:17 -- accel/accel.sh@21 -- # val= 00:05:51.326 22:58:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # IFS=: 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # read -r var val 00:05:51.326 22:58:17 -- accel/accel.sh@21 -- # val= 00:05:51.326 22:58:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # IFS=: 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # read -r var val 00:05:51.326 22:58:17 -- accel/accel.sh@21 -- # val= 00:05:51.326 22:58:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # IFS=: 00:05:51.326 22:58:17 -- accel/accel.sh@20 -- # read -r var val 00:05:51.326 22:58:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:51.326 22:58:17 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:51.326 22:58:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:51.326 00:05:51.326 real 0m2.933s 00:05:51.326 user 0m2.632s 00:05:51.326 sys 0m0.292s 00:05:51.326 22:58:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.326 22:58:17 -- common/autotest_common.sh@10 -- # set +x 00:05:51.326 ************************************ 00:05:51.326 END TEST accel_fill 00:05:51.326 ************************************ 00:05:51.604 22:58:17 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:51.604 22:58:17 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:51.604 22:58:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.604 22:58:17 -- common/autotest_common.sh@10 -- # set +x 00:05:51.604 ************************************ 00:05:51.604 START TEST accel_copy_crc32c 00:05:51.604 ************************************ 00:05:51.604 22:58:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:51.604 22:58:17 -- accel/accel.sh@16 -- # local accel_opc 00:05:51.604 22:58:17 -- accel/accel.sh@17 -- # local accel_module 00:05:51.604 22:58:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:51.604 22:58:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:51.604 22:58:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.604 22:58:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.604 22:58:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.605 22:58:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.605 22:58:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.605 22:58:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.605 22:58:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.605 22:58:17 -- accel/accel.sh@42 -- # jq -r . 00:05:51.605 [2024-11-26 22:58:17.731382] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.605 [2024-11-26 22:58:17.731457] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93205 ] 00:05:51.605 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.605 [2024-11-26 22:58:17.795167] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.605 [2024-11-26 22:58:17.909917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.038 22:58:19 -- accel/accel.sh@18 -- # out=' 00:05:53.038 SPDK Configuration: 00:05:53.038 Core mask: 0x1 00:05:53.038 00:05:53.038 Accel Perf Configuration: 00:05:53.038 Workload Type: copy_crc32c 00:05:53.038 CRC-32C seed: 0 00:05:53.038 Vector size: 4096 bytes 00:05:53.038 Transfer size: 4096 bytes 00:05:53.038 Vector count 1 00:05:53.038 Module: software 00:05:53.038 Queue depth: 32 00:05:53.038 Allocate depth: 32 00:05:53.038 # threads/core: 1 00:05:53.038 Run time: 1 seconds 00:05:53.038 Verify: Yes 00:05:53.038 00:05:53.038 Running for 1 seconds... 00:05:53.038 00:05:53.038 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.038 ------------------------------------------------------------------------------------ 00:05:53.038 0,0 219968/s 859 MiB/s 0 0 00:05:53.038 ==================================================================================== 00:05:53.038 Total 219968/s 859 MiB/s 0 0' 00:05:53.038 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.038 22:58:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:53.038 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.038 22:58:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:53.038 22:58:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.038 22:58:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.038 22:58:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.038 22:58:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.038 22:58:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.038 22:58:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.038 22:58:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.038 22:58:19 -- accel/accel.sh@42 -- # jq -r . 00:05:53.038 [2024-11-26 22:58:19.204339] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.038 [2024-11-26 22:58:19.204416] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93350 ] 00:05:53.038 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.038 [2024-11-26 22:58:19.267601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.038 [2024-11-26 22:58:19.383965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val= 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val= 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val=0x1 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val= 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val= 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val=0 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val= 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val=software 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val=32 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val=32 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val=1 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val=Yes 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val= 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.315 22:58:19 -- accel/accel.sh@21 -- # val= 00:05:53.315 22:58:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # IFS=: 00:05:53.315 22:58:19 -- accel/accel.sh@20 -- # read -r var val 00:05:54.318 22:58:20 -- accel/accel.sh@21 -- # val= 00:05:54.318 22:58:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.318 22:58:20 -- accel/accel.sh@20 -- # IFS=: 00:05:54.318 22:58:20 -- accel/accel.sh@20 -- # read -r var val 00:05:54.318 22:58:20 -- accel/accel.sh@21 -- # val= 00:05:54.318 22:58:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.318 22:58:20 -- accel/accel.sh@20 -- # IFS=: 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # read -r var val 00:05:54.319 22:58:20 -- accel/accel.sh@21 -- # val= 00:05:54.319 22:58:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # IFS=: 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # read -r var val 00:05:54.319 22:58:20 -- accel/accel.sh@21 -- # val= 00:05:54.319 22:58:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # IFS=: 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # read -r var val 00:05:54.319 22:58:20 -- accel/accel.sh@21 -- # val= 00:05:54.319 22:58:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # IFS=: 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # read -r var val 00:05:54.319 22:58:20 -- accel/accel.sh@21 -- # val= 00:05:54.319 22:58:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # IFS=: 00:05:54.319 22:58:20 -- accel/accel.sh@20 -- # read -r var val 00:05:54.319 22:58:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.319 22:58:20 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:54.319 22:58:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.319 00:05:54.319 real 0m2.946s 00:05:54.319 user 0m2.644s 00:05:54.319 sys 0m0.293s 00:05:54.319 22:58:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.319 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:05:54.319 ************************************ 00:05:54.319 END TEST accel_copy_crc32c 00:05:54.319 ************************************ 00:05:54.319 22:58:20 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:54.319 22:58:20 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:54.319 22:58:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.319 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:05:54.319 ************************************ 00:05:54.319 START TEST accel_copy_crc32c_C2 00:05:54.319 ************************************ 00:05:54.319 22:58:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:54.319 22:58:20 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.319 22:58:20 -- accel/accel.sh@17 -- # local accel_module 00:05:54.319 22:58:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:54.319 22:58:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:54.319 22:58:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.319 22:58:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.319 22:58:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.319 22:58:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.319 22:58:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.319 22:58:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.319 22:58:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.319 22:58:20 -- accel/accel.sh@42 -- # jq -r . 00:05:54.599 [2024-11-26 22:58:20.705803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.599 [2024-11-26 22:58:20.705891] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93516 ] 00:05:54.599 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.599 [2024-11-26 22:58:20.770327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.599 [2024-11-26 22:58:20.886978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.983 22:58:22 -- accel/accel.sh@18 -- # out=' 00:05:55.983 SPDK Configuration: 00:05:55.983 Core mask: 0x1 00:05:55.983 00:05:55.983 Accel Perf Configuration: 00:05:55.983 Workload Type: copy_crc32c 00:05:55.983 CRC-32C seed: 0 00:05:55.983 Vector size: 4096 bytes 00:05:55.983 Transfer size: 8192 bytes 00:05:55.983 Vector count 2 00:05:55.983 Module: software 00:05:55.983 Queue depth: 32 00:05:55.983 Allocate depth: 32 00:05:55.983 # threads/core: 1 00:05:55.983 Run time: 1 seconds 00:05:55.983 Verify: Yes 00:05:55.983 00:05:55.983 Running for 1 seconds... 00:05:55.983 00:05:55.983 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:55.983 ------------------------------------------------------------------------------------ 00:05:55.983 0,0 154656/s 1208 MiB/s 0 0 00:05:55.983 ==================================================================================== 00:05:55.983 Total 154656/s 604 MiB/s 0 0' 00:05:55.983 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:55.983 22:58:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:55.983 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:55.983 22:58:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:55.983 22:58:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.983 22:58:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.983 22:58:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.983 22:58:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.983 22:58:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.983 22:58:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.983 22:58:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.983 22:58:22 -- accel/accel.sh@42 -- # jq -r . 00:05:55.983 [2024-11-26 22:58:22.169396] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.983 [2024-11-26 22:58:22.169473] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93737 ] 00:05:55.983 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.983 [2024-11-26 22:58:22.227311] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.983 [2024-11-26 22:58:22.328595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val= 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val= 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val=0x1 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val= 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val= 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val=0 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val= 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val=software 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val=32 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val=32 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val=1 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val=Yes 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val= 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.242 22:58:22 -- accel/accel.sh@21 -- # val= 00:05:56.242 22:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:56.242 22:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:57.616 22:58:23 -- accel/accel.sh@21 -- # val= 00:05:57.616 22:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:57.616 22:58:23 -- accel/accel.sh@21 -- # val= 00:05:57.616 22:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:57.616 22:58:23 -- accel/accel.sh@21 -- # val= 00:05:57.616 22:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:57.616 22:58:23 -- accel/accel.sh@21 -- # val= 00:05:57.616 22:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:57.616 22:58:23 -- accel/accel.sh@21 -- # val= 00:05:57.616 22:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:57.616 22:58:23 -- accel/accel.sh@21 -- # val= 00:05:57.616 22:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:57.616 22:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:57.616 22:58:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.616 22:58:23 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:57.616 22:58:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.617 00:05:57.617 real 0m2.895s 00:05:57.617 user 0m2.610s 00:05:57.617 sys 0m0.275s 00:05:57.617 22:58:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.617 22:58:23 -- common/autotest_common.sh@10 -- # set +x 00:05:57.617 ************************************ 00:05:57.617 END TEST accel_copy_crc32c_C2 00:05:57.617 ************************************ 00:05:57.617 22:58:23 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:57.617 22:58:23 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:57.617 22:58:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.617 22:58:23 -- common/autotest_common.sh@10 -- # set +x 00:05:57.617 ************************************ 00:05:57.617 START TEST accel_dualcast 00:05:57.617 ************************************ 00:05:57.617 22:58:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:57.617 22:58:23 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.617 22:58:23 -- accel/accel.sh@17 -- # local accel_module 00:05:57.617 22:58:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:57.617 22:58:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:57.617 22:58:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.617 22:58:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.617 22:58:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.617 22:58:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.617 22:58:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.617 22:58:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.617 22:58:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.617 22:58:23 -- accel/accel.sh@42 -- # jq -r . 00:05:57.617 [2024-11-26 22:58:23.627890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.617 [2024-11-26 22:58:23.627965] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93962 ] 00:05:57.617 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.617 [2024-11-26 22:58:23.689684] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.617 [2024-11-26 22:58:23.806082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.993 22:58:25 -- accel/accel.sh@18 -- # out=' 00:05:58.993 SPDK Configuration: 00:05:58.993 Core mask: 0x1 00:05:58.993 00:05:58.993 Accel Perf Configuration: 00:05:58.993 Workload Type: dualcast 00:05:58.993 Transfer size: 4096 bytes 00:05:58.993 Vector count 1 00:05:58.993 Module: software 00:05:58.993 Queue depth: 32 00:05:58.993 Allocate depth: 32 00:05:58.993 # threads/core: 1 00:05:58.993 Run time: 1 seconds 00:05:58.993 Verify: Yes 00:05:58.993 00:05:58.993 Running for 1 seconds... 00:05:58.993 00:05:58.993 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:58.993 ------------------------------------------------------------------------------------ 00:05:58.993 0,0 300672/s 1174 MiB/s 0 0 00:05:58.993 ==================================================================================== 00:05:58.993 Total 300672/s 1174 MiB/s 0 0' 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:58.993 22:58:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.993 22:58:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.993 22:58:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.993 22:58:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.993 22:58:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.993 22:58:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.993 22:58:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.993 22:58:25 -- accel/accel.sh@42 -- # jq -r . 00:05:58.993 [2024-11-26 22:58:25.098637] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.993 [2024-11-26 22:58:25.098716] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94100 ] 00:05:58.993 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.993 [2024-11-26 22:58:25.161750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.993 [2024-11-26 22:58:25.277829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val= 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val= 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val=0x1 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val= 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val= 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val=dualcast 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val= 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val=software 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@23 -- # accel_module=software 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val=32 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val=32 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val=1 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val=Yes 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val= 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.993 22:58:25 -- accel/accel.sh@21 -- # val= 00:05:58.993 22:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.993 22:58:25 -- accel/accel.sh@20 -- # read -r var val 00:06:00.370 22:58:26 -- accel/accel.sh@21 -- # val= 00:06:00.370 22:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # IFS=: 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # read -r var val 00:06:00.370 22:58:26 -- accel/accel.sh@21 -- # val= 00:06:00.370 22:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # IFS=: 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # read -r var val 00:06:00.370 22:58:26 -- accel/accel.sh@21 -- # val= 00:06:00.370 22:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # IFS=: 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # read -r var val 00:06:00.370 22:58:26 -- accel/accel.sh@21 -- # val= 00:06:00.370 22:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # IFS=: 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # read -r var val 00:06:00.370 22:58:26 -- accel/accel.sh@21 -- # val= 00:06:00.370 22:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # IFS=: 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # read -r var val 00:06:00.370 22:58:26 -- accel/accel.sh@21 -- # val= 00:06:00.370 22:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # IFS=: 00:06:00.370 22:58:26 -- accel/accel.sh@20 -- # read -r var val 00:06:00.370 22:58:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:00.370 22:58:26 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:00.370 22:58:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.370 00:06:00.370 real 0m2.946s 00:06:00.370 user 0m2.645s 00:06:00.370 sys 0m0.292s 00:06:00.370 22:58:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.370 22:58:26 -- common/autotest_common.sh@10 -- # set +x 00:06:00.370 ************************************ 00:06:00.370 END TEST accel_dualcast 00:06:00.370 ************************************ 00:06:00.370 22:58:26 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:00.370 22:58:26 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:00.370 22:58:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.370 22:58:26 -- common/autotest_common.sh@10 -- # set +x 00:06:00.370 ************************************ 00:06:00.370 START TEST accel_compare 00:06:00.370 ************************************ 00:06:00.370 22:58:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:06:00.370 22:58:26 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.370 22:58:26 -- accel/accel.sh@17 -- # local accel_module 00:06:00.370 22:58:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:00.370 22:58:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:00.370 22:58:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.370 22:58:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.370 22:58:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.370 22:58:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.370 22:58:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.370 22:58:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.370 22:58:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.370 22:58:26 -- accel/accel.sh@42 -- # jq -r . 00:06:00.370 [2024-11-26 22:58:26.602077] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.370 [2024-11-26 22:58:26.602154] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94261 ] 00:06:00.370 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.370 [2024-11-26 22:58:26.665289] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.628 [2024-11-26 22:58:26.780971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.011 22:58:28 -- accel/accel.sh@18 -- # out=' 00:06:02.011 SPDK Configuration: 00:06:02.011 Core mask: 0x1 00:06:02.011 00:06:02.011 Accel Perf Configuration: 00:06:02.011 Workload Type: compare 00:06:02.011 Transfer size: 4096 bytes 00:06:02.011 Vector count 1 00:06:02.011 Module: software 00:06:02.011 Queue depth: 32 00:06:02.011 Allocate depth: 32 00:06:02.011 # threads/core: 1 00:06:02.011 Run time: 1 seconds 00:06:02.011 Verify: Yes 00:06:02.011 00:06:02.011 Running for 1 seconds... 00:06:02.011 00:06:02.011 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.011 ------------------------------------------------------------------------------------ 00:06:02.011 0,0 398784/s 1557 MiB/s 0 0 00:06:02.011 ==================================================================================== 00:06:02.011 Total 398784/s 1557 MiB/s 0 0' 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 22:58:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 22:58:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:02.011 22:58:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.011 22:58:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.011 22:58:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.011 22:58:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.011 22:58:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.011 22:58:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.011 22:58:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.011 22:58:28 -- accel/accel.sh@42 -- # jq -r . 00:06:02.011 [2024-11-26 22:58:28.058816] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.011 [2024-11-26 22:58:28.058913] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94528 ] 00:06:02.011 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.011 [2024-11-26 22:58:28.121736] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.011 [2024-11-26 22:58:28.238125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.011 22:58:28 -- accel/accel.sh@21 -- # val= 00:06:02.011 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 22:58:28 -- accel/accel.sh@21 -- # val= 00:06:02.011 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 22:58:28 -- accel/accel.sh@21 -- # val=0x1 00:06:02.011 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 22:58:28 -- accel/accel.sh@21 -- # val= 00:06:02.011 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 22:58:28 -- accel/accel.sh@21 -- # val= 00:06:02.011 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 22:58:28 -- accel/accel.sh@21 -- # val=compare 00:06:02.011 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 22:58:28 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 22:58:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val= 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val=software 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val=32 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val=32 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val=1 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val=Yes 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val= 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:02.012 22:58:28 -- accel/accel.sh@21 -- # val= 00:06:02.012 22:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # IFS=: 00:06:02.012 22:58:28 -- accel/accel.sh@20 -- # read -r var val 00:06:03.387 22:58:29 -- accel/accel.sh@21 -- # val= 00:06:03.387 22:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # IFS=: 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # read -r var val 00:06:03.387 22:58:29 -- accel/accel.sh@21 -- # val= 00:06:03.387 22:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # IFS=: 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # read -r var val 00:06:03.387 22:58:29 -- accel/accel.sh@21 -- # val= 00:06:03.387 22:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # IFS=: 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # read -r var val 00:06:03.387 22:58:29 -- accel/accel.sh@21 -- # val= 00:06:03.387 22:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # IFS=: 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # read -r var val 00:06:03.387 22:58:29 -- accel/accel.sh@21 -- # val= 00:06:03.387 22:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # IFS=: 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # read -r var val 00:06:03.387 22:58:29 -- accel/accel.sh@21 -- # val= 00:06:03.387 22:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # IFS=: 00:06:03.387 22:58:29 -- accel/accel.sh@20 -- # read -r var val 00:06:03.387 22:58:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:03.387 22:58:29 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:03.387 22:58:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.387 00:06:03.387 real 0m2.929s 00:06:03.387 user 0m2.626s 00:06:03.387 sys 0m0.294s 00:06:03.387 22:58:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.387 22:58:29 -- common/autotest_common.sh@10 -- # set +x 00:06:03.387 ************************************ 00:06:03.387 END TEST accel_compare 00:06:03.387 ************************************ 00:06:03.387 22:58:29 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:03.387 22:58:29 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:03.387 22:58:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.387 22:58:29 -- common/autotest_common.sh@10 -- # set +x 00:06:03.387 ************************************ 00:06:03.387 START TEST accel_xor 00:06:03.387 ************************************ 00:06:03.387 22:58:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:03.387 22:58:29 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.387 22:58:29 -- accel/accel.sh@17 -- # local accel_module 00:06:03.387 22:58:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:03.387 22:58:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:03.387 22:58:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.387 22:58:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.387 22:58:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.387 22:58:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.387 22:58:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.387 22:58:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.387 22:58:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.387 22:58:29 -- accel/accel.sh@42 -- # jq -r . 00:06:03.387 [2024-11-26 22:58:29.561818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.387 [2024-11-26 22:58:29.561922] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94689 ] 00:06:03.387 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.387 [2024-11-26 22:58:29.627595] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.387 [2024-11-26 22:58:29.741741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.761 22:58:31 -- accel/accel.sh@18 -- # out=' 00:06:04.761 SPDK Configuration: 00:06:04.761 Core mask: 0x1 00:06:04.761 00:06:04.761 Accel Perf Configuration: 00:06:04.761 Workload Type: xor 00:06:04.761 Source buffers: 2 00:06:04.761 Transfer size: 4096 bytes 00:06:04.761 Vector count 1 00:06:04.761 Module: software 00:06:04.761 Queue depth: 32 00:06:04.761 Allocate depth: 32 00:06:04.761 # threads/core: 1 00:06:04.761 Run time: 1 seconds 00:06:04.761 Verify: Yes 00:06:04.761 00:06:04.761 Running for 1 seconds... 00:06:04.761 00:06:04.761 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:04.761 ------------------------------------------------------------------------------------ 00:06:04.761 0,0 190400/s 743 MiB/s 0 0 00:06:04.761 ==================================================================================== 00:06:04.761 Total 190400/s 743 MiB/s 0 0' 00:06:04.761 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:04.761 22:58:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:04.761 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:04.761 22:58:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:04.761 22:58:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.761 22:58:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.761 22:58:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.761 22:58:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.761 22:58:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.761 22:58:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.761 22:58:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.761 22:58:31 -- accel/accel.sh@42 -- # jq -r . 00:06:04.761 [2024-11-26 22:58:31.037886] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.761 [2024-11-26 22:58:31.037965] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94827 ] 00:06:04.761 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.761 [2024-11-26 22:58:31.099938] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.020 [2024-11-26 22:58:31.217689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val= 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val= 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val=0x1 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val= 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val= 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val=xor 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val=2 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val= 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val=software 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val=32 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val=32 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val=1 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val=Yes 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val= 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:05.020 22:58:31 -- accel/accel.sh@21 -- # val= 00:06:05.020 22:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # IFS=: 00:06:05.020 22:58:31 -- accel/accel.sh@20 -- # read -r var val 00:06:06.394 22:58:32 -- accel/accel.sh@21 -- # val= 00:06:06.394 22:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.394 22:58:32 -- accel/accel.sh@20 -- # IFS=: 00:06:06.394 22:58:32 -- accel/accel.sh@20 -- # read -r var val 00:06:06.394 22:58:32 -- accel/accel.sh@21 -- # val= 00:06:06.394 22:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.394 22:58:32 -- accel/accel.sh@20 -- # IFS=: 00:06:06.394 22:58:32 -- accel/accel.sh@20 -- # read -r var val 00:06:06.394 22:58:32 -- accel/accel.sh@21 -- # val= 00:06:06.394 22:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.394 22:58:32 -- accel/accel.sh@20 -- # IFS=: 00:06:06.394 22:58:32 -- accel/accel.sh@20 -- # read -r var val 00:06:06.395 22:58:32 -- accel/accel.sh@21 -- # val= 00:06:06.395 22:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.395 22:58:32 -- accel/accel.sh@20 -- # IFS=: 00:06:06.395 22:58:32 -- accel/accel.sh@20 -- # read -r var val 00:06:06.395 22:58:32 -- accel/accel.sh@21 -- # val= 00:06:06.395 22:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.395 22:58:32 -- accel/accel.sh@20 -- # IFS=: 00:06:06.395 22:58:32 -- accel/accel.sh@20 -- # read -r var val 00:06:06.395 22:58:32 -- accel/accel.sh@21 -- # val= 00:06:06.395 22:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.395 22:58:32 -- accel/accel.sh@20 -- # IFS=: 00:06:06.395 22:58:32 -- accel/accel.sh@20 -- # read -r var val 00:06:06.395 22:58:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:06.395 22:58:32 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:06.395 22:58:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.395 00:06:06.395 real 0m2.938s 00:06:06.395 user 0m2.640s 00:06:06.395 sys 0m0.288s 00:06:06.395 22:58:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.395 22:58:32 -- common/autotest_common.sh@10 -- # set +x 00:06:06.395 ************************************ 00:06:06.395 END TEST accel_xor 00:06:06.395 ************************************ 00:06:06.395 22:58:32 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:06.395 22:58:32 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:06.395 22:58:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.395 22:58:32 -- common/autotest_common.sh@10 -- # set +x 00:06:06.395 ************************************ 00:06:06.395 START TEST accel_xor 00:06:06.395 ************************************ 00:06:06.395 22:58:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:06.395 22:58:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.395 22:58:32 -- accel/accel.sh@17 -- # local accel_module 00:06:06.395 22:58:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:06.395 22:58:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:06.395 22:58:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.395 22:58:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.395 22:58:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.395 22:58:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.395 22:58:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.395 22:58:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.395 22:58:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.395 22:58:32 -- accel/accel.sh@42 -- # jq -r . 00:06:06.395 [2024-11-26 22:58:32.516152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.395 [2024-11-26 22:58:32.516234] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95115 ] 00:06:06.395 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.395 [2024-11-26 22:58:32.575915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.395 [2024-11-26 22:58:32.694764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.766 22:58:33 -- accel/accel.sh@18 -- # out=' 00:06:07.766 SPDK Configuration: 00:06:07.766 Core mask: 0x1 00:06:07.766 00:06:07.766 Accel Perf Configuration: 00:06:07.766 Workload Type: xor 00:06:07.766 Source buffers: 3 00:06:07.766 Transfer size: 4096 bytes 00:06:07.766 Vector count 1 00:06:07.766 Module: software 00:06:07.766 Queue depth: 32 00:06:07.766 Allocate depth: 32 00:06:07.766 # threads/core: 1 00:06:07.766 Run time: 1 seconds 00:06:07.766 Verify: Yes 00:06:07.766 00:06:07.766 Running for 1 seconds... 00:06:07.766 00:06:07.766 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:07.766 ------------------------------------------------------------------------------------ 00:06:07.766 0,0 183520/s 716 MiB/s 0 0 00:06:07.766 ==================================================================================== 00:06:07.766 Total 183520/s 716 MiB/s 0 0' 00:06:07.766 22:58:33 -- accel/accel.sh@20 -- # IFS=: 00:06:07.766 22:58:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:07.766 22:58:33 -- accel/accel.sh@20 -- # read -r var val 00:06:07.766 22:58:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:07.766 22:58:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.766 22:58:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.766 22:58:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.766 22:58:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.766 22:58:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.766 22:58:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.766 22:58:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.766 22:58:33 -- accel/accel.sh@42 -- # jq -r . 00:06:07.766 [2024-11-26 22:58:33.985491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.766 [2024-11-26 22:58:33.985580] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95258 ] 00:06:07.766 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.766 [2024-11-26 22:58:34.048498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.025 [2024-11-26 22:58:34.165555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.025 22:58:34 -- accel/accel.sh@21 -- # val= 00:06:08.025 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.025 22:58:34 -- accel/accel.sh@21 -- # val= 00:06:08.025 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.025 22:58:34 -- accel/accel.sh@21 -- # val=0x1 00:06:08.025 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.025 22:58:34 -- accel/accel.sh@21 -- # val= 00:06:08.025 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.025 22:58:34 -- accel/accel.sh@21 -- # val= 00:06:08.025 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.025 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.025 22:58:34 -- accel/accel.sh@21 -- # val=xor 00:06:08.025 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val=3 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val= 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val=software 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val=32 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val=32 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val=1 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val=Yes 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val= 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:08.026 22:58:34 -- accel/accel.sh@21 -- # val= 00:06:08.026 22:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # IFS=: 00:06:08.026 22:58:34 -- accel/accel.sh@20 -- # read -r var val 00:06:09.401 22:58:35 -- accel/accel.sh@21 -- # val= 00:06:09.401 22:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # IFS=: 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # read -r var val 00:06:09.401 22:58:35 -- accel/accel.sh@21 -- # val= 00:06:09.401 22:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # IFS=: 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # read -r var val 00:06:09.401 22:58:35 -- accel/accel.sh@21 -- # val= 00:06:09.401 22:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # IFS=: 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # read -r var val 00:06:09.401 22:58:35 -- accel/accel.sh@21 -- # val= 00:06:09.401 22:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # IFS=: 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # read -r var val 00:06:09.401 22:58:35 -- accel/accel.sh@21 -- # val= 00:06:09.401 22:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # IFS=: 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # read -r var val 00:06:09.401 22:58:35 -- accel/accel.sh@21 -- # val= 00:06:09.401 22:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # IFS=: 00:06:09.401 22:58:35 -- accel/accel.sh@20 -- # read -r var val 00:06:09.401 22:58:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:09.401 22:58:35 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:09.401 22:58:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:09.401 00:06:09.401 real 0m2.940s 00:06:09.401 user 0m2.639s 00:06:09.401 sys 0m0.291s 00:06:09.401 22:58:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.401 22:58:35 -- common/autotest_common.sh@10 -- # set +x 00:06:09.401 ************************************ 00:06:09.401 END TEST accel_xor 00:06:09.401 ************************************ 00:06:09.401 22:58:35 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:09.401 22:58:35 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:09.401 22:58:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.401 22:58:35 -- common/autotest_common.sh@10 -- # set +x 00:06:09.401 ************************************ 00:06:09.401 START TEST accel_dif_verify 00:06:09.401 ************************************ 00:06:09.401 22:58:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:09.401 22:58:35 -- accel/accel.sh@16 -- # local accel_opc 00:06:09.401 22:58:35 -- accel/accel.sh@17 -- # local accel_module 00:06:09.401 22:58:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:09.401 22:58:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:09.401 22:58:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.401 22:58:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.401 22:58:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.401 22:58:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.401 22:58:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.401 22:58:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.401 22:58:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.401 22:58:35 -- accel/accel.sh@42 -- # jq -r . 00:06:09.401 [2024-11-26 22:58:35.484434] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.401 [2024-11-26 22:58:35.484510] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95413 ] 00:06:09.401 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.401 [2024-11-26 22:58:35.546131] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.401 [2024-11-26 22:58:35.662333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.777 22:58:36 -- accel/accel.sh@18 -- # out=' 00:06:10.777 SPDK Configuration: 00:06:10.777 Core mask: 0x1 00:06:10.777 00:06:10.777 Accel Perf Configuration: 00:06:10.777 Workload Type: dif_verify 00:06:10.777 Vector size: 4096 bytes 00:06:10.777 Transfer size: 4096 bytes 00:06:10.777 Block size: 512 bytes 00:06:10.777 Metadata size: 8 bytes 00:06:10.777 Vector count 1 00:06:10.777 Module: software 00:06:10.777 Queue depth: 32 00:06:10.777 Allocate depth: 32 00:06:10.777 # threads/core: 1 00:06:10.777 Run time: 1 seconds 00:06:10.777 Verify: No 00:06:10.777 00:06:10.777 Running for 1 seconds... 00:06:10.777 00:06:10.777 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:10.777 ------------------------------------------------------------------------------------ 00:06:10.777 0,0 81376/s 322 MiB/s 0 0 00:06:10.777 ==================================================================================== 00:06:10.777 Total 81376/s 317 MiB/s 0 0' 00:06:10.777 22:58:36 -- accel/accel.sh@20 -- # IFS=: 00:06:10.777 22:58:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:10.777 22:58:36 -- accel/accel.sh@20 -- # read -r var val 00:06:10.777 22:58:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:10.777 22:58:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.777 22:58:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.777 22:58:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.777 22:58:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.777 22:58:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.777 22:58:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.777 22:58:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.777 22:58:36 -- accel/accel.sh@42 -- # jq -r . 00:06:10.777 [2024-11-26 22:58:36.949199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:10.777 [2024-11-26 22:58:36.949277] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95656 ] 00:06:10.777 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.777 [2024-11-26 22:58:37.011648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.777 [2024-11-26 22:58:37.130946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val= 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val= 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val=0x1 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val= 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val= 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val=dif_verify 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val= 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val=software 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val=32 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val=32 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val=1 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val=No 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val= 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:11.036 22:58:37 -- accel/accel.sh@21 -- # val= 00:06:11.036 22:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # IFS=: 00:06:11.036 22:58:37 -- accel/accel.sh@20 -- # read -r var val 00:06:12.410 22:58:38 -- accel/accel.sh@21 -- # val= 00:06:12.410 22:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # IFS=: 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # read -r var val 00:06:12.410 22:58:38 -- accel/accel.sh@21 -- # val= 00:06:12.410 22:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # IFS=: 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # read -r var val 00:06:12.410 22:58:38 -- accel/accel.sh@21 -- # val= 00:06:12.410 22:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # IFS=: 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # read -r var val 00:06:12.410 22:58:38 -- accel/accel.sh@21 -- # val= 00:06:12.410 22:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # IFS=: 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # read -r var val 00:06:12.410 22:58:38 -- accel/accel.sh@21 -- # val= 00:06:12.410 22:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # IFS=: 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # read -r var val 00:06:12.410 22:58:38 -- accel/accel.sh@21 -- # val= 00:06:12.410 22:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # IFS=: 00:06:12.410 22:58:38 -- accel/accel.sh@20 -- # read -r var val 00:06:12.410 22:58:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:12.410 22:58:38 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:12.410 22:58:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:12.410 00:06:12.410 real 0m2.929s 00:06:12.410 user 0m2.626s 00:06:12.410 sys 0m0.296s 00:06:12.410 22:58:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.410 22:58:38 -- common/autotest_common.sh@10 -- # set +x 00:06:12.410 ************************************ 00:06:12.410 END TEST accel_dif_verify 00:06:12.410 ************************************ 00:06:12.410 22:58:38 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:12.410 22:58:38 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:12.410 22:58:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.410 22:58:38 -- common/autotest_common.sh@10 -- # set +x 00:06:12.410 ************************************ 00:06:12.410 START TEST accel_dif_generate 00:06:12.410 ************************************ 00:06:12.410 22:58:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:12.410 22:58:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.410 22:58:38 -- accel/accel.sh@17 -- # local accel_module 00:06:12.411 22:58:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:12.411 22:58:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:12.411 22:58:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.411 22:58:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.411 22:58:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.411 22:58:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.411 22:58:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.411 22:58:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.411 22:58:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.411 22:58:38 -- accel/accel.sh@42 -- # jq -r . 00:06:12.411 [2024-11-26 22:58:38.434986] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.411 [2024-11-26 22:58:38.435054] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95840 ] 00:06:12.411 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.411 [2024-11-26 22:58:38.496689] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.411 [2024-11-26 22:58:38.613250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.786 22:58:39 -- accel/accel.sh@18 -- # out=' 00:06:13.786 SPDK Configuration: 00:06:13.786 Core mask: 0x1 00:06:13.786 00:06:13.786 Accel Perf Configuration: 00:06:13.786 Workload Type: dif_generate 00:06:13.786 Vector size: 4096 bytes 00:06:13.786 Transfer size: 4096 bytes 00:06:13.786 Block size: 512 bytes 00:06:13.786 Metadata size: 8 bytes 00:06:13.786 Vector count 1 00:06:13.786 Module: software 00:06:13.786 Queue depth: 32 00:06:13.786 Allocate depth: 32 00:06:13.786 # threads/core: 1 00:06:13.786 Run time: 1 seconds 00:06:13.786 Verify: No 00:06:13.786 00:06:13.786 Running for 1 seconds... 00:06:13.786 00:06:13.786 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:13.786 ------------------------------------------------------------------------------------ 00:06:13.786 0,0 96192/s 381 MiB/s 0 0 00:06:13.786 ==================================================================================== 00:06:13.786 Total 96192/s 375 MiB/s 0 0' 00:06:13.786 22:58:39 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:13.786 22:58:39 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:13.786 22:58:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.786 22:58:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.786 22:58:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.786 22:58:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.786 22:58:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.786 22:58:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.786 22:58:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.786 22:58:39 -- accel/accel.sh@42 -- # jq -r . 00:06:13.786 [2024-11-26 22:58:39.905674] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.786 [2024-11-26 22:58:39.905754] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95985 ] 00:06:13.786 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.786 [2024-11-26 22:58:39.967013] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.786 [2024-11-26 22:58:40.092975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val= 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val= 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val=0x1 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val= 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val= 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val=dif_generate 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val= 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val=software 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@23 -- # accel_module=software 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val=32 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val=32 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val=1 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val=No 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.786 22:58:40 -- accel/accel.sh@21 -- # val= 00:06:13.786 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.786 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:13.787 22:58:40 -- accel/accel.sh@21 -- # val= 00:06:13.787 22:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.787 22:58:40 -- accel/accel.sh@20 -- # IFS=: 00:06:13.787 22:58:40 -- accel/accel.sh@20 -- # read -r var val 00:06:15.162 22:58:41 -- accel/accel.sh@21 -- # val= 00:06:15.162 22:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # IFS=: 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # read -r var val 00:06:15.162 22:58:41 -- accel/accel.sh@21 -- # val= 00:06:15.162 22:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # IFS=: 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # read -r var val 00:06:15.162 22:58:41 -- accel/accel.sh@21 -- # val= 00:06:15.162 22:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # IFS=: 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # read -r var val 00:06:15.162 22:58:41 -- accel/accel.sh@21 -- # val= 00:06:15.162 22:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # IFS=: 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # read -r var val 00:06:15.162 22:58:41 -- accel/accel.sh@21 -- # val= 00:06:15.162 22:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # IFS=: 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # read -r var val 00:06:15.162 22:58:41 -- accel/accel.sh@21 -- # val= 00:06:15.162 22:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # IFS=: 00:06:15.162 22:58:41 -- accel/accel.sh@20 -- # read -r var val 00:06:15.162 22:58:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:15.162 22:58:41 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:15.162 22:58:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:15.162 00:06:15.162 real 0m2.955s 00:06:15.162 user 0m2.661s 00:06:15.162 sys 0m0.288s 00:06:15.162 22:58:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.162 22:58:41 -- common/autotest_common.sh@10 -- # set +x 00:06:15.162 ************************************ 00:06:15.162 END TEST accel_dif_generate 00:06:15.162 ************************************ 00:06:15.162 22:58:41 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:15.162 22:58:41 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:15.162 22:58:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.162 22:58:41 -- common/autotest_common.sh@10 -- # set +x 00:06:15.162 ************************************ 00:06:15.162 START TEST accel_dif_generate_copy 00:06:15.162 ************************************ 00:06:15.162 22:58:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:15.162 22:58:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.162 22:58:41 -- accel/accel.sh@17 -- # local accel_module 00:06:15.162 22:58:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:15.162 22:58:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:15.162 22:58:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.162 22:58:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.162 22:58:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.162 22:58:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.162 22:58:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.162 22:58:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.162 22:58:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.162 22:58:41 -- accel/accel.sh@42 -- # jq -r . 00:06:15.162 [2024-11-26 22:58:41.418154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.162 [2024-11-26 22:58:41.418230] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96151 ] 00:06:15.162 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.162 [2024-11-26 22:58:41.481021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.421 [2024-11-26 22:58:41.597883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.799 22:58:42 -- accel/accel.sh@18 -- # out=' 00:06:16.799 SPDK Configuration: 00:06:16.799 Core mask: 0x1 00:06:16.799 00:06:16.799 Accel Perf Configuration: 00:06:16.799 Workload Type: dif_generate_copy 00:06:16.799 Vector size: 4096 bytes 00:06:16.799 Transfer size: 4096 bytes 00:06:16.799 Vector count 1 00:06:16.799 Module: software 00:06:16.799 Queue depth: 32 00:06:16.799 Allocate depth: 32 00:06:16.799 # threads/core: 1 00:06:16.799 Run time: 1 seconds 00:06:16.799 Verify: No 00:06:16.799 00:06:16.799 Running for 1 seconds... 00:06:16.799 00:06:16.799 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:16.799 ------------------------------------------------------------------------------------ 00:06:16.799 0,0 76672/s 304 MiB/s 0 0 00:06:16.799 ==================================================================================== 00:06:16.799 Total 76672/s 299 MiB/s 0 0' 00:06:16.799 22:58:42 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:16.799 22:58:42 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:16.799 22:58:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.799 22:58:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.799 22:58:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.799 22:58:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.799 22:58:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.799 22:58:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.799 22:58:42 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.799 22:58:42 -- accel/accel.sh@42 -- # jq -r . 00:06:16.799 [2024-11-26 22:58:42.886740] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.799 [2024-11-26 22:58:42.886842] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96411 ] 00:06:16.799 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.799 [2024-11-26 22:58:42.948460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.799 [2024-11-26 22:58:43.063476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val= 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val= 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val=0x1 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val= 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val= 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val= 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val=software 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@23 -- # accel_module=software 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val=32 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val=32 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val=1 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val=No 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val= 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:16.799 22:58:43 -- accel/accel.sh@21 -- # val= 00:06:16.799 22:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # IFS=: 00:06:16.799 22:58:43 -- accel/accel.sh@20 -- # read -r var val 00:06:18.177 22:58:44 -- accel/accel.sh@21 -- # val= 00:06:18.177 22:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # IFS=: 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # read -r var val 00:06:18.177 22:58:44 -- accel/accel.sh@21 -- # val= 00:06:18.177 22:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # IFS=: 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # read -r var val 00:06:18.177 22:58:44 -- accel/accel.sh@21 -- # val= 00:06:18.177 22:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # IFS=: 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # read -r var val 00:06:18.177 22:58:44 -- accel/accel.sh@21 -- # val= 00:06:18.177 22:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # IFS=: 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # read -r var val 00:06:18.177 22:58:44 -- accel/accel.sh@21 -- # val= 00:06:18.177 22:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # IFS=: 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # read -r var val 00:06:18.177 22:58:44 -- accel/accel.sh@21 -- # val= 00:06:18.177 22:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # IFS=: 00:06:18.177 22:58:44 -- accel/accel.sh@20 -- # read -r var val 00:06:18.177 22:58:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:18.177 22:58:44 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:18.177 22:58:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.177 00:06:18.177 real 0m2.942s 00:06:18.177 user 0m2.644s 00:06:18.177 sys 0m0.288s 00:06:18.177 22:58:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.177 22:58:44 -- common/autotest_common.sh@10 -- # set +x 00:06:18.177 ************************************ 00:06:18.177 END TEST accel_dif_generate_copy 00:06:18.177 ************************************ 00:06:18.177 22:58:44 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:18.177 22:58:44 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.177 22:58:44 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:18.177 22:58:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.177 22:58:44 -- common/autotest_common.sh@10 -- # set +x 00:06:18.177 ************************************ 00:06:18.177 START TEST accel_comp 00:06:18.177 ************************************ 00:06:18.177 22:58:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.177 22:58:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.177 22:58:44 -- accel/accel.sh@17 -- # local accel_module 00:06:18.177 22:58:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.177 22:58:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.177 22:58:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.177 22:58:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.177 22:58:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.177 22:58:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.177 22:58:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.177 22:58:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.177 22:58:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.177 22:58:44 -- accel/accel.sh@42 -- # jq -r . 00:06:18.177 [2024-11-26 22:58:44.384155] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.177 [2024-11-26 22:58:44.384237] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96566 ] 00:06:18.177 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.177 [2024-11-26 22:58:44.449730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.177 [2024-11-26 22:58:44.566952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.553 22:58:45 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:19.553 00:06:19.553 SPDK Configuration: 00:06:19.553 Core mask: 0x1 00:06:19.553 00:06:19.553 Accel Perf Configuration: 00:06:19.553 Workload Type: compress 00:06:19.553 Transfer size: 4096 bytes 00:06:19.553 Vector count 1 00:06:19.553 Module: software 00:06:19.553 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.553 Queue depth: 32 00:06:19.553 Allocate depth: 32 00:06:19.553 # threads/core: 1 00:06:19.553 Run time: 1 seconds 00:06:19.553 Verify: No 00:06:19.553 00:06:19.553 Running for 1 seconds... 00:06:19.553 00:06:19.553 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:19.553 ------------------------------------------------------------------------------------ 00:06:19.553 0,0 31584/s 131 MiB/s 0 0 00:06:19.553 ==================================================================================== 00:06:19.553 Total 31584/s 123 MiB/s 0 0' 00:06:19.553 22:58:45 -- accel/accel.sh@20 -- # IFS=: 00:06:19.553 22:58:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.553 22:58:45 -- accel/accel.sh@20 -- # read -r var val 00:06:19.553 22:58:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.553 22:58:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.553 22:58:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.553 22:58:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.553 22:58:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.553 22:58:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.553 22:58:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.553 22:58:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.553 22:58:45 -- accel/accel.sh@42 -- # jq -r . 00:06:19.553 [2024-11-26 22:58:45.865028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.553 [2024-11-26 22:58:45.865106] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96712 ] 00:06:19.553 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.553 [2024-11-26 22:58:45.927426] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.812 [2024-11-26 22:58:46.043061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val= 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val= 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val= 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val=0x1 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val= 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val= 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val=compress 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val= 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val=software 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.812 22:58:46 -- accel/accel.sh@23 -- # accel_module=software 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.812 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.812 22:58:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.812 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.813 22:58:46 -- accel/accel.sh@21 -- # val=32 00:06:19.813 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.813 22:58:46 -- accel/accel.sh@21 -- # val=32 00:06:19.813 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.813 22:58:46 -- accel/accel.sh@21 -- # val=1 00:06:19.813 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.813 22:58:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:19.813 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.813 22:58:46 -- accel/accel.sh@21 -- # val=No 00:06:19.813 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.813 22:58:46 -- accel/accel.sh@21 -- # val= 00:06:19.813 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:19.813 22:58:46 -- accel/accel.sh@21 -- # val= 00:06:19.813 22:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # IFS=: 00:06:19.813 22:58:46 -- accel/accel.sh@20 -- # read -r var val 00:06:21.189 22:58:47 -- accel/accel.sh@21 -- # val= 00:06:21.189 22:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.189 22:58:47 -- accel/accel.sh@20 -- # IFS=: 00:06:21.189 22:58:47 -- accel/accel.sh@20 -- # read -r var val 00:06:21.189 22:58:47 -- accel/accel.sh@21 -- # val= 00:06:21.189 22:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.189 22:58:47 -- accel/accel.sh@20 -- # IFS=: 00:06:21.189 22:58:47 -- accel/accel.sh@20 -- # read -r var val 00:06:21.189 22:58:47 -- accel/accel.sh@21 -- # val= 00:06:21.189 22:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.189 22:58:47 -- accel/accel.sh@20 -- # IFS=: 00:06:21.189 22:58:47 -- accel/accel.sh@20 -- # read -r var val 00:06:21.190 22:58:47 -- accel/accel.sh@21 -- # val= 00:06:21.190 22:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.190 22:58:47 -- accel/accel.sh@20 -- # IFS=: 00:06:21.190 22:58:47 -- accel/accel.sh@20 -- # read -r var val 00:06:21.190 22:58:47 -- accel/accel.sh@21 -- # val= 00:06:21.190 22:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.190 22:58:47 -- accel/accel.sh@20 -- # IFS=: 00:06:21.190 22:58:47 -- accel/accel.sh@20 -- # read -r var val 00:06:21.190 22:58:47 -- accel/accel.sh@21 -- # val= 00:06:21.190 22:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.190 22:58:47 -- accel/accel.sh@20 -- # IFS=: 00:06:21.190 22:58:47 -- accel/accel.sh@20 -- # read -r var val 00:06:21.190 22:58:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:21.190 22:58:47 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:21.190 22:58:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:21.190 00:06:21.190 real 0m2.950s 00:06:21.190 user 0m2.651s 00:06:21.190 sys 0m0.290s 00:06:21.190 22:58:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.190 22:58:47 -- common/autotest_common.sh@10 -- # set +x 00:06:21.190 ************************************ 00:06:21.190 END TEST accel_comp 00:06:21.190 ************************************ 00:06:21.190 22:58:47 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:21.190 22:58:47 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:21.190 22:58:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.190 22:58:47 -- common/autotest_common.sh@10 -- # set +x 00:06:21.190 ************************************ 00:06:21.190 START TEST accel_decomp 00:06:21.190 ************************************ 00:06:21.190 22:58:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:21.190 22:58:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.190 22:58:47 -- accel/accel.sh@17 -- # local accel_module 00:06:21.190 22:58:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:21.190 22:58:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:21.190 22:58:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.190 22:58:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.190 22:58:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.190 22:58:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.190 22:58:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.190 22:58:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.190 22:58:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.190 22:58:47 -- accel/accel.sh@42 -- # jq -r . 00:06:21.190 [2024-11-26 22:58:47.357770] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.190 [2024-11-26 22:58:47.357857] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96984 ] 00:06:21.190 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.190 [2024-11-26 22:58:47.421305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.190 [2024-11-26 22:58:47.545195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.567 22:58:48 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:22.567 00:06:22.567 SPDK Configuration: 00:06:22.567 Core mask: 0x1 00:06:22.567 00:06:22.567 Accel Perf Configuration: 00:06:22.567 Workload Type: decompress 00:06:22.567 Transfer size: 4096 bytes 00:06:22.567 Vector count 1 00:06:22.567 Module: software 00:06:22.567 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.567 Queue depth: 32 00:06:22.567 Allocate depth: 32 00:06:22.567 # threads/core: 1 00:06:22.567 Run time: 1 seconds 00:06:22.567 Verify: Yes 00:06:22.567 00:06:22.567 Running for 1 seconds... 00:06:22.567 00:06:22.567 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:22.567 ------------------------------------------------------------------------------------ 00:06:22.567 0,0 56096/s 103 MiB/s 0 0 00:06:22.567 ==================================================================================== 00:06:22.567 Total 56096/s 219 MiB/s 0 0' 00:06:22.567 22:58:48 -- accel/accel.sh@20 -- # IFS=: 00:06:22.567 22:58:48 -- accel/accel.sh@20 -- # read -r var val 00:06:22.567 22:58:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:22.567 22:58:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:22.567 22:58:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.567 22:58:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.567 22:58:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.567 22:58:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.567 22:58:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.567 22:58:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.567 22:58:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.567 22:58:48 -- accel/accel.sh@42 -- # jq -r . 00:06:22.567 [2024-11-26 22:58:48.828011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.567 [2024-11-26 22:58:48.828091] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97139 ] 00:06:22.568 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.568 [2024-11-26 22:58:48.890421] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.826 [2024-11-26 22:58:49.008036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val= 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val= 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val= 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val=0x1 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val= 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val= 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val=decompress 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val= 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val=software 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@23 -- # accel_module=software 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val=32 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val=32 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val=1 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val=Yes 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val= 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:22.826 22:58:49 -- accel/accel.sh@21 -- # val= 00:06:22.826 22:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # IFS=: 00:06:22.826 22:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:24.200 22:58:50 -- accel/accel.sh@21 -- # val= 00:06:24.200 22:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:24.200 22:58:50 -- accel/accel.sh@21 -- # val= 00:06:24.200 22:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:24.200 22:58:50 -- accel/accel.sh@21 -- # val= 00:06:24.200 22:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:24.200 22:58:50 -- accel/accel.sh@21 -- # val= 00:06:24.200 22:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:24.200 22:58:50 -- accel/accel.sh@21 -- # val= 00:06:24.200 22:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:24.200 22:58:50 -- accel/accel.sh@21 -- # val= 00:06:24.200 22:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:24.200 22:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:24.200 22:58:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:24.200 22:58:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:24.200 22:58:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:24.200 00:06:24.200 real 0m2.950s 00:06:24.200 user 0m2.648s 00:06:24.200 sys 0m0.293s 00:06:24.200 22:58:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.200 22:58:50 -- common/autotest_common.sh@10 -- # set +x 00:06:24.200 ************************************ 00:06:24.200 END TEST accel_decomp 00:06:24.200 ************************************ 00:06:24.200 22:58:50 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:24.200 22:58:50 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:24.200 22:58:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.200 22:58:50 -- common/autotest_common.sh@10 -- # set +x 00:06:24.200 ************************************ 00:06:24.200 START TEST accel_decmop_full 00:06:24.200 ************************************ 00:06:24.200 22:58:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:24.200 22:58:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.200 22:58:50 -- accel/accel.sh@17 -- # local accel_module 00:06:24.200 22:58:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:24.200 22:58:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:24.200 22:58:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.200 22:58:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.200 22:58:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.200 22:58:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.200 22:58:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.200 22:58:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.200 22:58:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.200 22:58:50 -- accel/accel.sh@42 -- # jq -r . 00:06:24.200 [2024-11-26 22:58:50.339008] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.200 [2024-11-26 22:58:50.339099] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97293 ] 00:06:24.200 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.200 [2024-11-26 22:58:50.404169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.200 [2024-11-26 22:58:50.519121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.602 22:58:51 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:25.602 00:06:25.602 SPDK Configuration: 00:06:25.602 Core mask: 0x1 00:06:25.602 00:06:25.602 Accel Perf Configuration: 00:06:25.602 Workload Type: decompress 00:06:25.602 Transfer size: 111250 bytes 00:06:25.602 Vector count 1 00:06:25.602 Module: software 00:06:25.602 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.602 Queue depth: 32 00:06:25.602 Allocate depth: 32 00:06:25.602 # threads/core: 1 00:06:25.602 Run time: 1 seconds 00:06:25.602 Verify: Yes 00:06:25.602 00:06:25.602 Running for 1 seconds... 00:06:25.602 00:06:25.602 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:25.602 ------------------------------------------------------------------------------------ 00:06:25.602 0,0 3808/s 157 MiB/s 0 0 00:06:25.602 ==================================================================================== 00:06:25.602 Total 3808/s 404 MiB/s 0 0' 00:06:25.602 22:58:51 -- accel/accel.sh@20 -- # IFS=: 00:06:25.602 22:58:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:25.602 22:58:51 -- accel/accel.sh@20 -- # read -r var val 00:06:25.602 22:58:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:25.602 22:58:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.602 22:58:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.602 22:58:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.602 22:58:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.602 22:58:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.602 22:58:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.602 22:58:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.602 22:58:51 -- accel/accel.sh@42 -- # jq -r . 00:06:25.602 [2024-11-26 22:58:51.821218] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.602 [2024-11-26 22:58:51.821300] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97559 ] 00:06:25.602 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.602 [2024-11-26 22:58:51.883156] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.860 [2024-11-26 22:58:51.999610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.860 22:58:52 -- accel/accel.sh@21 -- # val= 00:06:25.860 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.860 22:58:52 -- accel/accel.sh@21 -- # val= 00:06:25.860 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.860 22:58:52 -- accel/accel.sh@21 -- # val= 00:06:25.860 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.860 22:58:52 -- accel/accel.sh@21 -- # val=0x1 00:06:25.860 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.860 22:58:52 -- accel/accel.sh@21 -- # val= 00:06:25.860 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.860 22:58:52 -- accel/accel.sh@21 -- # val= 00:06:25.860 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.860 22:58:52 -- accel/accel.sh@21 -- # val=decompress 00:06:25.860 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.860 22:58:52 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.860 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.860 22:58:52 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val= 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val=software 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@23 -- # accel_module=software 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val=32 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val=32 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val=1 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val=Yes 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val= 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:25.861 22:58:52 -- accel/accel.sh@21 -- # val= 00:06:25.861 22:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:25.861 22:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:27.234 22:58:53 -- accel/accel.sh@21 -- # val= 00:06:27.234 22:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:27.234 22:58:53 -- accel/accel.sh@21 -- # val= 00:06:27.234 22:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:27.234 22:58:53 -- accel/accel.sh@21 -- # val= 00:06:27.234 22:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:27.234 22:58:53 -- accel/accel.sh@21 -- # val= 00:06:27.234 22:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:27.234 22:58:53 -- accel/accel.sh@21 -- # val= 00:06:27.234 22:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:27.234 22:58:53 -- accel/accel.sh@21 -- # val= 00:06:27.234 22:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:27.234 22:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:27.234 22:58:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.234 22:58:53 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:27.234 22:58:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.234 00:06:27.234 real 0m2.967s 00:06:27.234 user 0m2.667s 00:06:27.234 sys 0m0.291s 00:06:27.234 22:58:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.234 22:58:53 -- common/autotest_common.sh@10 -- # set +x 00:06:27.234 ************************************ 00:06:27.234 END TEST accel_decmop_full 00:06:27.234 ************************************ 00:06:27.234 22:58:53 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:27.234 22:58:53 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:27.234 22:58:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.234 22:58:53 -- common/autotest_common.sh@10 -- # set +x 00:06:27.234 ************************************ 00:06:27.234 START TEST accel_decomp_mcore 00:06:27.234 ************************************ 00:06:27.234 22:58:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:27.234 22:58:53 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.234 22:58:53 -- accel/accel.sh@17 -- # local accel_module 00:06:27.234 22:58:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:27.234 22:58:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:27.234 22:58:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.234 22:58:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.234 22:58:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.234 22:58:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.234 22:58:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.234 22:58:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.234 22:58:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.234 22:58:53 -- accel/accel.sh@42 -- # jq -r . 00:06:27.234 [2024-11-26 22:58:53.327737] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.234 [2024-11-26 22:58:53.327809] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97717 ] 00:06:27.234 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.234 [2024-11-26 22:58:53.392417] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.234 [2024-11-26 22:58:53.509707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.234 [2024-11-26 22:58:53.509737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.234 [2024-11-26 22:58:53.509856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.234 [2024-11-26 22:58:53.509859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.607 22:58:54 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:28.607 00:06:28.607 SPDK Configuration: 00:06:28.607 Core mask: 0xf 00:06:28.607 00:06:28.607 Accel Perf Configuration: 00:06:28.607 Workload Type: decompress 00:06:28.607 Transfer size: 4096 bytes 00:06:28.607 Vector count 1 00:06:28.607 Module: software 00:06:28.607 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:28.607 Queue depth: 32 00:06:28.607 Allocate depth: 32 00:06:28.607 # threads/core: 1 00:06:28.607 Run time: 1 seconds 00:06:28.607 Verify: Yes 00:06:28.607 00:06:28.607 Running for 1 seconds... 00:06:28.607 00:06:28.607 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:28.607 ------------------------------------------------------------------------------------ 00:06:28.607 0,0 56800/s 104 MiB/s 0 0 00:06:28.607 3,0 57344/s 105 MiB/s 0 0 00:06:28.607 2,0 57152/s 105 MiB/s 0 0 00:06:28.607 1,0 56992/s 105 MiB/s 0 0 00:06:28.607 ==================================================================================== 00:06:28.607 Total 228288/s 891 MiB/s 0 0' 00:06:28.607 22:58:54 -- accel/accel.sh@20 -- # IFS=: 00:06:28.607 22:58:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:28.607 22:58:54 -- accel/accel.sh@20 -- # read -r var val 00:06:28.607 22:58:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:28.607 22:58:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.607 22:58:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.607 22:58:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.607 22:58:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.607 22:58:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.607 22:58:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.607 22:58:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.607 22:58:54 -- accel/accel.sh@42 -- # jq -r . 00:06:28.607 [2024-11-26 22:58:54.800542] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.607 [2024-11-26 22:58:54.800652] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97867 ] 00:06:28.607 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.607 [2024-11-26 22:58:54.865036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:28.607 [2024-11-26 22:58:54.983849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.607 [2024-11-26 22:58:54.983907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.607 [2024-11-26 22:58:54.984022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:28.607 [2024-11-26 22:58:54.984025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val= 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val= 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val= 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val=0xf 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val= 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val= 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val=decompress 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val= 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val=software 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@23 -- # accel_module=software 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val=32 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val=32 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val=1 00:06:28.865 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.865 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.865 22:58:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:28.866 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.866 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.866 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.866 22:58:55 -- accel/accel.sh@21 -- # val=Yes 00:06:28.866 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.866 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.866 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.866 22:58:55 -- accel/accel.sh@21 -- # val= 00:06:28.866 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.866 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.866 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:28.866 22:58:55 -- accel/accel.sh@21 -- # val= 00:06:28.866 22:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.866 22:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:28.866 22:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@21 -- # val= 00:06:30.240 22:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:30.240 22:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:30.240 22:58:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.240 22:58:56 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:30.240 22:58:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.240 00:06:30.240 real 0m2.957s 00:06:30.240 user 0m9.530s 00:06:30.240 sys 0m0.296s 00:06:30.240 22:58:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.240 22:58:56 -- common/autotest_common.sh@10 -- # set +x 00:06:30.240 ************************************ 00:06:30.240 END TEST accel_decomp_mcore 00:06:30.240 ************************************ 00:06:30.240 22:58:56 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:30.240 22:58:56 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:30.240 22:58:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.240 22:58:56 -- common/autotest_common.sh@10 -- # set +x 00:06:30.240 ************************************ 00:06:30.240 START TEST accel_decomp_full_mcore 00:06:30.240 ************************************ 00:06:30.240 22:58:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:30.240 22:58:56 -- accel/accel.sh@16 -- # local accel_opc 00:06:30.240 22:58:56 -- accel/accel.sh@17 -- # local accel_module 00:06:30.240 22:58:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:30.240 22:58:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:30.240 22:58:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.240 22:58:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.240 22:58:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.240 22:58:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.240 22:58:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.240 22:58:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.240 22:58:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.240 22:58:56 -- accel/accel.sh@42 -- # jq -r . 00:06:30.240 [2024-11-26 22:58:56.313196] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.240 [2024-11-26 22:58:56.313272] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98096 ] 00:06:30.240 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.241 [2024-11-26 22:58:56.378853] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:30.241 [2024-11-26 22:58:56.499607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:30.241 [2024-11-26 22:58:56.499662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:30.241 [2024-11-26 22:58:56.499782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:30.241 [2024-11-26 22:58:56.499784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.617 22:58:57 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:31.617 00:06:31.617 SPDK Configuration: 00:06:31.617 Core mask: 0xf 00:06:31.617 00:06:31.617 Accel Perf Configuration: 00:06:31.617 Workload Type: decompress 00:06:31.617 Transfer size: 111250 bytes 00:06:31.617 Vector count 1 00:06:31.617 Module: software 00:06:31.617 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:31.617 Queue depth: 32 00:06:31.617 Allocate depth: 32 00:06:31.617 # threads/core: 1 00:06:31.617 Run time: 1 seconds 00:06:31.617 Verify: Yes 00:06:31.617 00:06:31.617 Running for 1 seconds... 00:06:31.617 00:06:31.617 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:31.617 ------------------------------------------------------------------------------------ 00:06:31.617 0,0 4256/s 175 MiB/s 0 0 00:06:31.617 3,0 4288/s 177 MiB/s 0 0 00:06:31.617 2,0 4288/s 177 MiB/s 0 0 00:06:31.617 1,0 4256/s 175 MiB/s 0 0 00:06:31.617 ==================================================================================== 00:06:31.617 Total 17088/s 1812 MiB/s 0 0' 00:06:31.617 22:58:57 -- accel/accel.sh@20 -- # IFS=: 00:06:31.617 22:58:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:31.617 22:58:57 -- accel/accel.sh@20 -- # read -r var val 00:06:31.617 22:58:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:31.617 22:58:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.617 22:58:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:31.617 22:58:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.617 22:58:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.617 22:58:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:31.617 22:58:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:31.617 22:58:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:31.617 22:58:57 -- accel/accel.sh@42 -- # jq -r . 00:06:31.617 [2024-11-26 22:58:57.817097] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:31.617 [2024-11-26 22:58:57.817177] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98293 ] 00:06:31.617 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.617 [2024-11-26 22:58:57.882183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:31.617 [2024-11-26 22:58:58.001683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:31.617 [2024-11-26 22:58:58.001742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:31.617 [2024-11-26 22:58:58.001861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:31.617 [2024-11-26 22:58:58.001864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val= 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val= 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val= 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val=0xf 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val= 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val= 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val=decompress 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val= 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val=software 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@23 -- # accel_module=software 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val=32 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val=32 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val=1 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val=Yes 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val= 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:31.876 22:58:58 -- accel/accel.sh@21 -- # val= 00:06:31.876 22:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:31.876 22:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@21 -- # val= 00:06:33.253 22:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:33.253 22:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:33.253 22:58:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:33.253 22:58:59 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:33.253 22:58:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:33.253 00:06:33.253 real 0m3.003s 00:06:33.253 user 0m9.680s 00:06:33.253 sys 0m0.310s 00:06:33.253 22:58:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.253 22:58:59 -- common/autotest_common.sh@10 -- # set +x 00:06:33.253 ************************************ 00:06:33.253 END TEST accel_decomp_full_mcore 00:06:33.253 ************************************ 00:06:33.253 22:58:59 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:33.253 22:58:59 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:33.253 22:58:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.253 22:58:59 -- common/autotest_common.sh@10 -- # set +x 00:06:33.253 ************************************ 00:06:33.253 START TEST accel_decomp_mthread 00:06:33.253 ************************************ 00:06:33.253 22:58:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:33.253 22:58:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:33.253 22:58:59 -- accel/accel.sh@17 -- # local accel_module 00:06:33.253 22:58:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:33.253 22:58:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:33.253 22:58:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.254 22:58:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.254 22:58:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.254 22:58:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.254 22:58:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.254 22:58:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.254 22:58:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.254 22:58:59 -- accel/accel.sh@42 -- # jq -r . 00:06:33.254 [2024-11-26 22:58:59.339713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.254 [2024-11-26 22:58:59.339786] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98461 ] 00:06:33.254 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.254 [2024-11-26 22:58:59.400916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.254 [2024-11-26 22:58:59.516693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.630 22:59:00 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:34.630 00:06:34.630 SPDK Configuration: 00:06:34.630 Core mask: 0x1 00:06:34.630 00:06:34.630 Accel Perf Configuration: 00:06:34.630 Workload Type: decompress 00:06:34.630 Transfer size: 4096 bytes 00:06:34.630 Vector count 1 00:06:34.630 Module: software 00:06:34.630 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:34.630 Queue depth: 32 00:06:34.630 Allocate depth: 32 00:06:34.630 # threads/core: 2 00:06:34.630 Run time: 1 seconds 00:06:34.630 Verify: Yes 00:06:34.630 00:06:34.630 Running for 1 seconds... 00:06:34.630 00:06:34.630 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:34.630 ------------------------------------------------------------------------------------ 00:06:34.630 0,1 28000/s 51 MiB/s 0 0 00:06:34.630 0,0 27904/s 51 MiB/s 0 0 00:06:34.630 ==================================================================================== 00:06:34.630 Total 55904/s 218 MiB/s 0 0' 00:06:34.630 22:59:00 -- accel/accel.sh@20 -- # IFS=: 00:06:34.630 22:59:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:34.630 22:59:00 -- accel/accel.sh@20 -- # read -r var val 00:06:34.630 22:59:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:34.630 22:59:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.630 22:59:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.630 22:59:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.630 22:59:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.630 22:59:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.630 22:59:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.630 22:59:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.630 22:59:00 -- accel/accel.sh@42 -- # jq -r . 00:06:34.630 [2024-11-26 22:59:00.820628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.630 [2024-11-26 22:59:00.820714] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98614 ] 00:06:34.630 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.630 [2024-11-26 22:59:00.884982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.630 [2024-11-26 22:59:01.003312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val= 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val= 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val= 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val=0x1 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val= 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val= 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val=decompress 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val= 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val=software 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@23 -- # accel_module=software 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val=32 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val=32 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val=2 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.890 22:59:01 -- accel/accel.sh@21 -- # val=Yes 00:06:34.890 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.890 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.891 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.891 22:59:01 -- accel/accel.sh@21 -- # val= 00:06:34.891 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.891 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.891 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:34.891 22:59:01 -- accel/accel.sh@21 -- # val= 00:06:34.891 22:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.891 22:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:34.891 22:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:36.268 22:59:02 -- accel/accel.sh@21 -- # val= 00:06:36.268 22:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:36.268 22:59:02 -- accel/accel.sh@21 -- # val= 00:06:36.268 22:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:36.268 22:59:02 -- accel/accel.sh@21 -- # val= 00:06:36.268 22:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:36.268 22:59:02 -- accel/accel.sh@21 -- # val= 00:06:36.268 22:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:36.268 22:59:02 -- accel/accel.sh@21 -- # val= 00:06:36.268 22:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:36.268 22:59:02 -- accel/accel.sh@21 -- # val= 00:06:36.268 22:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:36.268 22:59:02 -- accel/accel.sh@21 -- # val= 00:06:36.268 22:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:36.268 22:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:36.268 22:59:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:36.268 22:59:02 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:36.268 22:59:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:36.268 00:06:36.268 real 0m2.976s 00:06:36.268 user 0m2.661s 00:06:36.268 sys 0m0.306s 00:06:36.268 22:59:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.268 22:59:02 -- common/autotest_common.sh@10 -- # set +x 00:06:36.268 ************************************ 00:06:36.268 END TEST accel_decomp_mthread 00:06:36.268 ************************************ 00:06:36.268 22:59:02 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:36.268 22:59:02 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:36.268 22:59:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.268 22:59:02 -- common/autotest_common.sh@10 -- # set +x 00:06:36.268 ************************************ 00:06:36.268 START TEST accel_deomp_full_mthread 00:06:36.268 ************************************ 00:06:36.268 22:59:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:36.268 22:59:02 -- accel/accel.sh@16 -- # local accel_opc 00:06:36.268 22:59:02 -- accel/accel.sh@17 -- # local accel_module 00:06:36.268 22:59:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:36.268 22:59:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:36.268 22:59:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.268 22:59:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.268 22:59:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.268 22:59:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.268 22:59:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.268 22:59:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.268 22:59:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.268 22:59:02 -- accel/accel.sh@42 -- # jq -r . 00:06:36.268 [2024-11-26 22:59:02.342700] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.268 [2024-11-26 22:59:02.342794] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98882 ] 00:06:36.268 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.268 [2024-11-26 22:59:02.406905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.268 [2024-11-26 22:59:02.525980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.644 22:59:03 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:37.644 00:06:37.644 SPDK Configuration: 00:06:37.644 Core mask: 0x1 00:06:37.644 00:06:37.644 Accel Perf Configuration: 00:06:37.644 Workload Type: decompress 00:06:37.644 Transfer size: 111250 bytes 00:06:37.644 Vector count 1 00:06:37.644 Module: software 00:06:37.644 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:37.644 Queue depth: 32 00:06:37.644 Allocate depth: 32 00:06:37.644 # threads/core: 2 00:06:37.644 Run time: 1 seconds 00:06:37.644 Verify: Yes 00:06:37.644 00:06:37.644 Running for 1 seconds... 00:06:37.644 00:06:37.644 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:37.644 ------------------------------------------------------------------------------------ 00:06:37.644 0,1 1952/s 80 MiB/s 0 0 00:06:37.644 0,0 1920/s 79 MiB/s 0 0 00:06:37.644 ==================================================================================== 00:06:37.644 Total 3872/s 410 MiB/s 0 0' 00:06:37.644 22:59:03 -- accel/accel.sh@20 -- # IFS=: 00:06:37.644 22:59:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:37.644 22:59:03 -- accel/accel.sh@20 -- # read -r var val 00:06:37.644 22:59:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:37.644 22:59:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:37.644 22:59:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:37.644 22:59:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:37.644 22:59:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:37.644 22:59:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:37.644 22:59:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:37.644 22:59:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:37.644 22:59:03 -- accel/accel.sh@42 -- # jq -r . 00:06:37.644 [2024-11-26 22:59:03.870016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:37.644 [2024-11-26 22:59:03.870100] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99025 ] 00:06:37.644 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.644 [2024-11-26 22:59:03.934058] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.903 [2024-11-26 22:59:04.053451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val= 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val= 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val= 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val=0x1 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val= 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val= 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val=decompress 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val= 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val=software 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@23 -- # accel_module=software 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val=32 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val=32 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val=2 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val=Yes 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val= 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:37.903 22:59:04 -- accel/accel.sh@21 -- # val= 00:06:37.903 22:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:37.903 22:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:39.280 22:59:05 -- accel/accel.sh@21 -- # val= 00:06:39.280 22:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:39.280 22:59:05 -- accel/accel.sh@21 -- # val= 00:06:39.280 22:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:39.280 22:59:05 -- accel/accel.sh@21 -- # val= 00:06:39.280 22:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:39.280 22:59:05 -- accel/accel.sh@21 -- # val= 00:06:39.280 22:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:39.280 22:59:05 -- accel/accel.sh@21 -- # val= 00:06:39.280 22:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:39.280 22:59:05 -- accel/accel.sh@21 -- # val= 00:06:39.280 22:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:39.280 22:59:05 -- accel/accel.sh@21 -- # val= 00:06:39.280 22:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:39.280 22:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:39.280 22:59:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:39.280 22:59:05 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:39.280 22:59:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:39.280 00:06:39.280 real 0m3.032s 00:06:39.280 user 0m2.741s 00:06:39.280 sys 0m0.281s 00:06:39.281 22:59:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.281 22:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:39.281 ************************************ 00:06:39.281 END TEST accel_deomp_full_mthread 00:06:39.281 ************************************ 00:06:39.281 22:59:05 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:39.281 22:59:05 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:39.281 22:59:05 -- accel/accel.sh@129 -- # build_accel_config 00:06:39.281 22:59:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:39.281 22:59:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:39.281 22:59:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.281 22:59:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.281 22:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:39.281 22:59:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.281 22:59:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:39.281 22:59:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:39.281 22:59:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:39.281 22:59:05 -- accel/accel.sh@42 -- # jq -r . 00:06:39.281 ************************************ 00:06:39.281 START TEST accel_dif_functional_tests 00:06:39.281 ************************************ 00:06:39.281 22:59:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:39.281 [2024-11-26 22:59:05.419476] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.281 [2024-11-26 22:59:05.419584] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99211 ] 00:06:39.281 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.281 [2024-11-26 22:59:05.483990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:39.281 [2024-11-26 22:59:05.606708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:39.281 [2024-11-26 22:59:05.606763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:39.281 [2024-11-26 22:59:05.606766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.540 00:06:39.540 00:06:39.540 CUnit - A unit testing framework for C - Version 2.1-3 00:06:39.540 http://cunit.sourceforge.net/ 00:06:39.540 00:06:39.540 00:06:39.540 Suite: accel_dif 00:06:39.540 Test: verify: DIF generated, GUARD check ...passed 00:06:39.540 Test: verify: DIF generated, APPTAG check ...passed 00:06:39.540 Test: verify: DIF generated, REFTAG check ...passed 00:06:39.540 Test: verify: DIF not generated, GUARD check ...[2024-11-26 22:59:05.709749] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:39.540 [2024-11-26 22:59:05.709821] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:39.540 passed 00:06:39.540 Test: verify: DIF not generated, APPTAG check ...[2024-11-26 22:59:05.709865] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:39.541 [2024-11-26 22:59:05.709895] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:39.541 passed 00:06:39.541 Test: verify: DIF not generated, REFTAG check ...[2024-11-26 22:59:05.709943] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:39.541 [2024-11-26 22:59:05.709974] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:39.541 passed 00:06:39.541 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:39.541 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-26 22:59:05.710059] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:39.541 passed 00:06:39.541 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:39.541 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:39.541 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:39.541 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-26 22:59:05.710214] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:39.541 passed 00:06:39.541 Test: generate copy: DIF generated, GUARD check ...passed 00:06:39.541 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:39.541 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:39.541 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:39.541 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:39.541 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:39.541 Test: generate copy: iovecs-len validate ...[2024-11-26 22:59:05.710471] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:39.541 passed 00:06:39.541 Test: generate copy: buffer alignment validate ...passed 00:06:39.541 00:06:39.541 Run Summary: Type Total Ran Passed Failed Inactive 00:06:39.541 suites 1 1 n/a 0 0 00:06:39.541 tests 20 20 20 0 0 00:06:39.541 asserts 204 204 204 0 n/a 00:06:39.541 00:06:39.541 Elapsed time = 0.003 seconds 00:06:39.799 00:06:39.799 real 0m0.591s 00:06:39.799 user 0m0.893s 00:06:39.799 sys 0m0.181s 00:06:39.799 22:59:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.799 22:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:39.799 ************************************ 00:06:39.799 END TEST accel_dif_functional_tests 00:06:39.799 ************************************ 00:06:39.799 00:06:39.799 real 1m2.892s 00:06:39.799 user 1m10.623s 00:06:39.799 sys 0m7.290s 00:06:39.799 22:59:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.799 22:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:39.799 ************************************ 00:06:39.799 END TEST accel 00:06:39.799 ************************************ 00:06:39.799 22:59:06 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:39.799 22:59:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.799 22:59:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.799 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:39.799 ************************************ 00:06:39.799 START TEST accel_rpc 00:06:39.799 ************************************ 00:06:39.799 22:59:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:39.799 * Looking for test storage... 00:06:39.799 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:39.799 22:59:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:39.799 22:59:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:39.799 22:59:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:39.799 22:59:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:39.799 22:59:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:39.799 22:59:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:39.799 22:59:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:39.799 22:59:06 -- scripts/common.sh@335 -- # IFS=.-: 00:06:39.799 22:59:06 -- scripts/common.sh@335 -- # read -ra ver1 00:06:39.799 22:59:06 -- scripts/common.sh@336 -- # IFS=.-: 00:06:39.799 22:59:06 -- scripts/common.sh@336 -- # read -ra ver2 00:06:39.799 22:59:06 -- scripts/common.sh@337 -- # local 'op=<' 00:06:39.799 22:59:06 -- scripts/common.sh@339 -- # ver1_l=2 00:06:39.799 22:59:06 -- scripts/common.sh@340 -- # ver2_l=1 00:06:39.799 22:59:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:39.799 22:59:06 -- scripts/common.sh@343 -- # case "$op" in 00:06:39.799 22:59:06 -- scripts/common.sh@344 -- # : 1 00:06:39.799 22:59:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:39.799 22:59:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:39.799 22:59:06 -- scripts/common.sh@364 -- # decimal 1 00:06:39.799 22:59:06 -- scripts/common.sh@352 -- # local d=1 00:06:39.799 22:59:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:39.799 22:59:06 -- scripts/common.sh@354 -- # echo 1 00:06:39.799 22:59:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:39.799 22:59:06 -- scripts/common.sh@365 -- # decimal 2 00:06:39.799 22:59:06 -- scripts/common.sh@352 -- # local d=2 00:06:39.799 22:59:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:39.799 22:59:06 -- scripts/common.sh@354 -- # echo 2 00:06:39.799 22:59:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:39.799 22:59:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:39.799 22:59:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:39.799 22:59:06 -- scripts/common.sh@367 -- # return 0 00:06:39.799 22:59:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:39.799 22:59:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:39.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.799 --rc genhtml_branch_coverage=1 00:06:39.799 --rc genhtml_function_coverage=1 00:06:39.799 --rc genhtml_legend=1 00:06:39.799 --rc geninfo_all_blocks=1 00:06:39.799 --rc geninfo_unexecuted_blocks=1 00:06:39.799 00:06:39.799 ' 00:06:39.799 22:59:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:39.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.799 --rc genhtml_branch_coverage=1 00:06:39.799 --rc genhtml_function_coverage=1 00:06:39.799 --rc genhtml_legend=1 00:06:39.799 --rc geninfo_all_blocks=1 00:06:39.799 --rc geninfo_unexecuted_blocks=1 00:06:39.799 00:06:39.799 ' 00:06:39.799 22:59:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:39.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.799 --rc genhtml_branch_coverage=1 00:06:39.799 --rc genhtml_function_coverage=1 00:06:39.799 --rc genhtml_legend=1 00:06:39.799 --rc geninfo_all_blocks=1 00:06:39.799 --rc geninfo_unexecuted_blocks=1 00:06:39.799 00:06:39.799 ' 00:06:39.799 22:59:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:39.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.799 --rc genhtml_branch_coverage=1 00:06:39.799 --rc genhtml_function_coverage=1 00:06:39.799 --rc genhtml_legend=1 00:06:39.799 --rc geninfo_all_blocks=1 00:06:39.799 --rc geninfo_unexecuted_blocks=1 00:06:39.799 00:06:39.799 ' 00:06:39.799 22:59:06 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:39.799 22:59:06 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=99390 00:06:39.799 22:59:06 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:39.799 22:59:06 -- accel/accel_rpc.sh@15 -- # waitforlisten 99390 00:06:39.799 22:59:06 -- common/autotest_common.sh@829 -- # '[' -z 99390 ']' 00:06:39.799 22:59:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.799 22:59:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.799 22:59:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.799 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.799 22:59:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.799 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:40.057 [2024-11-26 22:59:06.222057] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:40.057 [2024-11-26 22:59:06.222136] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99390 ] 00:06:40.057 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.057 [2024-11-26 22:59:06.279257] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:40.057 [2024-11-26 22:59:06.384550] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:40.057 [2024-11-26 22:59:06.384707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.057 22:59:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.057 22:59:06 -- common/autotest_common.sh@862 -- # return 0 00:06:40.057 22:59:06 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:40.057 22:59:06 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:40.057 22:59:06 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:40.057 22:59:06 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:40.057 22:59:06 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:40.057 22:59:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:40.057 22:59:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.057 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:40.057 ************************************ 00:06:40.057 START TEST accel_assign_opcode 00:06:40.057 ************************************ 00:06:40.057 22:59:06 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:40.057 22:59:06 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:40.057 22:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.057 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:40.057 [2024-11-26 22:59:06.437205] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:40.057 22:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.057 22:59:06 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:40.057 22:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.057 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:40.057 [2024-11-26 22:59:06.445222] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:40.057 22:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.057 22:59:06 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:40.057 22:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.057 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:40.316 22:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.316 22:59:06 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:40.316 22:59:06 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:40.316 22:59:06 -- accel/accel_rpc.sh@42 -- # grep software 00:06:40.316 22:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.316 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:40.574 22:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.574 software 00:06:40.574 00:06:40.574 real 0m0.310s 00:06:40.574 user 0m0.041s 00:06:40.574 sys 0m0.007s 00:06:40.574 22:59:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:40.574 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:06:40.574 ************************************ 00:06:40.574 END TEST accel_assign_opcode 00:06:40.574 ************************************ 00:06:40.574 22:59:06 -- accel/accel_rpc.sh@55 -- # killprocess 99390 00:06:40.574 22:59:06 -- common/autotest_common.sh@936 -- # '[' -z 99390 ']' 00:06:40.574 22:59:06 -- common/autotest_common.sh@940 -- # kill -0 99390 00:06:40.574 22:59:06 -- common/autotest_common.sh@941 -- # uname 00:06:40.574 22:59:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:40.574 22:59:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 99390 00:06:40.574 22:59:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:40.574 22:59:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:40.574 22:59:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 99390' 00:06:40.574 killing process with pid 99390 00:06:40.574 22:59:06 -- common/autotest_common.sh@955 -- # kill 99390 00:06:40.574 22:59:06 -- common/autotest_common.sh@960 -- # wait 99390 00:06:41.141 00:06:41.141 real 0m1.259s 00:06:41.141 user 0m1.182s 00:06:41.141 sys 0m0.429s 00:06:41.141 22:59:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.141 22:59:07 -- common/autotest_common.sh@10 -- # set +x 00:06:41.141 ************************************ 00:06:41.141 END TEST accel_rpc 00:06:41.141 ************************************ 00:06:41.141 22:59:07 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:41.141 22:59:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.141 22:59:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.141 22:59:07 -- common/autotest_common.sh@10 -- # set +x 00:06:41.141 ************************************ 00:06:41.141 START TEST app_cmdline 00:06:41.141 ************************************ 00:06:41.141 22:59:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:41.141 * Looking for test storage... 00:06:41.141 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:41.141 22:59:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:41.141 22:59:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:41.141 22:59:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:41.141 22:59:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:41.141 22:59:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:41.141 22:59:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:41.141 22:59:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:41.141 22:59:07 -- scripts/common.sh@335 -- # IFS=.-: 00:06:41.141 22:59:07 -- scripts/common.sh@335 -- # read -ra ver1 00:06:41.141 22:59:07 -- scripts/common.sh@336 -- # IFS=.-: 00:06:41.141 22:59:07 -- scripts/common.sh@336 -- # read -ra ver2 00:06:41.141 22:59:07 -- scripts/common.sh@337 -- # local 'op=<' 00:06:41.141 22:59:07 -- scripts/common.sh@339 -- # ver1_l=2 00:06:41.141 22:59:07 -- scripts/common.sh@340 -- # ver2_l=1 00:06:41.141 22:59:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:41.141 22:59:07 -- scripts/common.sh@343 -- # case "$op" in 00:06:41.141 22:59:07 -- scripts/common.sh@344 -- # : 1 00:06:41.141 22:59:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:41.141 22:59:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:41.141 22:59:07 -- scripts/common.sh@364 -- # decimal 1 00:06:41.141 22:59:07 -- scripts/common.sh@352 -- # local d=1 00:06:41.141 22:59:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:41.141 22:59:07 -- scripts/common.sh@354 -- # echo 1 00:06:41.141 22:59:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:41.141 22:59:07 -- scripts/common.sh@365 -- # decimal 2 00:06:41.141 22:59:07 -- scripts/common.sh@352 -- # local d=2 00:06:41.141 22:59:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:41.141 22:59:07 -- scripts/common.sh@354 -- # echo 2 00:06:41.141 22:59:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:41.141 22:59:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:41.141 22:59:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:41.141 22:59:07 -- scripts/common.sh@367 -- # return 0 00:06:41.141 22:59:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:41.141 22:59:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:41.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.141 --rc genhtml_branch_coverage=1 00:06:41.141 --rc genhtml_function_coverage=1 00:06:41.141 --rc genhtml_legend=1 00:06:41.141 --rc geninfo_all_blocks=1 00:06:41.141 --rc geninfo_unexecuted_blocks=1 00:06:41.141 00:06:41.141 ' 00:06:41.141 22:59:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:41.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.141 --rc genhtml_branch_coverage=1 00:06:41.141 --rc genhtml_function_coverage=1 00:06:41.141 --rc genhtml_legend=1 00:06:41.141 --rc geninfo_all_blocks=1 00:06:41.141 --rc geninfo_unexecuted_blocks=1 00:06:41.141 00:06:41.141 ' 00:06:41.141 22:59:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:41.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.141 --rc genhtml_branch_coverage=1 00:06:41.141 --rc genhtml_function_coverage=1 00:06:41.141 --rc genhtml_legend=1 00:06:41.141 --rc geninfo_all_blocks=1 00:06:41.141 --rc geninfo_unexecuted_blocks=1 00:06:41.141 00:06:41.141 ' 00:06:41.141 22:59:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:41.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.141 --rc genhtml_branch_coverage=1 00:06:41.141 --rc genhtml_function_coverage=1 00:06:41.141 --rc genhtml_legend=1 00:06:41.141 --rc geninfo_all_blocks=1 00:06:41.141 --rc geninfo_unexecuted_blocks=1 00:06:41.141 00:06:41.141 ' 00:06:41.141 22:59:07 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:41.141 22:59:07 -- app/cmdline.sh@17 -- # spdk_tgt_pid=99601 00:06:41.141 22:59:07 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:41.141 22:59:07 -- app/cmdline.sh@18 -- # waitforlisten 99601 00:06:41.141 22:59:07 -- common/autotest_common.sh@829 -- # '[' -z 99601 ']' 00:06:41.141 22:59:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.141 22:59:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:41.141 22:59:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.141 22:59:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:41.141 22:59:07 -- common/autotest_common.sh@10 -- # set +x 00:06:41.141 [2024-11-26 22:59:07.512986] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:41.141 [2024-11-26 22:59:07.513080] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99601 ] 00:06:41.401 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.401 [2024-11-26 22:59:07.573895] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.401 [2024-11-26 22:59:07.689310] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.401 [2024-11-26 22:59:07.689481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.337 22:59:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.337 22:59:08 -- common/autotest_common.sh@862 -- # return 0 00:06:42.337 22:59:08 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:42.337 { 00:06:42.337 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:42.337 "fields": { 00:06:42.337 "major": 24, 00:06:42.337 "minor": 1, 00:06:42.337 "patch": 1, 00:06:42.337 "suffix": "-pre", 00:06:42.337 "commit": "c13c99a5e" 00:06:42.337 } 00:06:42.337 } 00:06:42.596 22:59:08 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:42.596 22:59:08 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:42.596 22:59:08 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:42.596 22:59:08 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:42.596 22:59:08 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:42.596 22:59:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.596 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:06:42.596 22:59:08 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:42.596 22:59:08 -- app/cmdline.sh@26 -- # sort 00:06:42.596 22:59:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.596 22:59:08 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:42.596 22:59:08 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:42.596 22:59:08 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:42.596 22:59:08 -- common/autotest_common.sh@650 -- # local es=0 00:06:42.596 22:59:08 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:42.596 22:59:08 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:42.596 22:59:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:42.596 22:59:08 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:42.596 22:59:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:42.596 22:59:08 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:42.596 22:59:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:42.596 22:59:08 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:42.596 22:59:08 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:42.596 22:59:08 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:42.856 request: 00:06:42.856 { 00:06:42.856 "method": "env_dpdk_get_mem_stats", 00:06:42.856 "req_id": 1 00:06:42.856 } 00:06:42.856 Got JSON-RPC error response 00:06:42.856 response: 00:06:42.856 { 00:06:42.856 "code": -32601, 00:06:42.856 "message": "Method not found" 00:06:42.856 } 00:06:42.856 22:59:09 -- common/autotest_common.sh@653 -- # es=1 00:06:42.856 22:59:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:42.856 22:59:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:42.856 22:59:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:42.856 22:59:09 -- app/cmdline.sh@1 -- # killprocess 99601 00:06:42.856 22:59:09 -- common/autotest_common.sh@936 -- # '[' -z 99601 ']' 00:06:42.856 22:59:09 -- common/autotest_common.sh@940 -- # kill -0 99601 00:06:42.856 22:59:09 -- common/autotest_common.sh@941 -- # uname 00:06:42.856 22:59:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:42.856 22:59:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 99601 00:06:42.856 22:59:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:42.856 22:59:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:42.856 22:59:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 99601' 00:06:42.856 killing process with pid 99601 00:06:42.856 22:59:09 -- common/autotest_common.sh@955 -- # kill 99601 00:06:42.856 22:59:09 -- common/autotest_common.sh@960 -- # wait 99601 00:06:43.423 00:06:43.423 real 0m2.230s 00:06:43.423 user 0m2.771s 00:06:43.423 sys 0m0.522s 00:06:43.423 22:59:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.423 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:06:43.423 ************************************ 00:06:43.423 END TEST app_cmdline 00:06:43.423 ************************************ 00:06:43.423 22:59:09 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:43.423 22:59:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:43.423 22:59:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.423 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:06:43.423 ************************************ 00:06:43.423 START TEST version 00:06:43.423 ************************************ 00:06:43.423 22:59:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:43.423 * Looking for test storage... 00:06:43.423 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:43.423 22:59:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.423 22:59:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.423 22:59:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.423 22:59:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.423 22:59:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.423 22:59:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.423 22:59:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.423 22:59:09 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.423 22:59:09 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.423 22:59:09 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.423 22:59:09 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.423 22:59:09 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.423 22:59:09 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.423 22:59:09 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.423 22:59:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.423 22:59:09 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.423 22:59:09 -- scripts/common.sh@344 -- # : 1 00:06:43.423 22:59:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.423 22:59:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.423 22:59:09 -- scripts/common.sh@364 -- # decimal 1 00:06:43.423 22:59:09 -- scripts/common.sh@352 -- # local d=1 00:06:43.423 22:59:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.423 22:59:09 -- scripts/common.sh@354 -- # echo 1 00:06:43.423 22:59:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.423 22:59:09 -- scripts/common.sh@365 -- # decimal 2 00:06:43.423 22:59:09 -- scripts/common.sh@352 -- # local d=2 00:06:43.423 22:59:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.423 22:59:09 -- scripts/common.sh@354 -- # echo 2 00:06:43.423 22:59:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.423 22:59:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.423 22:59:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.423 22:59:09 -- scripts/common.sh@367 -- # return 0 00:06:43.423 22:59:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.423 22:59:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.423 --rc genhtml_branch_coverage=1 00:06:43.423 --rc genhtml_function_coverage=1 00:06:43.423 --rc genhtml_legend=1 00:06:43.423 --rc geninfo_all_blocks=1 00:06:43.423 --rc geninfo_unexecuted_blocks=1 00:06:43.423 00:06:43.423 ' 00:06:43.423 22:59:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.423 --rc genhtml_branch_coverage=1 00:06:43.423 --rc genhtml_function_coverage=1 00:06:43.423 --rc genhtml_legend=1 00:06:43.423 --rc geninfo_all_blocks=1 00:06:43.423 --rc geninfo_unexecuted_blocks=1 00:06:43.423 00:06:43.423 ' 00:06:43.423 22:59:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.423 --rc genhtml_branch_coverage=1 00:06:43.423 --rc genhtml_function_coverage=1 00:06:43.423 --rc genhtml_legend=1 00:06:43.423 --rc geninfo_all_blocks=1 00:06:43.423 --rc geninfo_unexecuted_blocks=1 00:06:43.423 00:06:43.423 ' 00:06:43.423 22:59:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.423 --rc genhtml_branch_coverage=1 00:06:43.423 --rc genhtml_function_coverage=1 00:06:43.423 --rc genhtml_legend=1 00:06:43.423 --rc geninfo_all_blocks=1 00:06:43.423 --rc geninfo_unexecuted_blocks=1 00:06:43.423 00:06:43.423 ' 00:06:43.423 22:59:09 -- app/version.sh@17 -- # get_header_version major 00:06:43.423 22:59:09 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:43.423 22:59:09 -- app/version.sh@14 -- # cut -f2 00:06:43.423 22:59:09 -- app/version.sh@14 -- # tr -d '"' 00:06:43.423 22:59:09 -- app/version.sh@17 -- # major=24 00:06:43.423 22:59:09 -- app/version.sh@18 -- # get_header_version minor 00:06:43.424 22:59:09 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:43.424 22:59:09 -- app/version.sh@14 -- # cut -f2 00:06:43.424 22:59:09 -- app/version.sh@14 -- # tr -d '"' 00:06:43.424 22:59:09 -- app/version.sh@18 -- # minor=1 00:06:43.424 22:59:09 -- app/version.sh@19 -- # get_header_version patch 00:06:43.424 22:59:09 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:43.424 22:59:09 -- app/version.sh@14 -- # cut -f2 00:06:43.424 22:59:09 -- app/version.sh@14 -- # tr -d '"' 00:06:43.424 22:59:09 -- app/version.sh@19 -- # patch=1 00:06:43.424 22:59:09 -- app/version.sh@20 -- # get_header_version suffix 00:06:43.424 22:59:09 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:43.424 22:59:09 -- app/version.sh@14 -- # cut -f2 00:06:43.424 22:59:09 -- app/version.sh@14 -- # tr -d '"' 00:06:43.424 22:59:09 -- app/version.sh@20 -- # suffix=-pre 00:06:43.424 22:59:09 -- app/version.sh@22 -- # version=24.1 00:06:43.424 22:59:09 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:43.424 22:59:09 -- app/version.sh@25 -- # version=24.1.1 00:06:43.424 22:59:09 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:43.424 22:59:09 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:43.424 22:59:09 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:43.424 22:59:09 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:43.424 22:59:09 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:43.424 00:06:43.424 real 0m0.191s 00:06:43.424 user 0m0.132s 00:06:43.424 sys 0m0.083s 00:06:43.424 22:59:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.424 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:06:43.424 ************************************ 00:06:43.424 END TEST version 00:06:43.424 ************************************ 00:06:43.424 22:59:09 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:43.424 22:59:09 -- spdk/autotest.sh@191 -- # uname -s 00:06:43.424 22:59:09 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:43.424 22:59:09 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:43.424 22:59:09 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:43.424 22:59:09 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:43.424 22:59:09 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:43.424 22:59:09 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:43.424 22:59:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:43.424 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:06:43.424 22:59:09 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:43.424 22:59:09 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:43.424 22:59:09 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:43.424 22:59:09 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:43.424 22:59:09 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:43.424 22:59:09 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:43.424 22:59:09 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:43.424 22:59:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:43.424 22:59:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.424 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:06:43.424 ************************************ 00:06:43.424 START TEST nvmf_tcp 00:06:43.424 ************************************ 00:06:43.424 22:59:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:43.683 * Looking for test storage... 00:06:43.683 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:43.683 22:59:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.683 22:59:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.683 22:59:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.683 22:59:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.683 22:59:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.683 22:59:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.683 22:59:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.683 22:59:09 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.683 22:59:09 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.683 22:59:09 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.683 22:59:09 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.683 22:59:09 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.683 22:59:09 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.683 22:59:09 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.683 22:59:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.683 22:59:09 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.683 22:59:09 -- scripts/common.sh@344 -- # : 1 00:06:43.683 22:59:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.683 22:59:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.683 22:59:09 -- scripts/common.sh@364 -- # decimal 1 00:06:43.683 22:59:09 -- scripts/common.sh@352 -- # local d=1 00:06:43.683 22:59:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.683 22:59:09 -- scripts/common.sh@354 -- # echo 1 00:06:43.683 22:59:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.683 22:59:09 -- scripts/common.sh@365 -- # decimal 2 00:06:43.683 22:59:09 -- scripts/common.sh@352 -- # local d=2 00:06:43.683 22:59:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.683 22:59:09 -- scripts/common.sh@354 -- # echo 2 00:06:43.683 22:59:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.683 22:59:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.683 22:59:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.683 22:59:09 -- scripts/common.sh@367 -- # return 0 00:06:43.683 22:59:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.683 22:59:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.683 --rc genhtml_branch_coverage=1 00:06:43.683 --rc genhtml_function_coverage=1 00:06:43.683 --rc genhtml_legend=1 00:06:43.683 --rc geninfo_all_blocks=1 00:06:43.683 --rc geninfo_unexecuted_blocks=1 00:06:43.683 00:06:43.683 ' 00:06:43.683 22:59:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.683 --rc genhtml_branch_coverage=1 00:06:43.683 --rc genhtml_function_coverage=1 00:06:43.683 --rc genhtml_legend=1 00:06:43.683 --rc geninfo_all_blocks=1 00:06:43.683 --rc geninfo_unexecuted_blocks=1 00:06:43.683 00:06:43.683 ' 00:06:43.683 22:59:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.683 --rc genhtml_branch_coverage=1 00:06:43.683 --rc genhtml_function_coverage=1 00:06:43.683 --rc genhtml_legend=1 00:06:43.683 --rc geninfo_all_blocks=1 00:06:43.683 --rc geninfo_unexecuted_blocks=1 00:06:43.683 00:06:43.683 ' 00:06:43.683 22:59:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.683 --rc genhtml_branch_coverage=1 00:06:43.683 --rc genhtml_function_coverage=1 00:06:43.683 --rc genhtml_legend=1 00:06:43.683 --rc geninfo_all_blocks=1 00:06:43.683 --rc geninfo_unexecuted_blocks=1 00:06:43.683 00:06:43.683 ' 00:06:43.683 22:59:09 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:43.683 22:59:09 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:43.683 22:59:09 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:43.683 22:59:09 -- nvmf/common.sh@7 -- # uname -s 00:06:43.683 22:59:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:43.683 22:59:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:43.683 22:59:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:43.683 22:59:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:43.683 22:59:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:43.683 22:59:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:43.683 22:59:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:43.683 22:59:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:43.683 22:59:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:43.683 22:59:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:43.683 22:59:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.683 22:59:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.683 22:59:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:43.683 22:59:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:43.683 22:59:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:43.683 22:59:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:43.683 22:59:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.683 22:59:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.683 22:59:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.683 22:59:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.683 22:59:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.684 22:59:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.684 22:59:09 -- paths/export.sh@5 -- # export PATH 00:06:43.684 22:59:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.684 22:59:09 -- nvmf/common.sh@46 -- # : 0 00:06:43.684 22:59:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:43.684 22:59:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:43.684 22:59:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:43.684 22:59:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:43.684 22:59:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:43.684 22:59:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:43.684 22:59:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:43.684 22:59:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:43.684 22:59:09 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:43.684 22:59:09 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:43.684 22:59:09 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:43.684 22:59:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:43.684 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:06:43.684 22:59:09 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:43.684 22:59:09 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:43.684 22:59:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:43.684 22:59:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.684 22:59:09 -- common/autotest_common.sh@10 -- # set +x 00:06:43.684 ************************************ 00:06:43.684 START TEST nvmf_example 00:06:43.684 ************************************ 00:06:43.684 22:59:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:43.684 * Looking for test storage... 00:06:43.684 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.684 22:59:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.684 22:59:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.684 22:59:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.943 22:59:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.943 22:59:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.943 22:59:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.943 22:59:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.943 22:59:10 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.943 22:59:10 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.943 22:59:10 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.943 22:59:10 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.943 22:59:10 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.943 22:59:10 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.943 22:59:10 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.943 22:59:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.943 22:59:10 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.943 22:59:10 -- scripts/common.sh@344 -- # : 1 00:06:43.943 22:59:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.943 22:59:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.943 22:59:10 -- scripts/common.sh@364 -- # decimal 1 00:06:43.943 22:59:10 -- scripts/common.sh@352 -- # local d=1 00:06:43.943 22:59:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.943 22:59:10 -- scripts/common.sh@354 -- # echo 1 00:06:43.943 22:59:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.943 22:59:10 -- scripts/common.sh@365 -- # decimal 2 00:06:43.943 22:59:10 -- scripts/common.sh@352 -- # local d=2 00:06:43.943 22:59:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.943 22:59:10 -- scripts/common.sh@354 -- # echo 2 00:06:43.943 22:59:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.943 22:59:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.943 22:59:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.943 22:59:10 -- scripts/common.sh@367 -- # return 0 00:06:43.943 22:59:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.943 22:59:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.943 --rc genhtml_branch_coverage=1 00:06:43.943 --rc genhtml_function_coverage=1 00:06:43.943 --rc genhtml_legend=1 00:06:43.943 --rc geninfo_all_blocks=1 00:06:43.943 --rc geninfo_unexecuted_blocks=1 00:06:43.943 00:06:43.943 ' 00:06:43.943 22:59:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.943 --rc genhtml_branch_coverage=1 00:06:43.943 --rc genhtml_function_coverage=1 00:06:43.943 --rc genhtml_legend=1 00:06:43.943 --rc geninfo_all_blocks=1 00:06:43.943 --rc geninfo_unexecuted_blocks=1 00:06:43.943 00:06:43.943 ' 00:06:43.943 22:59:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.943 --rc genhtml_branch_coverage=1 00:06:43.943 --rc genhtml_function_coverage=1 00:06:43.943 --rc genhtml_legend=1 00:06:43.943 --rc geninfo_all_blocks=1 00:06:43.943 --rc geninfo_unexecuted_blocks=1 00:06:43.943 00:06:43.943 ' 00:06:43.943 22:59:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.943 --rc genhtml_branch_coverage=1 00:06:43.943 --rc genhtml_function_coverage=1 00:06:43.943 --rc genhtml_legend=1 00:06:43.943 --rc geninfo_all_blocks=1 00:06:43.943 --rc geninfo_unexecuted_blocks=1 00:06:43.943 00:06:43.943 ' 00:06:43.943 22:59:10 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:43.943 22:59:10 -- nvmf/common.sh@7 -- # uname -s 00:06:43.943 22:59:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:43.943 22:59:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:43.943 22:59:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:43.943 22:59:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:43.943 22:59:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:43.943 22:59:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:43.943 22:59:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:43.943 22:59:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:43.943 22:59:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:43.943 22:59:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:43.943 22:59:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.943 22:59:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.943 22:59:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:43.943 22:59:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:43.943 22:59:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:43.943 22:59:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:43.943 22:59:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.943 22:59:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.943 22:59:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.943 22:59:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.943 22:59:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.943 22:59:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.943 22:59:10 -- paths/export.sh@5 -- # export PATH 00:06:43.943 22:59:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.943 22:59:10 -- nvmf/common.sh@46 -- # : 0 00:06:43.943 22:59:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:43.943 22:59:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:43.943 22:59:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:43.943 22:59:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:43.943 22:59:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:43.943 22:59:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:43.943 22:59:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:43.943 22:59:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:43.943 22:59:10 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:43.943 22:59:10 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:43.943 22:59:10 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:43.943 22:59:10 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:43.944 22:59:10 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:43.944 22:59:10 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:43.944 22:59:10 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:43.944 22:59:10 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:43.944 22:59:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:43.944 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:06:43.944 22:59:10 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:43.944 22:59:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:43.944 22:59:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:43.944 22:59:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:43.944 22:59:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:43.944 22:59:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:43.944 22:59:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:43.944 22:59:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:43.944 22:59:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:43.944 22:59:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:43.944 22:59:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:43.944 22:59:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:43.944 22:59:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.851 22:59:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:45.851 22:59:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:45.851 22:59:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:45.851 22:59:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:45.851 22:59:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:45.851 22:59:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:45.851 22:59:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:45.851 22:59:12 -- nvmf/common.sh@294 -- # net_devs=() 00:06:45.851 22:59:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:45.851 22:59:12 -- nvmf/common.sh@295 -- # e810=() 00:06:45.851 22:59:12 -- nvmf/common.sh@295 -- # local -ga e810 00:06:45.851 22:59:12 -- nvmf/common.sh@296 -- # x722=() 00:06:45.851 22:59:12 -- nvmf/common.sh@296 -- # local -ga x722 00:06:45.851 22:59:12 -- nvmf/common.sh@297 -- # mlx=() 00:06:45.851 22:59:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:45.851 22:59:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:45.851 22:59:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:45.851 22:59:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:45.851 22:59:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:45.851 22:59:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.851 22:59:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:45.851 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:45.851 22:59:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.851 22:59:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:45.851 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:45.851 22:59:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:45.851 22:59:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:45.851 22:59:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.851 22:59:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.851 22:59:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.851 22:59:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.851 22:59:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:45.851 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:45.851 22:59:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.852 22:59:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.852 22:59:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.852 22:59:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.852 22:59:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.852 22:59:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:45.852 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:45.852 22:59:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.852 22:59:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:45.852 22:59:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:45.852 22:59:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:45.852 22:59:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:45.852 22:59:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:45.852 22:59:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:45.852 22:59:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:45.852 22:59:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:45.852 22:59:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:45.852 22:59:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:45.852 22:59:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:45.852 22:59:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:45.852 22:59:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:45.852 22:59:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:45.852 22:59:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:45.852 22:59:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:45.852 22:59:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:45.852 22:59:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:46.111 22:59:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:46.111 22:59:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:46.111 22:59:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:46.111 22:59:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:46.111 22:59:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:46.111 22:59:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:46.111 22:59:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:46.111 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:46.111 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:06:46.111 00:06:46.111 --- 10.0.0.2 ping statistics --- 00:06:46.111 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:46.111 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:06:46.111 22:59:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:46.111 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:46.111 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:06:46.111 00:06:46.111 --- 10.0.0.1 ping statistics --- 00:06:46.111 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:46.111 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:06:46.111 22:59:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:46.111 22:59:12 -- nvmf/common.sh@410 -- # return 0 00:06:46.111 22:59:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:46.111 22:59:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:46.111 22:59:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:46.111 22:59:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:46.111 22:59:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:46.111 22:59:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:46.111 22:59:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:46.111 22:59:12 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:46.111 22:59:12 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:46.111 22:59:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:46.111 22:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.111 22:59:12 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:46.111 22:59:12 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:46.111 22:59:12 -- target/nvmf_example.sh@34 -- # nvmfpid=101791 00:06:46.111 22:59:12 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:46.111 22:59:12 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:46.111 22:59:12 -- target/nvmf_example.sh@36 -- # waitforlisten 101791 00:06:46.111 22:59:12 -- common/autotest_common.sh@829 -- # '[' -z 101791 ']' 00:06:46.111 22:59:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:46.111 22:59:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:46.111 22:59:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:46.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:46.111 22:59:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:46.111 22:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.111 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.371 22:59:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.371 22:59:12 -- common/autotest_common.sh@862 -- # return 0 00:06:46.371 22:59:12 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:46.371 22:59:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:46.371 22:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.371 22:59:12 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:46.371 22:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.371 22:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.371 22:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.371 22:59:12 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:46.371 22:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.371 22:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.371 22:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.371 22:59:12 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:46.371 22:59:12 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:46.371 22:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.371 22:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.371 22:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.371 22:59:12 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:46.371 22:59:12 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:46.371 22:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.371 22:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.371 22:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.371 22:59:12 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:46.371 22:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.371 22:59:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.371 22:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.371 22:59:12 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:46.371 22:59:12 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:46.630 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.609 Initializing NVMe Controllers 00:06:56.609 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:56.609 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:56.609 Initialization complete. Launching workers. 00:06:56.609 ======================================================== 00:06:56.609 Latency(us) 00:06:56.609 Device Information : IOPS MiB/s Average min max 00:06:56.609 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15039.43 58.75 4256.71 873.97 16137.39 00:06:56.609 ======================================================== 00:06:56.609 Total : 15039.43 58.75 4256.71 873.97 16137.39 00:06:56.609 00:06:56.609 22:59:22 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:56.609 22:59:22 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:56.609 22:59:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:56.609 22:59:22 -- nvmf/common.sh@116 -- # sync 00:06:56.609 22:59:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:56.609 22:59:22 -- nvmf/common.sh@119 -- # set +e 00:06:56.609 22:59:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:56.609 22:59:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:56.609 rmmod nvme_tcp 00:06:56.609 rmmod nvme_fabrics 00:06:56.609 rmmod nvme_keyring 00:06:56.609 22:59:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:56.609 22:59:22 -- nvmf/common.sh@123 -- # set -e 00:06:56.609 22:59:23 -- nvmf/common.sh@124 -- # return 0 00:06:56.609 22:59:23 -- nvmf/common.sh@477 -- # '[' -n 101791 ']' 00:06:56.609 22:59:23 -- nvmf/common.sh@478 -- # killprocess 101791 00:06:56.609 22:59:23 -- common/autotest_common.sh@936 -- # '[' -z 101791 ']' 00:06:56.609 22:59:23 -- common/autotest_common.sh@940 -- # kill -0 101791 00:06:56.868 22:59:23 -- common/autotest_common.sh@941 -- # uname 00:06:56.868 22:59:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.868 22:59:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 101791 00:06:56.868 22:59:23 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:56.868 22:59:23 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:56.868 22:59:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 101791' 00:06:56.868 killing process with pid 101791 00:06:56.868 22:59:23 -- common/autotest_common.sh@955 -- # kill 101791 00:06:56.868 22:59:23 -- common/autotest_common.sh@960 -- # wait 101791 00:06:57.128 nvmf threads initialize successfully 00:06:57.128 bdev subsystem init successfully 00:06:57.128 created a nvmf target service 00:06:57.128 create targets's poll groups done 00:06:57.128 all subsystems of target started 00:06:57.128 nvmf target is running 00:06:57.128 all subsystems of target stopped 00:06:57.128 destroy targets's poll groups done 00:06:57.128 destroyed the nvmf target service 00:06:57.128 bdev subsystem finish successfully 00:06:57.128 nvmf threads destroy successfully 00:06:57.128 22:59:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:57.128 22:59:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:57.128 22:59:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:57.128 22:59:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:57.128 22:59:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:57.128 22:59:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:57.128 22:59:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:57.128 22:59:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:59.040 22:59:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:59.040 22:59:25 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:59.040 22:59:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:59.040 22:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:59.040 00:06:59.040 real 0m15.366s 00:06:59.040 user 0m42.105s 00:06:59.040 sys 0m3.306s 00:06:59.040 22:59:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.040 22:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:59.040 ************************************ 00:06:59.040 END TEST nvmf_example 00:06:59.040 ************************************ 00:06:59.040 22:59:25 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:59.040 22:59:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:59.040 22:59:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.040 22:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:59.040 ************************************ 00:06:59.040 START TEST nvmf_filesystem 00:06:59.040 ************************************ 00:06:59.040 22:59:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:59.040 * Looking for test storage... 00:06:59.040 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.040 22:59:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:59.040 22:59:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:59.040 22:59:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:59.301 22:59:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:59.301 22:59:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:59.301 22:59:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:59.301 22:59:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:59.301 22:59:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:59.301 22:59:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:59.301 22:59:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:59.301 22:59:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:59.301 22:59:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:59.301 22:59:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:59.301 22:59:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:59.301 22:59:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:59.301 22:59:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:59.301 22:59:25 -- scripts/common.sh@344 -- # : 1 00:06:59.301 22:59:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:59.301 22:59:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:59.301 22:59:25 -- scripts/common.sh@364 -- # decimal 1 00:06:59.301 22:59:25 -- scripts/common.sh@352 -- # local d=1 00:06:59.301 22:59:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:59.301 22:59:25 -- scripts/common.sh@354 -- # echo 1 00:06:59.301 22:59:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:59.301 22:59:25 -- scripts/common.sh@365 -- # decimal 2 00:06:59.301 22:59:25 -- scripts/common.sh@352 -- # local d=2 00:06:59.301 22:59:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:59.301 22:59:25 -- scripts/common.sh@354 -- # echo 2 00:06:59.301 22:59:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:59.301 22:59:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:59.301 22:59:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:59.301 22:59:25 -- scripts/common.sh@367 -- # return 0 00:06:59.301 22:59:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:59.301 22:59:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:59.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.301 --rc genhtml_branch_coverage=1 00:06:59.301 --rc genhtml_function_coverage=1 00:06:59.301 --rc genhtml_legend=1 00:06:59.301 --rc geninfo_all_blocks=1 00:06:59.301 --rc geninfo_unexecuted_blocks=1 00:06:59.301 00:06:59.301 ' 00:06:59.301 22:59:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:59.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.301 --rc genhtml_branch_coverage=1 00:06:59.301 --rc genhtml_function_coverage=1 00:06:59.301 --rc genhtml_legend=1 00:06:59.302 --rc geninfo_all_blocks=1 00:06:59.302 --rc geninfo_unexecuted_blocks=1 00:06:59.302 00:06:59.302 ' 00:06:59.302 22:59:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:59.302 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.302 --rc genhtml_branch_coverage=1 00:06:59.302 --rc genhtml_function_coverage=1 00:06:59.302 --rc genhtml_legend=1 00:06:59.302 --rc geninfo_all_blocks=1 00:06:59.302 --rc geninfo_unexecuted_blocks=1 00:06:59.302 00:06:59.302 ' 00:06:59.302 22:59:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:59.302 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.302 --rc genhtml_branch_coverage=1 00:06:59.302 --rc genhtml_function_coverage=1 00:06:59.302 --rc genhtml_legend=1 00:06:59.302 --rc geninfo_all_blocks=1 00:06:59.302 --rc geninfo_unexecuted_blocks=1 00:06:59.302 00:06:59.302 ' 00:06:59.302 22:59:25 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:59.302 22:59:25 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:59.302 22:59:25 -- common/autotest_common.sh@34 -- # set -e 00:06:59.302 22:59:25 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:59.302 22:59:25 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:59.302 22:59:25 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:59.302 22:59:25 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:59.302 22:59:25 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:59.302 22:59:25 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:59.302 22:59:25 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:59.302 22:59:25 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:59.302 22:59:25 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:59.302 22:59:25 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:59.302 22:59:25 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:59.302 22:59:25 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:59.302 22:59:25 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:59.302 22:59:25 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:59.302 22:59:25 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:59.302 22:59:25 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:59.302 22:59:25 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:59.302 22:59:25 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:59.302 22:59:25 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:59.302 22:59:25 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:59.302 22:59:25 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:59.302 22:59:25 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:59.302 22:59:25 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:59.302 22:59:25 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:59.302 22:59:25 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:59.302 22:59:25 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:59.302 22:59:25 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:59.302 22:59:25 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:59.302 22:59:25 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:59.302 22:59:25 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:59.302 22:59:25 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:59.302 22:59:25 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:59.302 22:59:25 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:59.302 22:59:25 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:59.302 22:59:25 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:59.302 22:59:25 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:59.302 22:59:25 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:59.302 22:59:25 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:59.302 22:59:25 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:59.302 22:59:25 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:59.302 22:59:25 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:59.302 22:59:25 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:59.302 22:59:25 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:59.302 22:59:25 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:59.302 22:59:25 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:59.302 22:59:25 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:59.302 22:59:25 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:59.302 22:59:25 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:59.302 22:59:25 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:59.302 22:59:25 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:59.302 22:59:25 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:59.302 22:59:25 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:59.302 22:59:25 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:59.302 22:59:25 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:59.302 22:59:25 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:59.302 22:59:25 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:59.302 22:59:25 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:59.302 22:59:25 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:59.302 22:59:25 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:59.302 22:59:25 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:59.302 22:59:25 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:59.302 22:59:25 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:59.302 22:59:25 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:59.302 22:59:25 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:59.302 22:59:25 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:59.302 22:59:25 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:59.302 22:59:25 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:59.302 22:59:25 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:59.302 22:59:25 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:59.302 22:59:25 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:59.302 22:59:25 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:59.302 22:59:25 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:59.302 22:59:25 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:59.302 22:59:25 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:59.302 22:59:25 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:59.302 22:59:25 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:59.302 22:59:25 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:59.302 22:59:25 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:59.302 22:59:25 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:59.302 22:59:25 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:59.302 22:59:25 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:59.302 22:59:25 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:59.302 22:59:25 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:59.302 22:59:25 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:59.302 22:59:25 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:59.302 22:59:25 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:59.302 22:59:25 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:59.302 22:59:25 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:59.302 22:59:25 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:59.302 22:59:25 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:59.302 22:59:25 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:59.302 22:59:25 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:59.302 22:59:25 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:59.302 22:59:25 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:59.302 22:59:25 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:59.302 22:59:25 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:59.302 22:59:25 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:59.302 22:59:25 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:59.302 22:59:25 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:59.302 #define SPDK_CONFIG_H 00:06:59.302 #define SPDK_CONFIG_APPS 1 00:06:59.302 #define SPDK_CONFIG_ARCH native 00:06:59.302 #undef SPDK_CONFIG_ASAN 00:06:59.302 #undef SPDK_CONFIG_AVAHI 00:06:59.302 #undef SPDK_CONFIG_CET 00:06:59.302 #define SPDK_CONFIG_COVERAGE 1 00:06:59.302 #define SPDK_CONFIG_CROSS_PREFIX 00:06:59.302 #undef SPDK_CONFIG_CRYPTO 00:06:59.302 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:59.302 #undef SPDK_CONFIG_CUSTOMOCF 00:06:59.302 #undef SPDK_CONFIG_DAOS 00:06:59.302 #define SPDK_CONFIG_DAOS_DIR 00:06:59.302 #define SPDK_CONFIG_DEBUG 1 00:06:59.302 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:59.302 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:59.302 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:59.302 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:59.302 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:59.302 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:59.302 #define SPDK_CONFIG_EXAMPLES 1 00:06:59.302 #undef SPDK_CONFIG_FC 00:06:59.302 #define SPDK_CONFIG_FC_PATH 00:06:59.302 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:59.302 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:59.302 #undef SPDK_CONFIG_FUSE 00:06:59.302 #undef SPDK_CONFIG_FUZZER 00:06:59.302 #define SPDK_CONFIG_FUZZER_LIB 00:06:59.302 #undef SPDK_CONFIG_GOLANG 00:06:59.302 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:59.302 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:59.302 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:59.302 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:59.302 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:59.302 #define SPDK_CONFIG_IDXD 1 00:06:59.302 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:59.302 #undef SPDK_CONFIG_IPSEC_MB 00:06:59.302 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:59.302 #define SPDK_CONFIG_ISAL 1 00:06:59.302 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:59.302 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:59.302 #define SPDK_CONFIG_LIBDIR 00:06:59.302 #undef SPDK_CONFIG_LTO 00:06:59.302 #define SPDK_CONFIG_MAX_LCORES 00:06:59.302 #define SPDK_CONFIG_NVME_CUSE 1 00:06:59.302 #undef SPDK_CONFIG_OCF 00:06:59.302 #define SPDK_CONFIG_OCF_PATH 00:06:59.302 #define SPDK_CONFIG_OPENSSL_PATH 00:06:59.302 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:59.302 #undef SPDK_CONFIG_PGO_USE 00:06:59.302 #define SPDK_CONFIG_PREFIX /usr/local 00:06:59.302 #undef SPDK_CONFIG_RAID5F 00:06:59.302 #undef SPDK_CONFIG_RBD 00:06:59.302 #define SPDK_CONFIG_RDMA 1 00:06:59.302 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:59.302 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:59.302 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:59.302 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:59.302 #define SPDK_CONFIG_SHARED 1 00:06:59.302 #undef SPDK_CONFIG_SMA 00:06:59.302 #define SPDK_CONFIG_TESTS 1 00:06:59.302 #undef SPDK_CONFIG_TSAN 00:06:59.302 #define SPDK_CONFIG_UBLK 1 00:06:59.302 #define SPDK_CONFIG_UBSAN 1 00:06:59.302 #undef SPDK_CONFIG_UNIT_TESTS 00:06:59.302 #undef SPDK_CONFIG_URING 00:06:59.302 #define SPDK_CONFIG_URING_PATH 00:06:59.302 #undef SPDK_CONFIG_URING_ZNS 00:06:59.302 #undef SPDK_CONFIG_USDT 00:06:59.302 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:59.302 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:59.302 #undef SPDK_CONFIG_VFIO_USER 00:06:59.302 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:59.302 #define SPDK_CONFIG_VHOST 1 00:06:59.302 #define SPDK_CONFIG_VIRTIO 1 00:06:59.302 #undef SPDK_CONFIG_VTUNE 00:06:59.302 #define SPDK_CONFIG_VTUNE_DIR 00:06:59.302 #define SPDK_CONFIG_WERROR 1 00:06:59.302 #define SPDK_CONFIG_WPDK_DIR 00:06:59.302 #undef SPDK_CONFIG_XNVME 00:06:59.302 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:59.302 22:59:25 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:59.302 22:59:25 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:59.302 22:59:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:59.302 22:59:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:59.302 22:59:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:59.302 22:59:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.302 22:59:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.302 22:59:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.302 22:59:25 -- paths/export.sh@5 -- # export PATH 00:06:59.302 22:59:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.302 22:59:25 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:59.302 22:59:25 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:59.302 22:59:25 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:59.302 22:59:25 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:59.302 22:59:25 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:59.302 22:59:25 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:59.302 22:59:25 -- pm/common@16 -- # TEST_TAG=N/A 00:06:59.302 22:59:25 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:59.302 22:59:25 -- common/autotest_common.sh@52 -- # : 1 00:06:59.302 22:59:25 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:59.302 22:59:25 -- common/autotest_common.sh@56 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:59.302 22:59:25 -- common/autotest_common.sh@58 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:59.302 22:59:25 -- common/autotest_common.sh@60 -- # : 1 00:06:59.302 22:59:25 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:59.302 22:59:25 -- common/autotest_common.sh@62 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:59.302 22:59:25 -- common/autotest_common.sh@64 -- # : 00:06:59.302 22:59:25 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:59.302 22:59:25 -- common/autotest_common.sh@66 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:59.302 22:59:25 -- common/autotest_common.sh@68 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:59.302 22:59:25 -- common/autotest_common.sh@70 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:59.302 22:59:25 -- common/autotest_common.sh@72 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:59.302 22:59:25 -- common/autotest_common.sh@74 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:59.302 22:59:25 -- common/autotest_common.sh@76 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:59.302 22:59:25 -- common/autotest_common.sh@78 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:59.302 22:59:25 -- common/autotest_common.sh@80 -- # : 1 00:06:59.302 22:59:25 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:59.302 22:59:25 -- common/autotest_common.sh@82 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:59.302 22:59:25 -- common/autotest_common.sh@84 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:59.302 22:59:25 -- common/autotest_common.sh@86 -- # : 1 00:06:59.302 22:59:25 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:59.302 22:59:25 -- common/autotest_common.sh@88 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:59.302 22:59:25 -- common/autotest_common.sh@90 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:59.302 22:59:25 -- common/autotest_common.sh@92 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:59.302 22:59:25 -- common/autotest_common.sh@94 -- # : 0 00:06:59.302 22:59:25 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:59.302 22:59:25 -- common/autotest_common.sh@96 -- # : tcp 00:06:59.302 22:59:25 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:59.303 22:59:25 -- common/autotest_common.sh@98 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:59.303 22:59:25 -- common/autotest_common.sh@100 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:59.303 22:59:25 -- common/autotest_common.sh@102 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:59.303 22:59:25 -- common/autotest_common.sh@104 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:59.303 22:59:25 -- common/autotest_common.sh@106 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:59.303 22:59:25 -- common/autotest_common.sh@108 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:59.303 22:59:25 -- common/autotest_common.sh@110 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:59.303 22:59:25 -- common/autotest_common.sh@112 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:59.303 22:59:25 -- common/autotest_common.sh@114 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:59.303 22:59:25 -- common/autotest_common.sh@116 -- # : 1 00:06:59.303 22:59:25 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:59.303 22:59:25 -- common/autotest_common.sh@118 -- # : 00:06:59.303 22:59:25 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:59.303 22:59:25 -- common/autotest_common.sh@120 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:59.303 22:59:25 -- common/autotest_common.sh@122 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:59.303 22:59:25 -- common/autotest_common.sh@124 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:59.303 22:59:25 -- common/autotest_common.sh@126 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:59.303 22:59:25 -- common/autotest_common.sh@128 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:59.303 22:59:25 -- common/autotest_common.sh@130 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:59.303 22:59:25 -- common/autotest_common.sh@132 -- # : 00:06:59.303 22:59:25 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:59.303 22:59:25 -- common/autotest_common.sh@134 -- # : true 00:06:59.303 22:59:25 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:59.303 22:59:25 -- common/autotest_common.sh@136 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:59.303 22:59:25 -- common/autotest_common.sh@138 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:59.303 22:59:25 -- common/autotest_common.sh@140 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:59.303 22:59:25 -- common/autotest_common.sh@142 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:59.303 22:59:25 -- common/autotest_common.sh@144 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:59.303 22:59:25 -- common/autotest_common.sh@146 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:59.303 22:59:25 -- common/autotest_common.sh@148 -- # : e810 00:06:59.303 22:59:25 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:59.303 22:59:25 -- common/autotest_common.sh@150 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:59.303 22:59:25 -- common/autotest_common.sh@152 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:59.303 22:59:25 -- common/autotest_common.sh@154 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:59.303 22:59:25 -- common/autotest_common.sh@156 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:59.303 22:59:25 -- common/autotest_common.sh@158 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:59.303 22:59:25 -- common/autotest_common.sh@160 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:59.303 22:59:25 -- common/autotest_common.sh@163 -- # : 00:06:59.303 22:59:25 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:59.303 22:59:25 -- common/autotest_common.sh@165 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:59.303 22:59:25 -- common/autotest_common.sh@167 -- # : 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:59.303 22:59:25 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:59.303 22:59:25 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:59.303 22:59:25 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:59.303 22:59:25 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:59.303 22:59:25 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:59.303 22:59:25 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:59.303 22:59:25 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:59.303 22:59:25 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:59.303 22:59:25 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:59.303 22:59:25 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:59.303 22:59:25 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:59.303 22:59:25 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:59.303 22:59:25 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:59.303 22:59:25 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:59.303 22:59:25 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:59.303 22:59:25 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:59.303 22:59:25 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:59.303 22:59:25 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:59.303 22:59:25 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:59.303 22:59:25 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:59.303 22:59:25 -- common/autotest_common.sh@196 -- # cat 00:06:59.303 22:59:25 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:59.303 22:59:25 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:59.303 22:59:25 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:59.303 22:59:25 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:59.303 22:59:25 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:59.303 22:59:25 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:59.303 22:59:25 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:59.303 22:59:25 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:59.303 22:59:25 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:59.303 22:59:25 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:59.303 22:59:25 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:59.303 22:59:25 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:59.303 22:59:25 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:59.303 22:59:25 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:59.303 22:59:25 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:59.303 22:59:25 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:59.303 22:59:25 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:59.303 22:59:25 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:59.303 22:59:25 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:59.303 22:59:25 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:59.303 22:59:25 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:59.303 22:59:25 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:59.303 22:59:25 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:59.303 22:59:25 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:59.303 22:59:25 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:59.303 22:59:25 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:59.303 22:59:25 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:59.303 22:59:25 -- common/autotest_common.sh@259 -- # valgrind= 00:06:59.303 22:59:25 -- common/autotest_common.sh@265 -- # uname -s 00:06:59.303 22:59:25 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:59.303 22:59:25 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:59.303 22:59:25 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:59.303 22:59:25 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:59.303 22:59:25 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:59.303 22:59:25 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:59.303 22:59:25 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:59.303 22:59:25 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:59.303 22:59:25 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:59.303 22:59:25 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:59.303 22:59:25 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:59.303 22:59:25 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:59.303 22:59:25 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:59.303 22:59:25 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:59.303 22:59:25 -- common/autotest_common.sh@319 -- # [[ -z 103413 ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@319 -- # kill -0 103413 00:06:59.303 22:59:25 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:59.303 22:59:25 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:59.303 22:59:25 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:59.303 22:59:25 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:59.303 22:59:25 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:59.303 22:59:25 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:59.303 22:59:25 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:59.303 22:59:25 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.CDMtsi 00:06:59.303 22:59:25 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:59.303 22:59:25 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.CDMtsi/tests/target /tmp/spdk.CDMtsi 00:06:59.303 22:59:25 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:59.303 22:59:25 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.303 22:59:25 -- common/autotest_common.sh@328 -- # df -T 00:06:59.303 22:59:25 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:59.303 22:59:25 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:59.303 22:59:25 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:59.303 22:59:25 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:59.303 22:59:25 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # avails["$mount"]=56689545216 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988503552 00:06:59.303 22:59:25 -- common/autotest_common.sh@364 -- # uses["$mount"]=5298958336 00:06:59.303 22:59:25 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # avails["$mount"]=30992994304 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:06:59.303 22:59:25 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:06:59.303 22:59:25 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:59.303 22:59:25 -- common/autotest_common.sh@364 -- # uses["$mount"]=8785920 00:06:59.303 22:59:25 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993944576 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:06:59.303 22:59:25 -- common/autotest_common.sh@364 -- # uses["$mount"]=307200 00:06:59.303 22:59:25 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:59.303 22:59:25 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:59.303 22:59:25 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:59.303 22:59:25 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.303 22:59:25 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:59.303 * Looking for test storage... 00:06:59.303 22:59:25 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:59.303 22:59:25 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:59.303 22:59:25 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.303 22:59:25 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:59.303 22:59:25 -- common/autotest_common.sh@373 -- # mount=/ 00:06:59.303 22:59:25 -- common/autotest_common.sh@375 -- # target_space=56689545216 00:06:59.303 22:59:25 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:59.303 22:59:25 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:59.303 22:59:25 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@382 -- # new_size=7513550848 00:06:59.303 22:59:25 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:59.303 22:59:25 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.303 22:59:25 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.303 22:59:25 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.303 22:59:25 -- common/autotest_common.sh@390 -- # return 0 00:06:59.303 22:59:25 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:59.303 22:59:25 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:59.303 22:59:25 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:59.303 22:59:25 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:59.303 22:59:25 -- common/autotest_common.sh@1682 -- # true 00:06:59.303 22:59:25 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:59.303 22:59:25 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:59.303 22:59:25 -- common/autotest_common.sh@27 -- # exec 00:06:59.304 22:59:25 -- common/autotest_common.sh@29 -- # exec 00:06:59.304 22:59:25 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:59.304 22:59:25 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:59.304 22:59:25 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:59.304 22:59:25 -- common/autotest_common.sh@18 -- # set -x 00:06:59.304 22:59:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:59.304 22:59:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:59.304 22:59:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:59.304 22:59:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:59.304 22:59:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:59.304 22:59:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:59.304 22:59:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:59.304 22:59:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:59.304 22:59:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:59.304 22:59:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:59.304 22:59:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:59.304 22:59:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:59.304 22:59:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:59.304 22:59:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:59.304 22:59:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:59.304 22:59:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:59.304 22:59:25 -- scripts/common.sh@344 -- # : 1 00:06:59.304 22:59:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:59.304 22:59:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:59.304 22:59:25 -- scripts/common.sh@364 -- # decimal 1 00:06:59.304 22:59:25 -- scripts/common.sh@352 -- # local d=1 00:06:59.304 22:59:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:59.304 22:59:25 -- scripts/common.sh@354 -- # echo 1 00:06:59.304 22:59:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:59.304 22:59:25 -- scripts/common.sh@365 -- # decimal 2 00:06:59.304 22:59:25 -- scripts/common.sh@352 -- # local d=2 00:06:59.304 22:59:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:59.304 22:59:25 -- scripts/common.sh@354 -- # echo 2 00:06:59.304 22:59:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:59.304 22:59:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:59.304 22:59:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:59.304 22:59:25 -- scripts/common.sh@367 -- # return 0 00:06:59.304 22:59:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:59.304 22:59:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:59.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.304 --rc genhtml_branch_coverage=1 00:06:59.304 --rc genhtml_function_coverage=1 00:06:59.304 --rc genhtml_legend=1 00:06:59.304 --rc geninfo_all_blocks=1 00:06:59.304 --rc geninfo_unexecuted_blocks=1 00:06:59.304 00:06:59.304 ' 00:06:59.304 22:59:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:59.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.304 --rc genhtml_branch_coverage=1 00:06:59.304 --rc genhtml_function_coverage=1 00:06:59.304 --rc genhtml_legend=1 00:06:59.304 --rc geninfo_all_blocks=1 00:06:59.304 --rc geninfo_unexecuted_blocks=1 00:06:59.304 00:06:59.304 ' 00:06:59.304 22:59:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:59.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.304 --rc genhtml_branch_coverage=1 00:06:59.304 --rc genhtml_function_coverage=1 00:06:59.304 --rc genhtml_legend=1 00:06:59.304 --rc geninfo_all_blocks=1 00:06:59.304 --rc geninfo_unexecuted_blocks=1 00:06:59.304 00:06:59.304 ' 00:06:59.304 22:59:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:59.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.304 --rc genhtml_branch_coverage=1 00:06:59.304 --rc genhtml_function_coverage=1 00:06:59.304 --rc genhtml_legend=1 00:06:59.304 --rc geninfo_all_blocks=1 00:06:59.304 --rc geninfo_unexecuted_blocks=1 00:06:59.304 00:06:59.304 ' 00:06:59.304 22:59:25 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:59.304 22:59:25 -- nvmf/common.sh@7 -- # uname -s 00:06:59.304 22:59:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:59.304 22:59:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:59.304 22:59:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:59.304 22:59:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:59.304 22:59:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:59.304 22:59:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:59.304 22:59:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:59.304 22:59:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:59.304 22:59:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:59.304 22:59:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:59.304 22:59:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:59.304 22:59:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:59.304 22:59:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:59.304 22:59:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:59.304 22:59:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:59.562 22:59:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:59.562 22:59:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:59.562 22:59:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:59.562 22:59:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:59.562 22:59:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.562 22:59:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.562 22:59:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.563 22:59:25 -- paths/export.sh@5 -- # export PATH 00:06:59.563 22:59:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.563 22:59:25 -- nvmf/common.sh@46 -- # : 0 00:06:59.563 22:59:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:59.563 22:59:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:59.563 22:59:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:59.563 22:59:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:59.563 22:59:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:59.563 22:59:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:59.563 22:59:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:59.563 22:59:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:59.563 22:59:25 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:59.563 22:59:25 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:59.563 22:59:25 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:59.563 22:59:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:59.563 22:59:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:59.563 22:59:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:59.563 22:59:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:59.563 22:59:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:59.563 22:59:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:59.563 22:59:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:59.563 22:59:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:59.563 22:59:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:59.563 22:59:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:59.563 22:59:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:59.563 22:59:25 -- common/autotest_common.sh@10 -- # set +x 00:07:01.467 22:59:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:01.467 22:59:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:01.467 22:59:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:01.467 22:59:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:01.467 22:59:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:01.467 22:59:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:01.467 22:59:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:01.467 22:59:27 -- nvmf/common.sh@294 -- # net_devs=() 00:07:01.467 22:59:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:01.467 22:59:27 -- nvmf/common.sh@295 -- # e810=() 00:07:01.467 22:59:27 -- nvmf/common.sh@295 -- # local -ga e810 00:07:01.467 22:59:27 -- nvmf/common.sh@296 -- # x722=() 00:07:01.467 22:59:27 -- nvmf/common.sh@296 -- # local -ga x722 00:07:01.467 22:59:27 -- nvmf/common.sh@297 -- # mlx=() 00:07:01.467 22:59:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:01.467 22:59:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:01.467 22:59:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:01.467 22:59:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:01.467 22:59:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:01.467 22:59:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:01.467 22:59:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:01.467 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:01.467 22:59:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:01.467 22:59:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:01.467 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:01.467 22:59:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:01.467 22:59:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:01.467 22:59:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:01.467 22:59:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:01.467 22:59:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:01.467 22:59:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:01.467 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:01.467 22:59:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:01.467 22:59:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:01.467 22:59:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:01.467 22:59:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:01.467 22:59:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:01.467 22:59:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:01.467 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:01.467 22:59:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:01.467 22:59:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:01.467 22:59:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:01.467 22:59:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:01.467 22:59:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:01.467 22:59:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:01.467 22:59:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:01.467 22:59:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:01.467 22:59:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:01.467 22:59:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:01.467 22:59:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:01.467 22:59:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:01.467 22:59:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:01.467 22:59:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:01.467 22:59:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:01.467 22:59:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:01.467 22:59:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:01.467 22:59:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:01.467 22:59:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:01.467 22:59:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:01.467 22:59:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:01.467 22:59:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:01.726 22:59:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:01.726 22:59:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:01.726 22:59:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:01.726 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:01.726 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:07:01.726 00:07:01.726 --- 10.0.0.2 ping statistics --- 00:07:01.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.726 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:07:01.726 22:59:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:01.726 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:01.726 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:07:01.726 00:07:01.726 --- 10.0.0.1 ping statistics --- 00:07:01.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.726 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:07:01.726 22:59:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:01.726 22:59:27 -- nvmf/common.sh@410 -- # return 0 00:07:01.726 22:59:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:01.726 22:59:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:01.726 22:59:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:01.726 22:59:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:01.726 22:59:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:01.726 22:59:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:01.726 22:59:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:01.726 22:59:27 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:01.726 22:59:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:01.726 22:59:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.726 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:07:01.726 ************************************ 00:07:01.726 START TEST nvmf_filesystem_no_in_capsule 00:07:01.726 ************************************ 00:07:01.726 22:59:27 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:01.726 22:59:27 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:01.726 22:59:27 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:01.726 22:59:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:01.726 22:59:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:01.726 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:07:01.726 22:59:27 -- nvmf/common.sh@469 -- # nvmfpid=105058 00:07:01.726 22:59:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:01.726 22:59:27 -- nvmf/common.sh@470 -- # waitforlisten 105058 00:07:01.726 22:59:27 -- common/autotest_common.sh@829 -- # '[' -z 105058 ']' 00:07:01.726 22:59:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:01.726 22:59:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:01.726 22:59:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:01.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:01.726 22:59:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:01.726 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:07:01.726 [2024-11-26 22:59:27.969543] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:01.726 [2024-11-26 22:59:27.969629] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:01.726 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.726 [2024-11-26 22:59:28.038029] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:01.985 [2024-11-26 22:59:28.160108] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:01.985 [2024-11-26 22:59:28.160276] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:01.985 [2024-11-26 22:59:28.160305] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:01.985 [2024-11-26 22:59:28.160328] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:01.985 [2024-11-26 22:59:28.160439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:01.985 [2024-11-26 22:59:28.160491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:01.985 [2024-11-26 22:59:28.160549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:01.985 [2024-11-26 22:59:28.160555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.918 22:59:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:02.918 22:59:28 -- common/autotest_common.sh@862 -- # return 0 00:07:02.918 22:59:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:02.918 22:59:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:02.918 22:59:28 -- common/autotest_common.sh@10 -- # set +x 00:07:02.919 22:59:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:02.919 22:59:28 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:02.919 22:59:28 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:02.919 22:59:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:02.919 22:59:28 -- common/autotest_common.sh@10 -- # set +x 00:07:02.919 [2024-11-26 22:59:28.970055] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:02.919 22:59:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:02.919 22:59:28 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:02.919 22:59:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:02.919 22:59:28 -- common/autotest_common.sh@10 -- # set +x 00:07:02.919 Malloc1 00:07:02.919 22:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:02.919 22:59:29 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:02.919 22:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:02.919 22:59:29 -- common/autotest_common.sh@10 -- # set +x 00:07:02.919 22:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:02.919 22:59:29 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:02.919 22:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:02.919 22:59:29 -- common/autotest_common.sh@10 -- # set +x 00:07:02.919 22:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:02.919 22:59:29 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:02.919 22:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:02.919 22:59:29 -- common/autotest_common.sh@10 -- # set +x 00:07:02.919 [2024-11-26 22:59:29.149865] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:02.919 22:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:02.919 22:59:29 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:02.919 22:59:29 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:02.919 22:59:29 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:02.919 22:59:29 -- common/autotest_common.sh@1369 -- # local bs 00:07:02.919 22:59:29 -- common/autotest_common.sh@1370 -- # local nb 00:07:02.919 22:59:29 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:02.919 22:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:02.919 22:59:29 -- common/autotest_common.sh@10 -- # set +x 00:07:02.919 22:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:02.919 22:59:29 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:02.919 { 00:07:02.919 "name": "Malloc1", 00:07:02.919 "aliases": [ 00:07:02.919 "6dfe8e59-3bec-4432-91b6-d19a636f6540" 00:07:02.919 ], 00:07:02.919 "product_name": "Malloc disk", 00:07:02.919 "block_size": 512, 00:07:02.919 "num_blocks": 1048576, 00:07:02.919 "uuid": "6dfe8e59-3bec-4432-91b6-d19a636f6540", 00:07:02.919 "assigned_rate_limits": { 00:07:02.919 "rw_ios_per_sec": 0, 00:07:02.919 "rw_mbytes_per_sec": 0, 00:07:02.919 "r_mbytes_per_sec": 0, 00:07:02.919 "w_mbytes_per_sec": 0 00:07:02.919 }, 00:07:02.919 "claimed": true, 00:07:02.919 "claim_type": "exclusive_write", 00:07:02.919 "zoned": false, 00:07:02.919 "supported_io_types": { 00:07:02.919 "read": true, 00:07:02.919 "write": true, 00:07:02.919 "unmap": true, 00:07:02.919 "write_zeroes": true, 00:07:02.919 "flush": true, 00:07:02.919 "reset": true, 00:07:02.919 "compare": false, 00:07:02.919 "compare_and_write": false, 00:07:02.919 "abort": true, 00:07:02.919 "nvme_admin": false, 00:07:02.919 "nvme_io": false 00:07:02.919 }, 00:07:02.919 "memory_domains": [ 00:07:02.919 { 00:07:02.919 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:02.919 "dma_device_type": 2 00:07:02.919 } 00:07:02.919 ], 00:07:02.919 "driver_specific": {} 00:07:02.919 } 00:07:02.919 ]' 00:07:02.919 22:59:29 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:02.919 22:59:29 -- common/autotest_common.sh@1372 -- # bs=512 00:07:02.919 22:59:29 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:02.919 22:59:29 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:02.919 22:59:29 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:02.919 22:59:29 -- common/autotest_common.sh@1377 -- # echo 512 00:07:02.919 22:59:29 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:02.919 22:59:29 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:03.853 22:59:29 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:03.853 22:59:29 -- common/autotest_common.sh@1187 -- # local i=0 00:07:03.853 22:59:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:03.853 22:59:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:03.853 22:59:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:05.755 22:59:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:05.755 22:59:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:05.755 22:59:31 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:05.755 22:59:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:05.755 22:59:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:05.755 22:59:31 -- common/autotest_common.sh@1197 -- # return 0 00:07:05.755 22:59:31 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:05.755 22:59:31 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:05.755 22:59:31 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:05.755 22:59:31 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:05.755 22:59:31 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:05.755 22:59:31 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:05.755 22:59:31 -- setup/common.sh@80 -- # echo 536870912 00:07:05.755 22:59:31 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:05.755 22:59:31 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:05.755 22:59:31 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:05.755 22:59:31 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:06.013 22:59:32 -- target/filesystem.sh@69 -- # partprobe 00:07:06.272 22:59:32 -- target/filesystem.sh@70 -- # sleep 1 00:07:07.647 22:59:33 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:07.647 22:59:33 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:07.647 22:59:33 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:07.647 22:59:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.647 22:59:33 -- common/autotest_common.sh@10 -- # set +x 00:07:07.647 ************************************ 00:07:07.647 START TEST filesystem_ext4 00:07:07.647 ************************************ 00:07:07.647 22:59:33 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:07.647 22:59:33 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:07.647 22:59:33 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:07.647 22:59:33 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:07.647 22:59:33 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:07.647 22:59:33 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:07.647 22:59:33 -- common/autotest_common.sh@914 -- # local i=0 00:07:07.647 22:59:33 -- common/autotest_common.sh@915 -- # local force 00:07:07.647 22:59:33 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:07.647 22:59:33 -- common/autotest_common.sh@918 -- # force=-F 00:07:07.647 22:59:33 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:07.647 mke2fs 1.47.0 (5-Feb-2023) 00:07:07.647 Discarding device blocks: 0/522240 done 00:07:07.647 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:07.647 Filesystem UUID: 7e3b17c6-8237-4301-b65c-af3c2b0a7540 00:07:07.647 Superblock backups stored on blocks: 00:07:07.647 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:07.647 00:07:07.647 Allocating group tables: 0/64 done 00:07:07.647 Writing inode tables: 0/64 done 00:07:07.647 Creating journal (8192 blocks): done 00:07:07.647 Writing superblocks and filesystem accounting information: 0/64 done 00:07:07.647 00:07:07.647 22:59:33 -- common/autotest_common.sh@931 -- # return 0 00:07:07.647 22:59:33 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:14.219 22:59:39 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:14.219 22:59:39 -- target/filesystem.sh@25 -- # sync 00:07:14.219 22:59:39 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:14.219 22:59:39 -- target/filesystem.sh@27 -- # sync 00:07:14.219 22:59:39 -- target/filesystem.sh@29 -- # i=0 00:07:14.219 22:59:39 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:14.219 22:59:39 -- target/filesystem.sh@37 -- # kill -0 105058 00:07:14.219 22:59:39 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:14.219 22:59:39 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:14.219 22:59:39 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:14.219 22:59:39 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:14.219 00:07:14.219 real 0m6.044s 00:07:14.219 user 0m0.020s 00:07:14.219 sys 0m0.049s 00:07:14.219 22:59:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.219 22:59:39 -- common/autotest_common.sh@10 -- # set +x 00:07:14.219 ************************************ 00:07:14.219 END TEST filesystem_ext4 00:07:14.220 ************************************ 00:07:14.220 22:59:39 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:14.220 22:59:39 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:14.220 22:59:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.220 22:59:39 -- common/autotest_common.sh@10 -- # set +x 00:07:14.220 ************************************ 00:07:14.220 START TEST filesystem_btrfs 00:07:14.220 ************************************ 00:07:14.220 22:59:39 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:14.220 22:59:39 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:14.220 22:59:39 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:14.220 22:59:39 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:14.220 22:59:39 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:14.220 22:59:39 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:14.220 22:59:39 -- common/autotest_common.sh@914 -- # local i=0 00:07:14.220 22:59:39 -- common/autotest_common.sh@915 -- # local force 00:07:14.220 22:59:39 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:14.220 22:59:39 -- common/autotest_common.sh@920 -- # force=-f 00:07:14.220 22:59:39 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:14.220 btrfs-progs v6.8.1 00:07:14.220 See https://btrfs.readthedocs.io for more information. 00:07:14.220 00:07:14.220 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:14.220 NOTE: several default settings have changed in version 5.15, please make sure 00:07:14.220 this does not affect your deployments: 00:07:14.220 - DUP for metadata (-m dup) 00:07:14.220 - enabled no-holes (-O no-holes) 00:07:14.220 - enabled free-space-tree (-R free-space-tree) 00:07:14.220 00:07:14.220 Label: (null) 00:07:14.220 UUID: 3d17efe5-8727-409e-b999-fd96ccd98cd4 00:07:14.220 Node size: 16384 00:07:14.220 Sector size: 4096 (CPU page size: 4096) 00:07:14.220 Filesystem size: 510.00MiB 00:07:14.220 Block group profiles: 00:07:14.220 Data: single 8.00MiB 00:07:14.220 Metadata: DUP 32.00MiB 00:07:14.220 System: DUP 8.00MiB 00:07:14.220 SSD detected: yes 00:07:14.220 Zoned device: no 00:07:14.220 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:14.220 Checksum: crc32c 00:07:14.220 Number of devices: 1 00:07:14.220 Devices: 00:07:14.220 ID SIZE PATH 00:07:14.220 1 510.00MiB /dev/nvme0n1p1 00:07:14.220 00:07:14.220 22:59:39 -- common/autotest_common.sh@931 -- # return 0 00:07:14.220 22:59:39 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:14.479 22:59:40 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:14.479 22:59:40 -- target/filesystem.sh@25 -- # sync 00:07:14.479 22:59:40 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:14.479 22:59:40 -- target/filesystem.sh@27 -- # sync 00:07:14.479 22:59:40 -- target/filesystem.sh@29 -- # i=0 00:07:14.479 22:59:40 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:14.479 22:59:40 -- target/filesystem.sh@37 -- # kill -0 105058 00:07:14.479 22:59:40 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:14.479 22:59:40 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:14.479 22:59:40 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:14.479 22:59:40 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:14.479 00:07:14.479 real 0m1.141s 00:07:14.479 user 0m0.016s 00:07:14.479 sys 0m0.130s 00:07:14.479 22:59:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.479 22:59:40 -- common/autotest_common.sh@10 -- # set +x 00:07:14.479 ************************************ 00:07:14.479 END TEST filesystem_btrfs 00:07:14.479 ************************************ 00:07:14.479 22:59:40 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:14.479 22:59:40 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:14.479 22:59:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.479 22:59:40 -- common/autotest_common.sh@10 -- # set +x 00:07:14.738 ************************************ 00:07:14.738 START TEST filesystem_xfs 00:07:14.738 ************************************ 00:07:14.738 22:59:40 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:14.738 22:59:40 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:14.738 22:59:40 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:14.738 22:59:40 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:14.738 22:59:40 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:14.738 22:59:40 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:14.738 22:59:40 -- common/autotest_common.sh@914 -- # local i=0 00:07:14.738 22:59:40 -- common/autotest_common.sh@915 -- # local force 00:07:14.738 22:59:40 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:14.738 22:59:40 -- common/autotest_common.sh@920 -- # force=-f 00:07:14.738 22:59:40 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:14.738 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:14.738 = sectsz=512 attr=2, projid32bit=1 00:07:14.738 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:14.738 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:14.738 data = bsize=4096 blocks=130560, imaxpct=25 00:07:14.738 = sunit=0 swidth=0 blks 00:07:14.738 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:14.738 log =internal log bsize=4096 blocks=16384, version=2 00:07:14.738 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:14.738 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:15.671 Discarding blocks...Done. 00:07:15.671 22:59:42 -- common/autotest_common.sh@931 -- # return 0 00:07:15.671 22:59:42 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:18.200 22:59:44 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:18.200 22:59:44 -- target/filesystem.sh@25 -- # sync 00:07:18.200 22:59:44 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:18.200 22:59:44 -- target/filesystem.sh@27 -- # sync 00:07:18.200 22:59:44 -- target/filesystem.sh@29 -- # i=0 00:07:18.200 22:59:44 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:18.200 22:59:44 -- target/filesystem.sh@37 -- # kill -0 105058 00:07:18.200 22:59:44 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:18.200 22:59:44 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:18.200 22:59:44 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:18.200 22:59:44 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:18.200 00:07:18.200 real 0m3.489s 00:07:18.200 user 0m0.013s 00:07:18.200 sys 0m0.091s 00:07:18.200 22:59:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:18.200 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:07:18.200 ************************************ 00:07:18.200 END TEST filesystem_xfs 00:07:18.200 ************************************ 00:07:18.200 22:59:44 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:18.459 22:59:44 -- target/filesystem.sh@93 -- # sync 00:07:18.459 22:59:44 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:18.459 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:18.459 22:59:44 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:18.459 22:59:44 -- common/autotest_common.sh@1208 -- # local i=0 00:07:18.459 22:59:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:18.459 22:59:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:18.459 22:59:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:18.459 22:59:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:18.459 22:59:44 -- common/autotest_common.sh@1220 -- # return 0 00:07:18.459 22:59:44 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:18.459 22:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.459 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:07:18.459 22:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.459 22:59:44 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:18.459 22:59:44 -- target/filesystem.sh@101 -- # killprocess 105058 00:07:18.459 22:59:44 -- common/autotest_common.sh@936 -- # '[' -z 105058 ']' 00:07:18.459 22:59:44 -- common/autotest_common.sh@940 -- # kill -0 105058 00:07:18.459 22:59:44 -- common/autotest_common.sh@941 -- # uname 00:07:18.459 22:59:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:18.459 22:59:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 105058 00:07:18.459 22:59:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:18.459 22:59:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:18.459 22:59:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 105058' 00:07:18.459 killing process with pid 105058 00:07:18.459 22:59:44 -- common/autotest_common.sh@955 -- # kill 105058 00:07:18.459 22:59:44 -- common/autotest_common.sh@960 -- # wait 105058 00:07:19.027 22:59:45 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:19.027 00:07:19.027 real 0m17.321s 00:07:19.027 user 1m6.858s 00:07:19.027 sys 0m2.246s 00:07:19.027 22:59:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.027 22:59:45 -- common/autotest_common.sh@10 -- # set +x 00:07:19.027 ************************************ 00:07:19.027 END TEST nvmf_filesystem_no_in_capsule 00:07:19.027 ************************************ 00:07:19.027 22:59:45 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:19.027 22:59:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:19.027 22:59:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.027 22:59:45 -- common/autotest_common.sh@10 -- # set +x 00:07:19.027 ************************************ 00:07:19.027 START TEST nvmf_filesystem_in_capsule 00:07:19.027 ************************************ 00:07:19.027 22:59:45 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:19.027 22:59:45 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:19.027 22:59:45 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:19.027 22:59:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:19.027 22:59:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:19.027 22:59:45 -- common/autotest_common.sh@10 -- # set +x 00:07:19.027 22:59:45 -- nvmf/common.sh@469 -- # nvmfpid=107347 00:07:19.027 22:59:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:19.027 22:59:45 -- nvmf/common.sh@470 -- # waitforlisten 107347 00:07:19.027 22:59:45 -- common/autotest_common.sh@829 -- # '[' -z 107347 ']' 00:07:19.027 22:59:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:19.027 22:59:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:19.027 22:59:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:19.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:19.027 22:59:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:19.027 22:59:45 -- common/autotest_common.sh@10 -- # set +x 00:07:19.027 [2024-11-26 22:59:45.321777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.027 [2024-11-26 22:59:45.321883] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:19.027 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.027 [2024-11-26 22:59:45.390430] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:19.286 [2024-11-26 22:59:45.511017] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:19.286 [2024-11-26 22:59:45.511182] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:19.286 [2024-11-26 22:59:45.511202] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:19.286 [2024-11-26 22:59:45.511217] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:19.286 [2024-11-26 22:59:45.511435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:19.286 [2024-11-26 22:59:45.511487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:19.286 [2024-11-26 22:59:45.511562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:19.286 [2024-11-26 22:59:45.511566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.222 22:59:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:20.222 22:59:46 -- common/autotest_common.sh@862 -- # return 0 00:07:20.222 22:59:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:20.222 22:59:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:20.222 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:07:20.222 22:59:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:20.222 22:59:46 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:20.222 22:59:46 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:20.222 22:59:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.222 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:07:20.222 [2024-11-26 22:59:46.318112] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:20.222 22:59:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.222 22:59:46 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:20.222 22:59:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.222 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:07:20.222 Malloc1 00:07:20.222 22:59:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.222 22:59:46 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:20.222 22:59:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.222 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:07:20.222 22:59:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.222 22:59:46 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:20.222 22:59:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.222 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:07:20.222 22:59:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.222 22:59:46 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:20.222 22:59:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.222 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:07:20.222 [2024-11-26 22:59:46.502552] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:20.222 22:59:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.222 22:59:46 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:20.222 22:59:46 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:20.222 22:59:46 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:20.222 22:59:46 -- common/autotest_common.sh@1369 -- # local bs 00:07:20.222 22:59:46 -- common/autotest_common.sh@1370 -- # local nb 00:07:20.222 22:59:46 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:20.222 22:59:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.222 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:07:20.222 22:59:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.222 22:59:46 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:20.222 { 00:07:20.222 "name": "Malloc1", 00:07:20.222 "aliases": [ 00:07:20.222 "aca0d1bb-db37-4e86-b54f-8ad90ead3273" 00:07:20.222 ], 00:07:20.222 "product_name": "Malloc disk", 00:07:20.222 "block_size": 512, 00:07:20.222 "num_blocks": 1048576, 00:07:20.222 "uuid": "aca0d1bb-db37-4e86-b54f-8ad90ead3273", 00:07:20.222 "assigned_rate_limits": { 00:07:20.222 "rw_ios_per_sec": 0, 00:07:20.222 "rw_mbytes_per_sec": 0, 00:07:20.222 "r_mbytes_per_sec": 0, 00:07:20.222 "w_mbytes_per_sec": 0 00:07:20.222 }, 00:07:20.222 "claimed": true, 00:07:20.222 "claim_type": "exclusive_write", 00:07:20.222 "zoned": false, 00:07:20.222 "supported_io_types": { 00:07:20.222 "read": true, 00:07:20.222 "write": true, 00:07:20.222 "unmap": true, 00:07:20.222 "write_zeroes": true, 00:07:20.222 "flush": true, 00:07:20.222 "reset": true, 00:07:20.222 "compare": false, 00:07:20.222 "compare_and_write": false, 00:07:20.222 "abort": true, 00:07:20.222 "nvme_admin": false, 00:07:20.222 "nvme_io": false 00:07:20.222 }, 00:07:20.222 "memory_domains": [ 00:07:20.222 { 00:07:20.222 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:20.222 "dma_device_type": 2 00:07:20.222 } 00:07:20.222 ], 00:07:20.222 "driver_specific": {} 00:07:20.222 } 00:07:20.222 ]' 00:07:20.222 22:59:46 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:20.222 22:59:46 -- common/autotest_common.sh@1372 -- # bs=512 00:07:20.222 22:59:46 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:20.222 22:59:46 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:20.222 22:59:46 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:20.222 22:59:46 -- common/autotest_common.sh@1377 -- # echo 512 00:07:20.222 22:59:46 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:20.222 22:59:46 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:21.156 22:59:47 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:21.156 22:59:47 -- common/autotest_common.sh@1187 -- # local i=0 00:07:21.156 22:59:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:21.156 22:59:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:21.156 22:59:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:23.064 22:59:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:23.064 22:59:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:23.064 22:59:49 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:23.064 22:59:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:23.064 22:59:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:23.064 22:59:49 -- common/autotest_common.sh@1197 -- # return 0 00:07:23.064 22:59:49 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:23.064 22:59:49 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:23.064 22:59:49 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:23.064 22:59:49 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:23.064 22:59:49 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:23.064 22:59:49 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:23.064 22:59:49 -- setup/common.sh@80 -- # echo 536870912 00:07:23.064 22:59:49 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:23.064 22:59:49 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:23.064 22:59:49 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:23.064 22:59:49 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:23.322 22:59:49 -- target/filesystem.sh@69 -- # partprobe 00:07:24.258 22:59:50 -- target/filesystem.sh@70 -- # sleep 1 00:07:25.193 22:59:51 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:25.193 22:59:51 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:25.193 22:59:51 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:25.193 22:59:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.193 22:59:51 -- common/autotest_common.sh@10 -- # set +x 00:07:25.193 ************************************ 00:07:25.193 START TEST filesystem_in_capsule_ext4 00:07:25.193 ************************************ 00:07:25.193 22:59:51 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:25.193 22:59:51 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:25.193 22:59:51 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:25.193 22:59:51 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:25.193 22:59:51 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:25.193 22:59:51 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:25.193 22:59:51 -- common/autotest_common.sh@914 -- # local i=0 00:07:25.193 22:59:51 -- common/autotest_common.sh@915 -- # local force 00:07:25.193 22:59:51 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:25.193 22:59:51 -- common/autotest_common.sh@918 -- # force=-F 00:07:25.193 22:59:51 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:25.193 mke2fs 1.47.0 (5-Feb-2023) 00:07:25.452 Discarding device blocks: 0/522240 done 00:07:25.452 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:25.452 Filesystem UUID: f7444f38-dd93-447d-9a61-38786e05ad4d 00:07:25.452 Superblock backups stored on blocks: 00:07:25.452 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:25.452 00:07:25.452 Allocating group tables: 0/64 done 00:07:25.452 Writing inode tables: 0/64 done 00:07:25.452 Creating journal (8192 blocks): done 00:07:25.710 Writing superblocks and filesystem accounting information: 0/64 done 00:07:25.710 00:07:25.710 22:59:51 -- common/autotest_common.sh@931 -- # return 0 00:07:25.710 22:59:51 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:30.977 22:59:57 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:30.977 22:59:57 -- target/filesystem.sh@25 -- # sync 00:07:30.977 22:59:57 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:30.977 22:59:57 -- target/filesystem.sh@27 -- # sync 00:07:30.977 22:59:57 -- target/filesystem.sh@29 -- # i=0 00:07:30.977 22:59:57 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:30.977 22:59:57 -- target/filesystem.sh@37 -- # kill -0 107347 00:07:30.977 22:59:57 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:30.977 22:59:57 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:31.236 22:59:57 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:31.236 22:59:57 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:31.236 00:07:31.236 real 0m5.875s 00:07:31.236 user 0m0.029s 00:07:31.236 sys 0m0.053s 00:07:31.236 22:59:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:31.236 22:59:57 -- common/autotest_common.sh@10 -- # set +x 00:07:31.236 ************************************ 00:07:31.236 END TEST filesystem_in_capsule_ext4 00:07:31.236 ************************************ 00:07:31.236 22:59:57 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:31.236 22:59:57 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:31.236 22:59:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.236 22:59:57 -- common/autotest_common.sh@10 -- # set +x 00:07:31.236 ************************************ 00:07:31.236 START TEST filesystem_in_capsule_btrfs 00:07:31.236 ************************************ 00:07:31.236 22:59:57 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:31.236 22:59:57 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:31.236 22:59:57 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:31.236 22:59:57 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:31.236 22:59:57 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:31.236 22:59:57 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:31.236 22:59:57 -- common/autotest_common.sh@914 -- # local i=0 00:07:31.236 22:59:57 -- common/autotest_common.sh@915 -- # local force 00:07:31.236 22:59:57 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:31.236 22:59:57 -- common/autotest_common.sh@920 -- # force=-f 00:07:31.236 22:59:57 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:31.494 btrfs-progs v6.8.1 00:07:31.494 See https://btrfs.readthedocs.io for more information. 00:07:31.494 00:07:31.494 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:31.494 NOTE: several default settings have changed in version 5.15, please make sure 00:07:31.494 this does not affect your deployments: 00:07:31.494 - DUP for metadata (-m dup) 00:07:31.494 - enabled no-holes (-O no-holes) 00:07:31.494 - enabled free-space-tree (-R free-space-tree) 00:07:31.494 00:07:31.494 Label: (null) 00:07:31.494 UUID: cfdc05f5-6283-4331-b412-097b3fb1c516 00:07:31.494 Node size: 16384 00:07:31.494 Sector size: 4096 (CPU page size: 4096) 00:07:31.494 Filesystem size: 510.00MiB 00:07:31.494 Block group profiles: 00:07:31.494 Data: single 8.00MiB 00:07:31.494 Metadata: DUP 32.00MiB 00:07:31.494 System: DUP 8.00MiB 00:07:31.494 SSD detected: yes 00:07:31.494 Zoned device: no 00:07:31.494 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:31.494 Checksum: crc32c 00:07:31.494 Number of devices: 1 00:07:31.494 Devices: 00:07:31.494 ID SIZE PATH 00:07:31.494 1 510.00MiB /dev/nvme0n1p1 00:07:31.494 00:07:31.494 22:59:57 -- common/autotest_common.sh@931 -- # return 0 00:07:31.494 22:59:57 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:32.427 22:59:58 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:32.428 22:59:58 -- target/filesystem.sh@25 -- # sync 00:07:32.428 22:59:58 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:32.428 22:59:58 -- target/filesystem.sh@27 -- # sync 00:07:32.428 22:59:58 -- target/filesystem.sh@29 -- # i=0 00:07:32.428 22:59:58 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:32.428 22:59:58 -- target/filesystem.sh@37 -- # kill -0 107347 00:07:32.428 22:59:58 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:32.428 22:59:58 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:32.428 22:59:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:32.428 22:59:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:32.428 00:07:32.428 real 0m1.394s 00:07:32.428 user 0m0.017s 00:07:32.428 sys 0m0.099s 00:07:32.428 22:59:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:32.428 22:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:32.428 ************************************ 00:07:32.428 END TEST filesystem_in_capsule_btrfs 00:07:32.428 ************************************ 00:07:32.687 22:59:58 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:32.687 22:59:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:32.687 22:59:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:32.687 22:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:32.687 ************************************ 00:07:32.687 START TEST filesystem_in_capsule_xfs 00:07:32.687 ************************************ 00:07:32.687 22:59:58 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:32.687 22:59:58 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:32.687 22:59:58 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:32.687 22:59:58 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:32.687 22:59:58 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:32.687 22:59:58 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:32.687 22:59:58 -- common/autotest_common.sh@914 -- # local i=0 00:07:32.687 22:59:58 -- common/autotest_common.sh@915 -- # local force 00:07:32.687 22:59:58 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:32.687 22:59:58 -- common/autotest_common.sh@920 -- # force=-f 00:07:32.687 22:59:58 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:32.687 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:32.687 = sectsz=512 attr=2, projid32bit=1 00:07:32.687 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:32.687 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:32.687 data = bsize=4096 blocks=130560, imaxpct=25 00:07:32.687 = sunit=0 swidth=0 blks 00:07:32.687 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:32.687 log =internal log bsize=4096 blocks=16384, version=2 00:07:32.687 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:32.687 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:33.272 Discarding blocks...Done. 00:07:33.272 22:59:59 -- common/autotest_common.sh@931 -- # return 0 00:07:33.272 22:59:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:35.802 23:00:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:35.802 23:00:01 -- target/filesystem.sh@25 -- # sync 00:07:35.802 23:00:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:35.802 23:00:01 -- target/filesystem.sh@27 -- # sync 00:07:35.802 23:00:01 -- target/filesystem.sh@29 -- # i=0 00:07:35.802 23:00:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:35.802 23:00:01 -- target/filesystem.sh@37 -- # kill -0 107347 00:07:35.802 23:00:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:35.802 23:00:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:35.802 23:00:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:35.802 23:00:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:35.802 00:07:35.802 real 0m3.103s 00:07:35.802 user 0m0.014s 00:07:35.802 sys 0m0.061s 00:07:35.802 23:00:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:35.802 23:00:01 -- common/autotest_common.sh@10 -- # set +x 00:07:35.802 ************************************ 00:07:35.802 END TEST filesystem_in_capsule_xfs 00:07:35.802 ************************************ 00:07:35.802 23:00:01 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:35.802 23:00:01 -- target/filesystem.sh@93 -- # sync 00:07:35.802 23:00:01 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:35.802 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:35.802 23:00:02 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:35.802 23:00:02 -- common/autotest_common.sh@1208 -- # local i=0 00:07:35.802 23:00:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:35.802 23:00:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:35.802 23:00:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:35.802 23:00:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:35.802 23:00:02 -- common/autotest_common.sh@1220 -- # return 0 00:07:35.802 23:00:02 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:35.802 23:00:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.802 23:00:02 -- common/autotest_common.sh@10 -- # set +x 00:07:35.802 23:00:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.802 23:00:02 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:35.802 23:00:02 -- target/filesystem.sh@101 -- # killprocess 107347 00:07:35.802 23:00:02 -- common/autotest_common.sh@936 -- # '[' -z 107347 ']' 00:07:35.802 23:00:02 -- common/autotest_common.sh@940 -- # kill -0 107347 00:07:35.802 23:00:02 -- common/autotest_common.sh@941 -- # uname 00:07:35.802 23:00:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:35.802 23:00:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 107347 00:07:35.802 23:00:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:35.802 23:00:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:35.802 23:00:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 107347' 00:07:35.802 killing process with pid 107347 00:07:35.802 23:00:02 -- common/autotest_common.sh@955 -- # kill 107347 00:07:35.802 23:00:02 -- common/autotest_common.sh@960 -- # wait 107347 00:07:36.368 23:00:02 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:36.368 00:07:36.368 real 0m17.323s 00:07:36.368 user 1m6.872s 00:07:36.368 sys 0m2.207s 00:07:36.368 23:00:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.368 23:00:02 -- common/autotest_common.sh@10 -- # set +x 00:07:36.368 ************************************ 00:07:36.368 END TEST nvmf_filesystem_in_capsule 00:07:36.368 ************************************ 00:07:36.368 23:00:02 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:36.368 23:00:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:36.368 23:00:02 -- nvmf/common.sh@116 -- # sync 00:07:36.368 23:00:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:36.368 23:00:02 -- nvmf/common.sh@119 -- # set +e 00:07:36.368 23:00:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:36.368 23:00:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:36.368 rmmod nvme_tcp 00:07:36.368 rmmod nvme_fabrics 00:07:36.368 rmmod nvme_keyring 00:07:36.368 23:00:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:36.368 23:00:02 -- nvmf/common.sh@123 -- # set -e 00:07:36.368 23:00:02 -- nvmf/common.sh@124 -- # return 0 00:07:36.368 23:00:02 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:36.368 23:00:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:36.368 23:00:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:36.368 23:00:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:36.368 23:00:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:36.368 23:00:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:36.368 23:00:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:36.368 23:00:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:36.368 23:00:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:38.906 23:00:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:38.906 00:07:38.906 real 0m39.348s 00:07:38.906 user 2m14.821s 00:07:38.906 sys 0m6.071s 00:07:38.906 23:00:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.906 23:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:38.906 ************************************ 00:07:38.906 END TEST nvmf_filesystem 00:07:38.906 ************************************ 00:07:38.906 23:00:04 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:38.906 23:00:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:38.906 23:00:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.906 23:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:38.906 ************************************ 00:07:38.907 START TEST nvmf_discovery 00:07:38.907 ************************************ 00:07:38.907 23:00:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:38.907 * Looking for test storage... 00:07:38.907 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:38.907 23:00:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:38.907 23:00:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:38.907 23:00:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:38.907 23:00:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:38.907 23:00:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:38.907 23:00:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:38.907 23:00:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:38.907 23:00:04 -- scripts/common.sh@335 -- # IFS=.-: 00:07:38.907 23:00:04 -- scripts/common.sh@335 -- # read -ra ver1 00:07:38.907 23:00:04 -- scripts/common.sh@336 -- # IFS=.-: 00:07:38.907 23:00:04 -- scripts/common.sh@336 -- # read -ra ver2 00:07:38.907 23:00:04 -- scripts/common.sh@337 -- # local 'op=<' 00:07:38.907 23:00:04 -- scripts/common.sh@339 -- # ver1_l=2 00:07:38.907 23:00:04 -- scripts/common.sh@340 -- # ver2_l=1 00:07:38.907 23:00:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:38.907 23:00:04 -- scripts/common.sh@343 -- # case "$op" in 00:07:38.907 23:00:04 -- scripts/common.sh@344 -- # : 1 00:07:38.907 23:00:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:38.907 23:00:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:38.907 23:00:04 -- scripts/common.sh@364 -- # decimal 1 00:07:38.907 23:00:04 -- scripts/common.sh@352 -- # local d=1 00:07:38.907 23:00:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:38.907 23:00:04 -- scripts/common.sh@354 -- # echo 1 00:07:38.907 23:00:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:38.907 23:00:04 -- scripts/common.sh@365 -- # decimal 2 00:07:38.907 23:00:04 -- scripts/common.sh@352 -- # local d=2 00:07:38.907 23:00:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:38.907 23:00:04 -- scripts/common.sh@354 -- # echo 2 00:07:38.907 23:00:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:38.907 23:00:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:38.907 23:00:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:38.907 23:00:04 -- scripts/common.sh@367 -- # return 0 00:07:38.907 23:00:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:38.907 23:00:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:38.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:38.907 --rc genhtml_branch_coverage=1 00:07:38.907 --rc genhtml_function_coverage=1 00:07:38.907 --rc genhtml_legend=1 00:07:38.907 --rc geninfo_all_blocks=1 00:07:38.907 --rc geninfo_unexecuted_blocks=1 00:07:38.907 00:07:38.907 ' 00:07:38.907 23:00:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:38.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:38.907 --rc genhtml_branch_coverage=1 00:07:38.907 --rc genhtml_function_coverage=1 00:07:38.907 --rc genhtml_legend=1 00:07:38.907 --rc geninfo_all_blocks=1 00:07:38.907 --rc geninfo_unexecuted_blocks=1 00:07:38.907 00:07:38.907 ' 00:07:38.907 23:00:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:38.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:38.907 --rc genhtml_branch_coverage=1 00:07:38.907 --rc genhtml_function_coverage=1 00:07:38.907 --rc genhtml_legend=1 00:07:38.907 --rc geninfo_all_blocks=1 00:07:38.907 --rc geninfo_unexecuted_blocks=1 00:07:38.907 00:07:38.907 ' 00:07:38.907 23:00:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:38.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:38.907 --rc genhtml_branch_coverage=1 00:07:38.907 --rc genhtml_function_coverage=1 00:07:38.907 --rc genhtml_legend=1 00:07:38.907 --rc geninfo_all_blocks=1 00:07:38.907 --rc geninfo_unexecuted_blocks=1 00:07:38.907 00:07:38.907 ' 00:07:38.907 23:00:04 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:38.907 23:00:04 -- nvmf/common.sh@7 -- # uname -s 00:07:38.907 23:00:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:38.907 23:00:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:38.907 23:00:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:38.907 23:00:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:38.907 23:00:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:38.907 23:00:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:38.907 23:00:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:38.907 23:00:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:38.907 23:00:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:38.907 23:00:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:38.907 23:00:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:38.907 23:00:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:38.907 23:00:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:38.907 23:00:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:38.907 23:00:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:38.907 23:00:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:38.907 23:00:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:38.907 23:00:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:38.907 23:00:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:38.907 23:00:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.907 23:00:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.907 23:00:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.907 23:00:04 -- paths/export.sh@5 -- # export PATH 00:07:38.907 23:00:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.907 23:00:04 -- nvmf/common.sh@46 -- # : 0 00:07:38.907 23:00:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:38.907 23:00:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:38.907 23:00:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:38.907 23:00:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:38.907 23:00:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:38.907 23:00:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:38.907 23:00:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:38.907 23:00:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:38.907 23:00:04 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:38.907 23:00:04 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:38.907 23:00:04 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:38.907 23:00:04 -- target/discovery.sh@15 -- # hash nvme 00:07:38.907 23:00:04 -- target/discovery.sh@20 -- # nvmftestinit 00:07:38.907 23:00:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:38.907 23:00:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:38.907 23:00:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:38.907 23:00:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:38.907 23:00:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:38.907 23:00:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:38.907 23:00:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:38.907 23:00:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:38.907 23:00:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:38.907 23:00:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:38.907 23:00:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:38.907 23:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:40.813 23:00:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:40.813 23:00:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:40.813 23:00:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:40.813 23:00:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:40.813 23:00:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:40.813 23:00:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:40.813 23:00:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:40.813 23:00:06 -- nvmf/common.sh@294 -- # net_devs=() 00:07:40.813 23:00:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:40.813 23:00:06 -- nvmf/common.sh@295 -- # e810=() 00:07:40.813 23:00:06 -- nvmf/common.sh@295 -- # local -ga e810 00:07:40.813 23:00:06 -- nvmf/common.sh@296 -- # x722=() 00:07:40.813 23:00:06 -- nvmf/common.sh@296 -- # local -ga x722 00:07:40.813 23:00:06 -- nvmf/common.sh@297 -- # mlx=() 00:07:40.813 23:00:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:40.813 23:00:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:40.813 23:00:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:40.813 23:00:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:40.813 23:00:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:40.813 23:00:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:40.813 23:00:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:40.813 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:40.813 23:00:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:40.813 23:00:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:40.813 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:40.813 23:00:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:40.813 23:00:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:40.813 23:00:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:40.813 23:00:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:40.813 23:00:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:40.813 23:00:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:40.813 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:40.813 23:00:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:40.813 23:00:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:40.813 23:00:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:40.813 23:00:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:40.813 23:00:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:40.813 23:00:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:40.813 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:40.813 23:00:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:40.813 23:00:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:40.813 23:00:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:40.813 23:00:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:40.813 23:00:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:40.813 23:00:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:40.813 23:00:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:40.813 23:00:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:40.813 23:00:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:40.813 23:00:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:40.814 23:00:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:40.814 23:00:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:40.814 23:00:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:40.814 23:00:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:40.814 23:00:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:40.814 23:00:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:40.814 23:00:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:40.814 23:00:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:40.814 23:00:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:40.814 23:00:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:40.814 23:00:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:40.814 23:00:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:40.814 23:00:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:40.814 23:00:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:40.814 23:00:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:40.814 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:40.814 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:07:40.814 00:07:40.814 --- 10.0.0.2 ping statistics --- 00:07:40.814 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:40.814 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:07:40.814 23:00:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:40.814 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:40.814 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.067 ms 00:07:40.814 00:07:40.814 --- 10.0.0.1 ping statistics --- 00:07:40.814 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:40.814 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:07:40.814 23:00:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:40.814 23:00:07 -- nvmf/common.sh@410 -- # return 0 00:07:40.814 23:00:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:40.814 23:00:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:40.814 23:00:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:40.814 23:00:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:40.814 23:00:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:40.814 23:00:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:40.814 23:00:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:40.814 23:00:07 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:40.814 23:00:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:40.814 23:00:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:40.814 23:00:07 -- common/autotest_common.sh@10 -- # set +x 00:07:40.814 23:00:07 -- nvmf/common.sh@469 -- # nvmfpid=111718 00:07:40.814 23:00:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:40.814 23:00:07 -- nvmf/common.sh@470 -- # waitforlisten 111718 00:07:40.814 23:00:07 -- common/autotest_common.sh@829 -- # '[' -z 111718 ']' 00:07:40.814 23:00:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:40.814 23:00:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:40.814 23:00:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:40.814 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:40.814 23:00:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:40.814 23:00:07 -- common/autotest_common.sh@10 -- # set +x 00:07:40.814 [2024-11-26 23:00:07.092046] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:40.814 [2024-11-26 23:00:07.092117] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:40.814 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.814 [2024-11-26 23:00:07.161610] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:41.072 [2024-11-26 23:00:07.281569] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:41.072 [2024-11-26 23:00:07.281732] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:41.072 [2024-11-26 23:00:07.281751] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:41.072 [2024-11-26 23:00:07.281766] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:41.072 [2024-11-26 23:00:07.281866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:41.072 [2024-11-26 23:00:07.281924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:41.072 [2024-11-26 23:00:07.281975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:41.072 [2024-11-26 23:00:07.281978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.006 23:00:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:42.006 23:00:08 -- common/autotest_common.sh@862 -- # return 0 00:07:42.006 23:00:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:42.006 23:00:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:42.006 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.006 23:00:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:42.006 23:00:08 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:42.006 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.006 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.006 [2024-11-26 23:00:08.104164] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:42.006 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.006 23:00:08 -- target/discovery.sh@26 -- # seq 1 4 00:07:42.006 23:00:08 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:42.006 23:00:08 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:42.006 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.006 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.006 Null1 00:07:42.006 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.006 23:00:08 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:42.006 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.006 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.006 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.006 23:00:08 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:42.006 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.006 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.006 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 [2024-11-26 23:00:08.148478] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:42.007 23:00:08 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 Null2 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:42.007 23:00:08 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 Null3 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:42.007 23:00:08 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 Null4 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:42.007 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.007 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.007 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.007 23:00:08 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:42.265 00:07:42.265 Discovery Log Number of Records 6, Generation counter 6 00:07:42.265 =====Discovery Log Entry 0====== 00:07:42.265 trtype: tcp 00:07:42.265 adrfam: ipv4 00:07:42.265 subtype: current discovery subsystem 00:07:42.265 treq: not required 00:07:42.265 portid: 0 00:07:42.265 trsvcid: 4420 00:07:42.265 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:42.265 traddr: 10.0.0.2 00:07:42.265 eflags: explicit discovery connections, duplicate discovery information 00:07:42.265 sectype: none 00:07:42.265 =====Discovery Log Entry 1====== 00:07:42.265 trtype: tcp 00:07:42.265 adrfam: ipv4 00:07:42.265 subtype: nvme subsystem 00:07:42.265 treq: not required 00:07:42.265 portid: 0 00:07:42.265 trsvcid: 4420 00:07:42.265 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:42.265 traddr: 10.0.0.2 00:07:42.265 eflags: none 00:07:42.265 sectype: none 00:07:42.265 =====Discovery Log Entry 2====== 00:07:42.265 trtype: tcp 00:07:42.265 adrfam: ipv4 00:07:42.265 subtype: nvme subsystem 00:07:42.265 treq: not required 00:07:42.265 portid: 0 00:07:42.265 trsvcid: 4420 00:07:42.265 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:42.265 traddr: 10.0.0.2 00:07:42.265 eflags: none 00:07:42.265 sectype: none 00:07:42.265 =====Discovery Log Entry 3====== 00:07:42.265 trtype: tcp 00:07:42.265 adrfam: ipv4 00:07:42.265 subtype: nvme subsystem 00:07:42.265 treq: not required 00:07:42.265 portid: 0 00:07:42.265 trsvcid: 4420 00:07:42.265 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:42.265 traddr: 10.0.0.2 00:07:42.265 eflags: none 00:07:42.265 sectype: none 00:07:42.265 =====Discovery Log Entry 4====== 00:07:42.265 trtype: tcp 00:07:42.265 adrfam: ipv4 00:07:42.265 subtype: nvme subsystem 00:07:42.265 treq: not required 00:07:42.265 portid: 0 00:07:42.265 trsvcid: 4420 00:07:42.265 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:42.265 traddr: 10.0.0.2 00:07:42.265 eflags: none 00:07:42.265 sectype: none 00:07:42.265 =====Discovery Log Entry 5====== 00:07:42.265 trtype: tcp 00:07:42.265 adrfam: ipv4 00:07:42.265 subtype: discovery subsystem referral 00:07:42.265 treq: not required 00:07:42.265 portid: 0 00:07:42.265 trsvcid: 4430 00:07:42.265 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:42.265 traddr: 10.0.0.2 00:07:42.265 eflags: none 00:07:42.265 sectype: none 00:07:42.265 23:00:08 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:42.265 Perform nvmf subsystem discovery via RPC 00:07:42.265 23:00:08 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:42.265 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.265 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.265 [2024-11-26 23:00:08.477436] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:42.265 [ 00:07:42.265 { 00:07:42.265 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:42.265 "subtype": "Discovery", 00:07:42.265 "listen_addresses": [ 00:07:42.265 { 00:07:42.265 "transport": "TCP", 00:07:42.265 "trtype": "TCP", 00:07:42.265 "adrfam": "IPv4", 00:07:42.265 "traddr": "10.0.0.2", 00:07:42.265 "trsvcid": "4420" 00:07:42.265 } 00:07:42.265 ], 00:07:42.265 "allow_any_host": true, 00:07:42.265 "hosts": [] 00:07:42.265 }, 00:07:42.265 { 00:07:42.265 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:42.266 "subtype": "NVMe", 00:07:42.266 "listen_addresses": [ 00:07:42.266 { 00:07:42.266 "transport": "TCP", 00:07:42.266 "trtype": "TCP", 00:07:42.266 "adrfam": "IPv4", 00:07:42.266 "traddr": "10.0.0.2", 00:07:42.266 "trsvcid": "4420" 00:07:42.266 } 00:07:42.266 ], 00:07:42.266 "allow_any_host": true, 00:07:42.266 "hosts": [], 00:07:42.266 "serial_number": "SPDK00000000000001", 00:07:42.266 "model_number": "SPDK bdev Controller", 00:07:42.266 "max_namespaces": 32, 00:07:42.266 "min_cntlid": 1, 00:07:42.266 "max_cntlid": 65519, 00:07:42.266 "namespaces": [ 00:07:42.266 { 00:07:42.266 "nsid": 1, 00:07:42.266 "bdev_name": "Null1", 00:07:42.266 "name": "Null1", 00:07:42.266 "nguid": "60F6FF511126408F8CB87732C0F8429D", 00:07:42.266 "uuid": "60f6ff51-1126-408f-8cb8-7732c0f8429d" 00:07:42.266 } 00:07:42.266 ] 00:07:42.266 }, 00:07:42.266 { 00:07:42.266 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:42.266 "subtype": "NVMe", 00:07:42.266 "listen_addresses": [ 00:07:42.266 { 00:07:42.266 "transport": "TCP", 00:07:42.266 "trtype": "TCP", 00:07:42.266 "adrfam": "IPv4", 00:07:42.266 "traddr": "10.0.0.2", 00:07:42.266 "trsvcid": "4420" 00:07:42.266 } 00:07:42.266 ], 00:07:42.266 "allow_any_host": true, 00:07:42.266 "hosts": [], 00:07:42.266 "serial_number": "SPDK00000000000002", 00:07:42.266 "model_number": "SPDK bdev Controller", 00:07:42.266 "max_namespaces": 32, 00:07:42.266 "min_cntlid": 1, 00:07:42.266 "max_cntlid": 65519, 00:07:42.266 "namespaces": [ 00:07:42.266 { 00:07:42.266 "nsid": 1, 00:07:42.266 "bdev_name": "Null2", 00:07:42.266 "name": "Null2", 00:07:42.266 "nguid": "25DF847799934CF8B64408C9B29F10C5", 00:07:42.266 "uuid": "25df8477-9993-4cf8-b644-08c9b29f10c5" 00:07:42.266 } 00:07:42.266 ] 00:07:42.266 }, 00:07:42.266 { 00:07:42.266 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:42.266 "subtype": "NVMe", 00:07:42.266 "listen_addresses": [ 00:07:42.266 { 00:07:42.266 "transport": "TCP", 00:07:42.266 "trtype": "TCP", 00:07:42.266 "adrfam": "IPv4", 00:07:42.266 "traddr": "10.0.0.2", 00:07:42.266 "trsvcid": "4420" 00:07:42.266 } 00:07:42.266 ], 00:07:42.266 "allow_any_host": true, 00:07:42.266 "hosts": [], 00:07:42.266 "serial_number": "SPDK00000000000003", 00:07:42.266 "model_number": "SPDK bdev Controller", 00:07:42.266 "max_namespaces": 32, 00:07:42.266 "min_cntlid": 1, 00:07:42.266 "max_cntlid": 65519, 00:07:42.266 "namespaces": [ 00:07:42.266 { 00:07:42.266 "nsid": 1, 00:07:42.266 "bdev_name": "Null3", 00:07:42.266 "name": "Null3", 00:07:42.266 "nguid": "5C4E9FB376A140998526449B05E3078C", 00:07:42.266 "uuid": "5c4e9fb3-76a1-4099-8526-449b05e3078c" 00:07:42.266 } 00:07:42.266 ] 00:07:42.266 }, 00:07:42.266 { 00:07:42.266 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:42.266 "subtype": "NVMe", 00:07:42.266 "listen_addresses": [ 00:07:42.266 { 00:07:42.266 "transport": "TCP", 00:07:42.266 "trtype": "TCP", 00:07:42.266 "adrfam": "IPv4", 00:07:42.266 "traddr": "10.0.0.2", 00:07:42.266 "trsvcid": "4420" 00:07:42.266 } 00:07:42.266 ], 00:07:42.266 "allow_any_host": true, 00:07:42.266 "hosts": [], 00:07:42.266 "serial_number": "SPDK00000000000004", 00:07:42.266 "model_number": "SPDK bdev Controller", 00:07:42.266 "max_namespaces": 32, 00:07:42.266 "min_cntlid": 1, 00:07:42.266 "max_cntlid": 65519, 00:07:42.266 "namespaces": [ 00:07:42.266 { 00:07:42.266 "nsid": 1, 00:07:42.266 "bdev_name": "Null4", 00:07:42.266 "name": "Null4", 00:07:42.266 "nguid": "DEB24174A2AD46DFAFDB1E1CA99AE49A", 00:07:42.266 "uuid": "deb24174-a2ad-46df-afdb-1e1ca99ae49a" 00:07:42.266 } 00:07:42.266 ] 00:07:42.266 } 00:07:42.266 ] 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@42 -- # seq 1 4 00:07:42.266 23:00:08 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:42.266 23:00:08 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:42.266 23:00:08 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:42.266 23:00:08 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:42.266 23:00:08 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:42.266 23:00:08 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:42.266 23:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.266 23:00:08 -- common/autotest_common.sh@10 -- # set +x 00:07:42.266 23:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.266 23:00:08 -- target/discovery.sh@49 -- # check_bdevs= 00:07:42.266 23:00:08 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:42.266 23:00:08 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:42.266 23:00:08 -- target/discovery.sh@57 -- # nvmftestfini 00:07:42.266 23:00:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:42.266 23:00:08 -- nvmf/common.sh@116 -- # sync 00:07:42.266 23:00:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:42.266 23:00:08 -- nvmf/common.sh@119 -- # set +e 00:07:42.266 23:00:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:42.266 23:00:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:42.266 rmmod nvme_tcp 00:07:42.266 rmmod nvme_fabrics 00:07:42.266 rmmod nvme_keyring 00:07:42.266 23:00:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:42.525 23:00:08 -- nvmf/common.sh@123 -- # set -e 00:07:42.525 23:00:08 -- nvmf/common.sh@124 -- # return 0 00:07:42.525 23:00:08 -- nvmf/common.sh@477 -- # '[' -n 111718 ']' 00:07:42.525 23:00:08 -- nvmf/common.sh@478 -- # killprocess 111718 00:07:42.525 23:00:08 -- common/autotest_common.sh@936 -- # '[' -z 111718 ']' 00:07:42.525 23:00:08 -- common/autotest_common.sh@940 -- # kill -0 111718 00:07:42.525 23:00:08 -- common/autotest_common.sh@941 -- # uname 00:07:42.525 23:00:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:42.525 23:00:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 111718 00:07:42.525 23:00:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:42.525 23:00:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:42.525 23:00:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 111718' 00:07:42.525 killing process with pid 111718 00:07:42.525 23:00:08 -- common/autotest_common.sh@955 -- # kill 111718 00:07:42.525 [2024-11-26 23:00:08.702893] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:42.525 23:00:08 -- common/autotest_common.sh@960 -- # wait 111718 00:07:42.784 23:00:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:42.784 23:00:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:42.784 23:00:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:42.784 23:00:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:42.784 23:00:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:42.784 23:00:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:42.784 23:00:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:42.784 23:00:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:44.689 23:00:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:44.689 00:07:44.689 real 0m6.275s 00:07:44.689 user 0m7.715s 00:07:44.689 sys 0m1.863s 00:07:44.689 23:00:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.689 23:00:11 -- common/autotest_common.sh@10 -- # set +x 00:07:44.689 ************************************ 00:07:44.689 END TEST nvmf_discovery 00:07:44.689 ************************************ 00:07:44.689 23:00:11 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:44.689 23:00:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:44.689 23:00:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.689 23:00:11 -- common/autotest_common.sh@10 -- # set +x 00:07:44.689 ************************************ 00:07:44.689 START TEST nvmf_referrals 00:07:44.689 ************************************ 00:07:44.689 23:00:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:44.949 * Looking for test storage... 00:07:44.949 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.949 23:00:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:44.949 23:00:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:44.949 23:00:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:44.949 23:00:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:44.949 23:00:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:44.949 23:00:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:44.949 23:00:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:44.949 23:00:11 -- scripts/common.sh@335 -- # IFS=.-: 00:07:44.949 23:00:11 -- scripts/common.sh@335 -- # read -ra ver1 00:07:44.949 23:00:11 -- scripts/common.sh@336 -- # IFS=.-: 00:07:44.949 23:00:11 -- scripts/common.sh@336 -- # read -ra ver2 00:07:44.949 23:00:11 -- scripts/common.sh@337 -- # local 'op=<' 00:07:44.949 23:00:11 -- scripts/common.sh@339 -- # ver1_l=2 00:07:44.949 23:00:11 -- scripts/common.sh@340 -- # ver2_l=1 00:07:44.949 23:00:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:44.949 23:00:11 -- scripts/common.sh@343 -- # case "$op" in 00:07:44.949 23:00:11 -- scripts/common.sh@344 -- # : 1 00:07:44.949 23:00:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:44.949 23:00:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:44.949 23:00:11 -- scripts/common.sh@364 -- # decimal 1 00:07:44.949 23:00:11 -- scripts/common.sh@352 -- # local d=1 00:07:44.949 23:00:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:44.949 23:00:11 -- scripts/common.sh@354 -- # echo 1 00:07:44.949 23:00:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:44.949 23:00:11 -- scripts/common.sh@365 -- # decimal 2 00:07:44.949 23:00:11 -- scripts/common.sh@352 -- # local d=2 00:07:44.949 23:00:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:44.949 23:00:11 -- scripts/common.sh@354 -- # echo 2 00:07:44.949 23:00:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:44.949 23:00:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:44.949 23:00:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:44.949 23:00:11 -- scripts/common.sh@367 -- # return 0 00:07:44.949 23:00:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:44.949 23:00:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:44.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.949 --rc genhtml_branch_coverage=1 00:07:44.949 --rc genhtml_function_coverage=1 00:07:44.949 --rc genhtml_legend=1 00:07:44.949 --rc geninfo_all_blocks=1 00:07:44.949 --rc geninfo_unexecuted_blocks=1 00:07:44.949 00:07:44.949 ' 00:07:44.949 23:00:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:44.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.949 --rc genhtml_branch_coverage=1 00:07:44.949 --rc genhtml_function_coverage=1 00:07:44.949 --rc genhtml_legend=1 00:07:44.949 --rc geninfo_all_blocks=1 00:07:44.949 --rc geninfo_unexecuted_blocks=1 00:07:44.949 00:07:44.949 ' 00:07:44.949 23:00:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:44.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.949 --rc genhtml_branch_coverage=1 00:07:44.949 --rc genhtml_function_coverage=1 00:07:44.949 --rc genhtml_legend=1 00:07:44.949 --rc geninfo_all_blocks=1 00:07:44.949 --rc geninfo_unexecuted_blocks=1 00:07:44.949 00:07:44.949 ' 00:07:44.949 23:00:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:44.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.949 --rc genhtml_branch_coverage=1 00:07:44.949 --rc genhtml_function_coverage=1 00:07:44.949 --rc genhtml_legend=1 00:07:44.949 --rc geninfo_all_blocks=1 00:07:44.949 --rc geninfo_unexecuted_blocks=1 00:07:44.949 00:07:44.949 ' 00:07:44.949 23:00:11 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:44.949 23:00:11 -- nvmf/common.sh@7 -- # uname -s 00:07:44.949 23:00:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:44.949 23:00:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:44.949 23:00:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:44.949 23:00:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:44.949 23:00:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:44.949 23:00:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:44.949 23:00:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:44.949 23:00:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:44.949 23:00:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:44.949 23:00:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:44.949 23:00:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:44.949 23:00:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:44.949 23:00:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:44.949 23:00:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:44.949 23:00:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:44.949 23:00:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:44.949 23:00:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:44.949 23:00:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:44.949 23:00:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:44.949 23:00:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.949 23:00:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.949 23:00:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.949 23:00:11 -- paths/export.sh@5 -- # export PATH 00:07:44.949 23:00:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.949 23:00:11 -- nvmf/common.sh@46 -- # : 0 00:07:44.949 23:00:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:44.949 23:00:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:44.949 23:00:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:44.949 23:00:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:44.949 23:00:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:44.949 23:00:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:44.949 23:00:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:44.949 23:00:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:44.949 23:00:11 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:44.949 23:00:11 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:44.949 23:00:11 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:44.949 23:00:11 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:44.949 23:00:11 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:44.949 23:00:11 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:44.949 23:00:11 -- target/referrals.sh@37 -- # nvmftestinit 00:07:44.949 23:00:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:44.949 23:00:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:44.949 23:00:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:44.949 23:00:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:44.949 23:00:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:44.949 23:00:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:44.949 23:00:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:44.949 23:00:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:44.949 23:00:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:44.949 23:00:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:44.949 23:00:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:44.949 23:00:11 -- common/autotest_common.sh@10 -- # set +x 00:07:47.484 23:00:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:47.484 23:00:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:47.484 23:00:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:47.484 23:00:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:47.484 23:00:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:47.484 23:00:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:47.484 23:00:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:47.484 23:00:13 -- nvmf/common.sh@294 -- # net_devs=() 00:07:47.484 23:00:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:47.484 23:00:13 -- nvmf/common.sh@295 -- # e810=() 00:07:47.484 23:00:13 -- nvmf/common.sh@295 -- # local -ga e810 00:07:47.484 23:00:13 -- nvmf/common.sh@296 -- # x722=() 00:07:47.484 23:00:13 -- nvmf/common.sh@296 -- # local -ga x722 00:07:47.484 23:00:13 -- nvmf/common.sh@297 -- # mlx=() 00:07:47.484 23:00:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:47.484 23:00:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:47.484 23:00:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:47.484 23:00:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:47.484 23:00:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:47.484 23:00:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:47.484 23:00:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:47.484 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:47.484 23:00:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:47.484 23:00:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:47.484 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:47.484 23:00:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:47.484 23:00:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:47.484 23:00:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:47.484 23:00:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:47.485 23:00:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:47.485 23:00:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:47.485 23:00:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:47.485 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:47.485 23:00:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:47.485 23:00:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:47.485 23:00:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:47.485 23:00:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:47.485 23:00:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:47.485 23:00:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:47.485 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:47.485 23:00:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:47.485 23:00:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:47.485 23:00:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:47.485 23:00:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:47.485 23:00:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:47.485 23:00:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:47.485 23:00:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:47.485 23:00:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:47.485 23:00:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:47.485 23:00:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:47.485 23:00:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:47.485 23:00:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:47.485 23:00:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:47.485 23:00:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:47.485 23:00:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:47.485 23:00:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:47.485 23:00:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:47.485 23:00:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:47.485 23:00:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:47.485 23:00:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:47.485 23:00:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:47.485 23:00:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:47.485 23:00:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:47.485 23:00:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:47.485 23:00:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:47.485 23:00:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:47.485 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:47.485 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:07:47.485 00:07:47.485 --- 10.0.0.2 ping statistics --- 00:07:47.485 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.485 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:07:47.485 23:00:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:47.485 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:47.485 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:07:47.485 00:07:47.485 --- 10.0.0.1 ping statistics --- 00:07:47.485 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.485 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:07:47.485 23:00:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:47.485 23:00:13 -- nvmf/common.sh@410 -- # return 0 00:07:47.485 23:00:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:47.485 23:00:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:47.485 23:00:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:47.485 23:00:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:47.485 23:00:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:47.485 23:00:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:47.485 23:00:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:47.485 23:00:13 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:47.485 23:00:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:47.485 23:00:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:47.485 23:00:13 -- common/autotest_common.sh@10 -- # set +x 00:07:47.485 23:00:13 -- nvmf/common.sh@469 -- # nvmfpid=114441 00:07:47.485 23:00:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:47.485 23:00:13 -- nvmf/common.sh@470 -- # waitforlisten 114441 00:07:47.485 23:00:13 -- common/autotest_common.sh@829 -- # '[' -z 114441 ']' 00:07:47.485 23:00:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:47.485 23:00:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:47.485 23:00:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:47.485 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:47.485 23:00:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:47.485 23:00:13 -- common/autotest_common.sh@10 -- # set +x 00:07:47.485 [2024-11-26 23:00:13.514372] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.485 [2024-11-26 23:00:13.514461] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:47.485 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.485 [2024-11-26 23:00:13.584892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:47.485 [2024-11-26 23:00:13.696213] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:47.485 [2024-11-26 23:00:13.696387] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:47.485 [2024-11-26 23:00:13.696405] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:47.485 [2024-11-26 23:00:13.696418] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:47.485 [2024-11-26 23:00:13.696479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.485 [2024-11-26 23:00:13.696553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.485 [2024-11-26 23:00:13.696607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:47.485 [2024-11-26 23:00:13.696610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.419 23:00:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:48.419 23:00:14 -- common/autotest_common.sh@862 -- # return 0 00:07:48.419 23:00:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:48.419 23:00:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:48.419 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.419 23:00:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:48.419 23:00:14 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:48.419 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.419 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.419 [2024-11-26 23:00:14.549272] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:48.419 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.419 23:00:14 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:48.419 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.419 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.419 [2024-11-26 23:00:14.561493] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:48.419 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.419 23:00:14 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:48.419 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.419 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.419 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.419 23:00:14 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:48.419 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.419 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.419 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.419 23:00:14 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:48.419 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.419 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.419 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.419 23:00:14 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.419 23:00:14 -- target/referrals.sh@48 -- # jq length 00:07:48.419 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.419 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.419 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.419 23:00:14 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:48.419 23:00:14 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:48.419 23:00:14 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:48.419 23:00:14 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.419 23:00:14 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:48.419 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.419 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.419 23:00:14 -- target/referrals.sh@21 -- # sort 00:07:48.419 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.419 23:00:14 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:48.419 23:00:14 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:48.419 23:00:14 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:48.419 23:00:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:48.419 23:00:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:48.419 23:00:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.419 23:00:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:48.419 23:00:14 -- target/referrals.sh@26 -- # sort 00:07:48.677 23:00:14 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:48.677 23:00:14 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:48.677 23:00:14 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:48.677 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.677 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.677 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.677 23:00:14 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:48.677 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.677 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.677 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.677 23:00:14 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:48.677 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.677 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.677 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.677 23:00:14 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.677 23:00:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.677 23:00:14 -- target/referrals.sh@56 -- # jq length 00:07:48.677 23:00:14 -- common/autotest_common.sh@10 -- # set +x 00:07:48.677 23:00:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.677 23:00:14 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:48.677 23:00:14 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:48.677 23:00:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:48.677 23:00:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:48.677 23:00:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.677 23:00:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:48.677 23:00:14 -- target/referrals.sh@26 -- # sort 00:07:48.935 23:00:15 -- target/referrals.sh@26 -- # echo 00:07:48.935 23:00:15 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:48.935 23:00:15 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:48.935 23:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.935 23:00:15 -- common/autotest_common.sh@10 -- # set +x 00:07:48.935 23:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.935 23:00:15 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:48.935 23:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.935 23:00:15 -- common/autotest_common.sh@10 -- # set +x 00:07:48.935 23:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.935 23:00:15 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:48.935 23:00:15 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:48.935 23:00:15 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.935 23:00:15 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:48.935 23:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.935 23:00:15 -- target/referrals.sh@21 -- # sort 00:07:48.935 23:00:15 -- common/autotest_common.sh@10 -- # set +x 00:07:48.935 23:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.935 23:00:15 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:48.935 23:00:15 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:48.935 23:00:15 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:48.935 23:00:15 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:48.935 23:00:15 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:48.935 23:00:15 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.935 23:00:15 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:48.935 23:00:15 -- target/referrals.sh@26 -- # sort 00:07:49.193 23:00:15 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:49.193 23:00:15 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:49.193 23:00:15 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:49.193 23:00:15 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:49.193 23:00:15 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:49.193 23:00:15 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.193 23:00:15 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:49.193 23:00:15 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:49.193 23:00:15 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:49.193 23:00:15 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:49.193 23:00:15 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:49.193 23:00:15 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.193 23:00:15 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:49.451 23:00:15 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:49.451 23:00:15 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:49.451 23:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.451 23:00:15 -- common/autotest_common.sh@10 -- # set +x 00:07:49.451 23:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.451 23:00:15 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:49.451 23:00:15 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:49.451 23:00:15 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:49.451 23:00:15 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:49.451 23:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.451 23:00:15 -- common/autotest_common.sh@10 -- # set +x 00:07:49.451 23:00:15 -- target/referrals.sh@21 -- # sort 00:07:49.451 23:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.451 23:00:15 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:49.451 23:00:15 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:49.451 23:00:15 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:49.451 23:00:15 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:49.451 23:00:15 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:49.451 23:00:15 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.451 23:00:15 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:49.451 23:00:15 -- target/referrals.sh@26 -- # sort 00:07:49.709 23:00:15 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:49.709 23:00:15 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:49.709 23:00:15 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:49.709 23:00:15 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:49.709 23:00:15 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:49.709 23:00:15 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.709 23:00:15 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:49.967 23:00:16 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:49.967 23:00:16 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:49.967 23:00:16 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:49.967 23:00:16 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:49.967 23:00:16 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.967 23:00:16 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:49.967 23:00:16 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:49.967 23:00:16 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:49.967 23:00:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.967 23:00:16 -- common/autotest_common.sh@10 -- # set +x 00:07:49.967 23:00:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.967 23:00:16 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:49.967 23:00:16 -- target/referrals.sh@82 -- # jq length 00:07:49.967 23:00:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.967 23:00:16 -- common/autotest_common.sh@10 -- # set +x 00:07:49.967 23:00:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.967 23:00:16 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:49.967 23:00:16 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:49.967 23:00:16 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:49.967 23:00:16 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:49.967 23:00:16 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.967 23:00:16 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:49.967 23:00:16 -- target/referrals.sh@26 -- # sort 00:07:50.225 23:00:16 -- target/referrals.sh@26 -- # echo 00:07:50.225 23:00:16 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:50.225 23:00:16 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:50.225 23:00:16 -- target/referrals.sh@86 -- # nvmftestfini 00:07:50.225 23:00:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:50.225 23:00:16 -- nvmf/common.sh@116 -- # sync 00:07:50.225 23:00:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:50.225 23:00:16 -- nvmf/common.sh@119 -- # set +e 00:07:50.225 23:00:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:50.225 23:00:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:50.225 rmmod nvme_tcp 00:07:50.225 rmmod nvme_fabrics 00:07:50.225 rmmod nvme_keyring 00:07:50.484 23:00:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:50.484 23:00:16 -- nvmf/common.sh@123 -- # set -e 00:07:50.484 23:00:16 -- nvmf/common.sh@124 -- # return 0 00:07:50.484 23:00:16 -- nvmf/common.sh@477 -- # '[' -n 114441 ']' 00:07:50.484 23:00:16 -- nvmf/common.sh@478 -- # killprocess 114441 00:07:50.484 23:00:16 -- common/autotest_common.sh@936 -- # '[' -z 114441 ']' 00:07:50.484 23:00:16 -- common/autotest_common.sh@940 -- # kill -0 114441 00:07:50.484 23:00:16 -- common/autotest_common.sh@941 -- # uname 00:07:50.484 23:00:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:50.484 23:00:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 114441 00:07:50.484 23:00:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:50.484 23:00:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:50.484 23:00:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 114441' 00:07:50.484 killing process with pid 114441 00:07:50.484 23:00:16 -- common/autotest_common.sh@955 -- # kill 114441 00:07:50.484 23:00:16 -- common/autotest_common.sh@960 -- # wait 114441 00:07:50.745 23:00:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:50.745 23:00:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:50.745 23:00:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:50.745 23:00:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:50.745 23:00:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:50.745 23:00:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:50.745 23:00:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:50.745 23:00:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.653 23:00:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:52.653 00:07:52.653 real 0m7.935s 00:07:52.653 user 0m14.526s 00:07:52.653 sys 0m2.287s 00:07:52.653 23:00:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:52.653 23:00:18 -- common/autotest_common.sh@10 -- # set +x 00:07:52.653 ************************************ 00:07:52.653 END TEST nvmf_referrals 00:07:52.653 ************************************ 00:07:52.653 23:00:19 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:52.653 23:00:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:52.653 23:00:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:52.653 23:00:19 -- common/autotest_common.sh@10 -- # set +x 00:07:52.653 ************************************ 00:07:52.653 START TEST nvmf_connect_disconnect 00:07:52.653 ************************************ 00:07:52.653 23:00:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:52.913 * Looking for test storage... 00:07:52.913 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:52.913 23:00:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:52.913 23:00:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:52.913 23:00:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:52.913 23:00:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:52.913 23:00:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:52.913 23:00:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:52.913 23:00:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:52.913 23:00:19 -- scripts/common.sh@335 -- # IFS=.-: 00:07:52.913 23:00:19 -- scripts/common.sh@335 -- # read -ra ver1 00:07:52.913 23:00:19 -- scripts/common.sh@336 -- # IFS=.-: 00:07:52.913 23:00:19 -- scripts/common.sh@336 -- # read -ra ver2 00:07:52.913 23:00:19 -- scripts/common.sh@337 -- # local 'op=<' 00:07:52.913 23:00:19 -- scripts/common.sh@339 -- # ver1_l=2 00:07:52.913 23:00:19 -- scripts/common.sh@340 -- # ver2_l=1 00:07:52.913 23:00:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:52.913 23:00:19 -- scripts/common.sh@343 -- # case "$op" in 00:07:52.913 23:00:19 -- scripts/common.sh@344 -- # : 1 00:07:52.913 23:00:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:52.913 23:00:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:52.913 23:00:19 -- scripts/common.sh@364 -- # decimal 1 00:07:52.913 23:00:19 -- scripts/common.sh@352 -- # local d=1 00:07:52.913 23:00:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:52.913 23:00:19 -- scripts/common.sh@354 -- # echo 1 00:07:52.913 23:00:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:52.913 23:00:19 -- scripts/common.sh@365 -- # decimal 2 00:07:52.913 23:00:19 -- scripts/common.sh@352 -- # local d=2 00:07:52.913 23:00:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:52.913 23:00:19 -- scripts/common.sh@354 -- # echo 2 00:07:52.913 23:00:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:52.913 23:00:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:52.913 23:00:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:52.913 23:00:19 -- scripts/common.sh@367 -- # return 0 00:07:52.913 23:00:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:52.913 23:00:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:52.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.913 --rc genhtml_branch_coverage=1 00:07:52.913 --rc genhtml_function_coverage=1 00:07:52.913 --rc genhtml_legend=1 00:07:52.913 --rc geninfo_all_blocks=1 00:07:52.913 --rc geninfo_unexecuted_blocks=1 00:07:52.913 00:07:52.913 ' 00:07:52.913 23:00:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:52.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.913 --rc genhtml_branch_coverage=1 00:07:52.913 --rc genhtml_function_coverage=1 00:07:52.913 --rc genhtml_legend=1 00:07:52.913 --rc geninfo_all_blocks=1 00:07:52.913 --rc geninfo_unexecuted_blocks=1 00:07:52.913 00:07:52.913 ' 00:07:52.913 23:00:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:52.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.913 --rc genhtml_branch_coverage=1 00:07:52.913 --rc genhtml_function_coverage=1 00:07:52.913 --rc genhtml_legend=1 00:07:52.913 --rc geninfo_all_blocks=1 00:07:52.914 --rc geninfo_unexecuted_blocks=1 00:07:52.914 00:07:52.914 ' 00:07:52.914 23:00:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:52.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.914 --rc genhtml_branch_coverage=1 00:07:52.914 --rc genhtml_function_coverage=1 00:07:52.914 --rc genhtml_legend=1 00:07:52.914 --rc geninfo_all_blocks=1 00:07:52.914 --rc geninfo_unexecuted_blocks=1 00:07:52.914 00:07:52.914 ' 00:07:52.914 23:00:19 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:52.914 23:00:19 -- nvmf/common.sh@7 -- # uname -s 00:07:52.914 23:00:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:52.914 23:00:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:52.914 23:00:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:52.914 23:00:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:52.914 23:00:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:52.914 23:00:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:52.914 23:00:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:52.914 23:00:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:52.914 23:00:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:52.914 23:00:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:52.914 23:00:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:52.914 23:00:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:52.914 23:00:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:52.914 23:00:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:52.914 23:00:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:52.914 23:00:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:52.914 23:00:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:52.914 23:00:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:52.914 23:00:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:52.914 23:00:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.914 23:00:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.914 23:00:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.914 23:00:19 -- paths/export.sh@5 -- # export PATH 00:07:52.914 23:00:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.914 23:00:19 -- nvmf/common.sh@46 -- # : 0 00:07:52.914 23:00:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:52.914 23:00:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:52.914 23:00:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:52.914 23:00:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:52.914 23:00:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:52.914 23:00:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:52.914 23:00:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:52.914 23:00:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:52.914 23:00:19 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:52.914 23:00:19 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:52.914 23:00:19 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:52.914 23:00:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:52.914 23:00:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:52.914 23:00:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:52.914 23:00:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:52.914 23:00:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:52.914 23:00:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.914 23:00:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.914 23:00:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.914 23:00:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:52.914 23:00:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:52.914 23:00:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:52.914 23:00:19 -- common/autotest_common.sh@10 -- # set +x 00:07:55.449 23:00:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:55.449 23:00:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:55.449 23:00:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:55.449 23:00:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:55.449 23:00:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:55.449 23:00:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:55.449 23:00:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:55.450 23:00:21 -- nvmf/common.sh@294 -- # net_devs=() 00:07:55.450 23:00:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:55.450 23:00:21 -- nvmf/common.sh@295 -- # e810=() 00:07:55.450 23:00:21 -- nvmf/common.sh@295 -- # local -ga e810 00:07:55.450 23:00:21 -- nvmf/common.sh@296 -- # x722=() 00:07:55.450 23:00:21 -- nvmf/common.sh@296 -- # local -ga x722 00:07:55.450 23:00:21 -- nvmf/common.sh@297 -- # mlx=() 00:07:55.450 23:00:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:55.450 23:00:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:55.450 23:00:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:55.450 23:00:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:55.450 23:00:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:55.450 23:00:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:55.450 23:00:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:55.450 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:55.450 23:00:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:55.450 23:00:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:55.450 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:55.450 23:00:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:55.450 23:00:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:55.450 23:00:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:55.450 23:00:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:55.450 23:00:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:55.450 23:00:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:55.450 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:55.450 23:00:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:55.450 23:00:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:55.450 23:00:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:55.450 23:00:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:55.450 23:00:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:55.450 23:00:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:55.450 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:55.450 23:00:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:55.450 23:00:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:55.450 23:00:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:55.450 23:00:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:55.450 23:00:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:55.450 23:00:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:55.450 23:00:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:55.450 23:00:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:55.450 23:00:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:55.450 23:00:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:55.450 23:00:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:55.450 23:00:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:55.450 23:00:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:55.450 23:00:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:55.450 23:00:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:55.450 23:00:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:55.450 23:00:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:55.450 23:00:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:55.450 23:00:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:55.450 23:00:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:55.450 23:00:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:55.450 23:00:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:55.450 23:00:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:55.450 23:00:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:55.450 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:55.450 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:07:55.450 00:07:55.450 --- 10.0.0.2 ping statistics --- 00:07:55.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:55.450 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:07:55.450 23:00:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:55.450 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:55.450 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:07:55.450 00:07:55.450 --- 10.0.0.1 ping statistics --- 00:07:55.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:55.450 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:07:55.450 23:00:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:55.450 23:00:21 -- nvmf/common.sh@410 -- # return 0 00:07:55.450 23:00:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:55.450 23:00:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:55.450 23:00:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:55.450 23:00:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:55.450 23:00:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:55.450 23:00:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:55.450 23:00:21 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:55.450 23:00:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:55.450 23:00:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:55.450 23:00:21 -- common/autotest_common.sh@10 -- # set +x 00:07:55.450 23:00:21 -- nvmf/common.sh@469 -- # nvmfpid=116899 00:07:55.450 23:00:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:55.450 23:00:21 -- nvmf/common.sh@470 -- # waitforlisten 116899 00:07:55.450 23:00:21 -- common/autotest_common.sh@829 -- # '[' -z 116899 ']' 00:07:55.450 23:00:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:55.450 23:00:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:55.450 23:00:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:55.450 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:55.450 23:00:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:55.450 23:00:21 -- common/autotest_common.sh@10 -- # set +x 00:07:55.450 [2024-11-26 23:00:21.430457] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:55.450 [2024-11-26 23:00:21.430547] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:55.450 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.450 [2024-11-26 23:00:21.499686] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:55.450 [2024-11-26 23:00:21.618546] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:55.450 [2024-11-26 23:00:21.618717] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:55.450 [2024-11-26 23:00:21.618737] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:55.450 [2024-11-26 23:00:21.618752] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:55.450 [2024-11-26 23:00:21.618841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:55.450 [2024-11-26 23:00:21.618887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:55.450 [2024-11-26 23:00:21.618942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:55.450 [2024-11-26 23:00:21.618945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.387 23:00:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:56.387 23:00:22 -- common/autotest_common.sh@862 -- # return 0 00:07:56.387 23:00:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:56.387 23:00:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:56.387 23:00:22 -- common/autotest_common.sh@10 -- # set +x 00:07:56.387 23:00:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:56.387 23:00:22 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:56.387 23:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.387 23:00:22 -- common/autotest_common.sh@10 -- # set +x 00:07:56.387 [2024-11-26 23:00:22.454197] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:56.387 23:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.387 23:00:22 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:56.387 23:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.387 23:00:22 -- common/autotest_common.sh@10 -- # set +x 00:07:56.387 23:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.387 23:00:22 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:56.387 23:00:22 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:56.387 23:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.387 23:00:22 -- common/autotest_common.sh@10 -- # set +x 00:07:56.387 23:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.387 23:00:22 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:56.387 23:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.387 23:00:22 -- common/autotest_common.sh@10 -- # set +x 00:07:56.387 23:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.387 23:00:22 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:56.387 23:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.387 23:00:22 -- common/autotest_common.sh@10 -- # set +x 00:07:56.388 [2024-11-26 23:00:22.511540] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:56.388 23:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.388 23:00:22 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:56.388 23:00:22 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:56.388 23:00:22 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:56.388 23:00:22 -- target/connect_disconnect.sh@34 -- # set +x 00:07:58.921 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:03.353 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.885 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.859 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.408 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.324 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.867 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:24.329 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.875 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.790 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.887 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:36.437 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.353 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.901 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.811 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.360 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:47.915 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.830 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.385 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.847 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.388 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.849 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.955 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.870 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.869 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.427 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.972 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.441 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.356 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.899 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.349 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.972 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.885 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.886 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.972 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.887 [2024-11-26 23:02:33.093427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ef390 is same with the state(5) to be set 00:10:06.887 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.424 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.426 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.878 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.792 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.333 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.875 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.793 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.331 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.777 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.848 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.752 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.200 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.741 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.186 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.723 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.259 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.165 [2024-11-26 23:03:28.528343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ef1f0 is same with the state(5) to be set 00:11:02.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.698 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.239 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.151 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.692 [2024-11-26 23:03:37.735397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ef1f0 is same with the state(5) to be set 00:11:11.692 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.226 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.127 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.206 [2024-11-26 23:03:47.048317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ef1f0 is same with the state(5) to be set 00:11:21.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.113 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.094 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.633 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.170 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.704 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.610 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.146 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.590 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.125 23:04:15 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:49.125 23:04:15 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:49.125 23:04:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:49.125 23:04:15 -- nvmf/common.sh@116 -- # sync 00:11:49.125 23:04:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:49.125 23:04:15 -- nvmf/common.sh@119 -- # set +e 00:11:49.125 23:04:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:49.125 23:04:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:49.125 rmmod nvme_tcp 00:11:49.125 rmmod nvme_fabrics 00:11:49.125 rmmod nvme_keyring 00:11:49.125 23:04:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:49.125 23:04:15 -- nvmf/common.sh@123 -- # set -e 00:11:49.125 23:04:15 -- nvmf/common.sh@124 -- # return 0 00:11:49.125 23:04:15 -- nvmf/common.sh@477 -- # '[' -n 116899 ']' 00:11:49.125 23:04:15 -- nvmf/common.sh@478 -- # killprocess 116899 00:11:49.125 23:04:15 -- common/autotest_common.sh@936 -- # '[' -z 116899 ']' 00:11:49.125 23:04:15 -- common/autotest_common.sh@940 -- # kill -0 116899 00:11:49.125 23:04:15 -- common/autotest_common.sh@941 -- # uname 00:11:49.125 23:04:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:49.125 23:04:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 116899 00:11:49.125 23:04:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:49.125 23:04:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:49.125 23:04:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 116899' 00:11:49.125 killing process with pid 116899 00:11:49.125 23:04:15 -- common/autotest_common.sh@955 -- # kill 116899 00:11:49.125 23:04:15 -- common/autotest_common.sh@960 -- # wait 116899 00:11:49.125 23:04:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:49.125 23:04:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:49.125 23:04:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:49.125 23:04:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:49.125 23:04:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:49.125 23:04:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.125 23:04:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.125 23:04:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.662 23:04:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:51.662 00:11:51.662 real 3m58.522s 00:11:51.662 user 15m8.439s 00:11:51.662 sys 0m35.991s 00:11:51.662 23:04:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:51.662 23:04:17 -- common/autotest_common.sh@10 -- # set +x 00:11:51.662 ************************************ 00:11:51.662 END TEST nvmf_connect_disconnect 00:11:51.662 ************************************ 00:11:51.662 23:04:17 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:51.662 23:04:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:51.662 23:04:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:51.662 23:04:17 -- common/autotest_common.sh@10 -- # set +x 00:11:51.662 ************************************ 00:11:51.662 START TEST nvmf_multitarget 00:11:51.662 ************************************ 00:11:51.662 23:04:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:51.662 * Looking for test storage... 00:11:51.662 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:51.662 23:04:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:51.662 23:04:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:51.662 23:04:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:51.662 23:04:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:51.662 23:04:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:51.662 23:04:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:51.662 23:04:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:51.662 23:04:17 -- scripts/common.sh@335 -- # IFS=.-: 00:11:51.662 23:04:17 -- scripts/common.sh@335 -- # read -ra ver1 00:11:51.662 23:04:17 -- scripts/common.sh@336 -- # IFS=.-: 00:11:51.662 23:04:17 -- scripts/common.sh@336 -- # read -ra ver2 00:11:51.662 23:04:17 -- scripts/common.sh@337 -- # local 'op=<' 00:11:51.662 23:04:17 -- scripts/common.sh@339 -- # ver1_l=2 00:11:51.662 23:04:17 -- scripts/common.sh@340 -- # ver2_l=1 00:11:51.662 23:04:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:51.662 23:04:17 -- scripts/common.sh@343 -- # case "$op" in 00:11:51.662 23:04:17 -- scripts/common.sh@344 -- # : 1 00:11:51.662 23:04:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:51.662 23:04:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:51.662 23:04:17 -- scripts/common.sh@364 -- # decimal 1 00:11:51.662 23:04:17 -- scripts/common.sh@352 -- # local d=1 00:11:51.662 23:04:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:51.662 23:04:17 -- scripts/common.sh@354 -- # echo 1 00:11:51.662 23:04:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:51.662 23:04:17 -- scripts/common.sh@365 -- # decimal 2 00:11:51.662 23:04:17 -- scripts/common.sh@352 -- # local d=2 00:11:51.662 23:04:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:51.662 23:04:17 -- scripts/common.sh@354 -- # echo 2 00:11:51.662 23:04:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:51.662 23:04:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:51.662 23:04:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:51.662 23:04:17 -- scripts/common.sh@367 -- # return 0 00:11:51.662 23:04:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:51.662 23:04:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:51.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.662 --rc genhtml_branch_coverage=1 00:11:51.662 --rc genhtml_function_coverage=1 00:11:51.662 --rc genhtml_legend=1 00:11:51.662 --rc geninfo_all_blocks=1 00:11:51.662 --rc geninfo_unexecuted_blocks=1 00:11:51.662 00:11:51.662 ' 00:11:51.662 23:04:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:51.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.662 --rc genhtml_branch_coverage=1 00:11:51.662 --rc genhtml_function_coverage=1 00:11:51.662 --rc genhtml_legend=1 00:11:51.662 --rc geninfo_all_blocks=1 00:11:51.662 --rc geninfo_unexecuted_blocks=1 00:11:51.662 00:11:51.662 ' 00:11:51.663 23:04:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:51.663 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.663 --rc genhtml_branch_coverage=1 00:11:51.663 --rc genhtml_function_coverage=1 00:11:51.663 --rc genhtml_legend=1 00:11:51.663 --rc geninfo_all_blocks=1 00:11:51.663 --rc geninfo_unexecuted_blocks=1 00:11:51.663 00:11:51.663 ' 00:11:51.663 23:04:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:51.663 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.663 --rc genhtml_branch_coverage=1 00:11:51.663 --rc genhtml_function_coverage=1 00:11:51.663 --rc genhtml_legend=1 00:11:51.663 --rc geninfo_all_blocks=1 00:11:51.663 --rc geninfo_unexecuted_blocks=1 00:11:51.663 00:11:51.663 ' 00:11:51.663 23:04:17 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:51.663 23:04:17 -- nvmf/common.sh@7 -- # uname -s 00:11:51.663 23:04:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:51.663 23:04:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:51.663 23:04:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:51.663 23:04:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:51.663 23:04:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:51.663 23:04:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:51.663 23:04:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:51.663 23:04:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:51.663 23:04:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:51.663 23:04:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:51.663 23:04:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:51.663 23:04:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:51.663 23:04:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:51.663 23:04:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:51.663 23:04:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:51.663 23:04:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:51.663 23:04:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:51.663 23:04:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:51.663 23:04:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:51.663 23:04:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.663 23:04:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.663 23:04:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.663 23:04:17 -- paths/export.sh@5 -- # export PATH 00:11:51.663 23:04:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.663 23:04:17 -- nvmf/common.sh@46 -- # : 0 00:11:51.663 23:04:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:51.663 23:04:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:51.663 23:04:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:51.663 23:04:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:51.663 23:04:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:51.663 23:04:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:51.663 23:04:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:51.663 23:04:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:51.663 23:04:17 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:51.663 23:04:17 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:51.663 23:04:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:51.663 23:04:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:51.663 23:04:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:51.663 23:04:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:51.663 23:04:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:51.663 23:04:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:51.663 23:04:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:51.663 23:04:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.663 23:04:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:51.663 23:04:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:51.663 23:04:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:51.663 23:04:17 -- common/autotest_common.sh@10 -- # set +x 00:11:53.567 23:04:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:53.567 23:04:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:53.567 23:04:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:53.567 23:04:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:53.567 23:04:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:53.567 23:04:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:53.567 23:04:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:53.567 23:04:19 -- nvmf/common.sh@294 -- # net_devs=() 00:11:53.567 23:04:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:53.567 23:04:19 -- nvmf/common.sh@295 -- # e810=() 00:11:53.567 23:04:19 -- nvmf/common.sh@295 -- # local -ga e810 00:11:53.567 23:04:19 -- nvmf/common.sh@296 -- # x722=() 00:11:53.567 23:04:19 -- nvmf/common.sh@296 -- # local -ga x722 00:11:53.567 23:04:19 -- nvmf/common.sh@297 -- # mlx=() 00:11:53.567 23:04:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:53.567 23:04:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:53.567 23:04:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:53.567 23:04:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:53.567 23:04:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:53.567 23:04:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:53.567 23:04:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:53.567 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:53.567 23:04:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:53.567 23:04:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:53.567 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:53.567 23:04:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:53.567 23:04:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:53.567 23:04:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:53.567 23:04:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:53.567 23:04:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:53.567 23:04:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:53.567 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:53.567 23:04:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:53.567 23:04:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:53.567 23:04:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:53.567 23:04:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:53.567 23:04:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:53.567 23:04:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:53.567 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:53.567 23:04:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:53.567 23:04:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:53.567 23:04:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:53.567 23:04:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:53.567 23:04:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:53.567 23:04:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:53.567 23:04:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:53.567 23:04:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:53.567 23:04:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:53.567 23:04:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:53.567 23:04:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:53.567 23:04:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:53.567 23:04:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:53.567 23:04:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:53.567 23:04:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:53.567 23:04:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:53.567 23:04:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:53.567 23:04:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:53.567 23:04:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:53.567 23:04:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:53.567 23:04:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:53.567 23:04:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:53.567 23:04:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:53.567 23:04:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:53.567 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:53.567 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.361 ms 00:11:53.567 00:11:53.567 --- 10.0.0.2 ping statistics --- 00:11:53.567 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:53.567 rtt min/avg/max/mdev = 0.361/0.361/0.361/0.000 ms 00:11:53.567 23:04:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:53.567 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:53.567 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:11:53.567 00:11:53.567 --- 10.0.0.1 ping statistics --- 00:11:53.567 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:53.567 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:11:53.567 23:04:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:53.567 23:04:19 -- nvmf/common.sh@410 -- # return 0 00:11:53.567 23:04:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:53.567 23:04:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:53.567 23:04:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:53.567 23:04:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:53.567 23:04:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:53.567 23:04:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:53.567 23:04:19 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:53.567 23:04:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:53.567 23:04:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:53.567 23:04:19 -- common/autotest_common.sh@10 -- # set +x 00:11:53.567 23:04:19 -- nvmf/common.sh@469 -- # nvmfpid=149169 00:11:53.568 23:04:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:53.568 23:04:19 -- nvmf/common.sh@470 -- # waitforlisten 149169 00:11:53.568 23:04:19 -- common/autotest_common.sh@829 -- # '[' -z 149169 ']' 00:11:53.568 23:04:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:53.568 23:04:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:53.568 23:04:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:53.568 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:53.568 23:04:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:53.568 23:04:19 -- common/autotest_common.sh@10 -- # set +x 00:11:53.828 [2024-11-26 23:04:19.964633] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:53.828 [2024-11-26 23:04:19.964714] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:53.828 EAL: No free 2048 kB hugepages reported on node 1 00:11:53.828 [2024-11-26 23:04:20.044625] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:53.828 [2024-11-26 23:04:20.177202] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:53.828 [2024-11-26 23:04:20.177366] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:53.828 [2024-11-26 23:04:20.177385] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:53.828 [2024-11-26 23:04:20.177399] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:53.828 [2024-11-26 23:04:20.177454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:53.828 [2024-11-26 23:04:20.177509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:53.828 [2024-11-26 23:04:20.180549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:53.828 [2024-11-26 23:04:20.180562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:54.762 23:04:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:54.762 23:04:21 -- common/autotest_common.sh@862 -- # return 0 00:11:54.762 23:04:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:54.762 23:04:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:54.762 23:04:21 -- common/autotest_common.sh@10 -- # set +x 00:11:54.762 23:04:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:54.762 23:04:21 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:54.762 23:04:21 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:54.762 23:04:21 -- target/multitarget.sh@21 -- # jq length 00:11:55.021 23:04:21 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:55.021 23:04:21 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:55.021 "nvmf_tgt_1" 00:11:55.021 23:04:21 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:55.280 "nvmf_tgt_2" 00:11:55.280 23:04:21 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:55.280 23:04:21 -- target/multitarget.sh@28 -- # jq length 00:11:55.280 23:04:21 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:55.280 23:04:21 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:55.280 true 00:11:55.280 23:04:21 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:55.539 true 00:11:55.539 23:04:21 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:55.539 23:04:21 -- target/multitarget.sh@35 -- # jq length 00:11:55.539 23:04:21 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:55.539 23:04:21 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:55.539 23:04:21 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:55.539 23:04:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:55.539 23:04:21 -- nvmf/common.sh@116 -- # sync 00:11:55.539 23:04:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:55.539 23:04:21 -- nvmf/common.sh@119 -- # set +e 00:11:55.539 23:04:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:55.539 23:04:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:55.539 rmmod nvme_tcp 00:11:55.539 rmmod nvme_fabrics 00:11:55.539 rmmod nvme_keyring 00:11:55.539 23:04:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:55.798 23:04:21 -- nvmf/common.sh@123 -- # set -e 00:11:55.798 23:04:21 -- nvmf/common.sh@124 -- # return 0 00:11:55.798 23:04:21 -- nvmf/common.sh@477 -- # '[' -n 149169 ']' 00:11:55.798 23:04:21 -- nvmf/common.sh@478 -- # killprocess 149169 00:11:55.798 23:04:21 -- common/autotest_common.sh@936 -- # '[' -z 149169 ']' 00:11:55.798 23:04:21 -- common/autotest_common.sh@940 -- # kill -0 149169 00:11:55.798 23:04:21 -- common/autotest_common.sh@941 -- # uname 00:11:55.798 23:04:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:55.798 23:04:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 149169 00:11:55.798 23:04:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:55.798 23:04:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:55.798 23:04:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 149169' 00:11:55.798 killing process with pid 149169 00:11:55.798 23:04:21 -- common/autotest_common.sh@955 -- # kill 149169 00:11:55.798 23:04:21 -- common/autotest_common.sh@960 -- # wait 149169 00:11:56.059 23:04:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:56.059 23:04:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:56.059 23:04:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:56.059 23:04:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:56.059 23:04:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:56.059 23:04:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.059 23:04:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:56.059 23:04:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:57.966 23:04:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:57.966 00:11:57.966 real 0m6.725s 00:11:57.966 user 0m10.046s 00:11:57.966 sys 0m2.004s 00:11:57.966 23:04:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:57.966 23:04:24 -- common/autotest_common.sh@10 -- # set +x 00:11:57.966 ************************************ 00:11:57.966 END TEST nvmf_multitarget 00:11:57.966 ************************************ 00:11:57.966 23:04:24 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:57.966 23:04:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:57.966 23:04:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:57.966 23:04:24 -- common/autotest_common.sh@10 -- # set +x 00:11:57.966 ************************************ 00:11:57.966 START TEST nvmf_rpc 00:11:57.966 ************************************ 00:11:57.966 23:04:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:58.228 * Looking for test storage... 00:11:58.228 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:58.228 23:04:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:58.228 23:04:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:58.228 23:04:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:58.228 23:04:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:58.228 23:04:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:58.228 23:04:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:58.228 23:04:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:58.228 23:04:24 -- scripts/common.sh@335 -- # IFS=.-: 00:11:58.228 23:04:24 -- scripts/common.sh@335 -- # read -ra ver1 00:11:58.228 23:04:24 -- scripts/common.sh@336 -- # IFS=.-: 00:11:58.228 23:04:24 -- scripts/common.sh@336 -- # read -ra ver2 00:11:58.228 23:04:24 -- scripts/common.sh@337 -- # local 'op=<' 00:11:58.228 23:04:24 -- scripts/common.sh@339 -- # ver1_l=2 00:11:58.228 23:04:24 -- scripts/common.sh@340 -- # ver2_l=1 00:11:58.228 23:04:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:58.228 23:04:24 -- scripts/common.sh@343 -- # case "$op" in 00:11:58.228 23:04:24 -- scripts/common.sh@344 -- # : 1 00:11:58.228 23:04:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:58.228 23:04:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:58.228 23:04:24 -- scripts/common.sh@364 -- # decimal 1 00:11:58.228 23:04:24 -- scripts/common.sh@352 -- # local d=1 00:11:58.228 23:04:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:58.228 23:04:24 -- scripts/common.sh@354 -- # echo 1 00:11:58.228 23:04:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:58.228 23:04:24 -- scripts/common.sh@365 -- # decimal 2 00:11:58.228 23:04:24 -- scripts/common.sh@352 -- # local d=2 00:11:58.228 23:04:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:58.228 23:04:24 -- scripts/common.sh@354 -- # echo 2 00:11:58.228 23:04:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:58.228 23:04:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:58.228 23:04:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:58.228 23:04:24 -- scripts/common.sh@367 -- # return 0 00:11:58.228 23:04:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:58.228 23:04:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:58.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:58.228 --rc genhtml_branch_coverage=1 00:11:58.228 --rc genhtml_function_coverage=1 00:11:58.228 --rc genhtml_legend=1 00:11:58.228 --rc geninfo_all_blocks=1 00:11:58.228 --rc geninfo_unexecuted_blocks=1 00:11:58.228 00:11:58.228 ' 00:11:58.228 23:04:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:58.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:58.228 --rc genhtml_branch_coverage=1 00:11:58.228 --rc genhtml_function_coverage=1 00:11:58.228 --rc genhtml_legend=1 00:11:58.228 --rc geninfo_all_blocks=1 00:11:58.228 --rc geninfo_unexecuted_blocks=1 00:11:58.228 00:11:58.228 ' 00:11:58.228 23:04:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:58.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:58.228 --rc genhtml_branch_coverage=1 00:11:58.228 --rc genhtml_function_coverage=1 00:11:58.228 --rc genhtml_legend=1 00:11:58.228 --rc geninfo_all_blocks=1 00:11:58.228 --rc geninfo_unexecuted_blocks=1 00:11:58.228 00:11:58.229 ' 00:11:58.229 23:04:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:58.229 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:58.229 --rc genhtml_branch_coverage=1 00:11:58.229 --rc genhtml_function_coverage=1 00:11:58.229 --rc genhtml_legend=1 00:11:58.229 --rc geninfo_all_blocks=1 00:11:58.229 --rc geninfo_unexecuted_blocks=1 00:11:58.229 00:11:58.229 ' 00:11:58.229 23:04:24 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:58.229 23:04:24 -- nvmf/common.sh@7 -- # uname -s 00:11:58.229 23:04:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:58.229 23:04:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:58.229 23:04:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:58.229 23:04:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:58.229 23:04:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:58.229 23:04:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:58.229 23:04:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:58.229 23:04:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:58.229 23:04:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:58.229 23:04:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:58.229 23:04:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:58.229 23:04:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:58.229 23:04:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:58.229 23:04:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:58.229 23:04:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:58.229 23:04:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:58.229 23:04:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:58.229 23:04:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:58.229 23:04:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:58.229 23:04:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.229 23:04:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.229 23:04:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.229 23:04:24 -- paths/export.sh@5 -- # export PATH 00:11:58.229 23:04:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.229 23:04:24 -- nvmf/common.sh@46 -- # : 0 00:11:58.229 23:04:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:58.229 23:04:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:58.229 23:04:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:58.229 23:04:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:58.229 23:04:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:58.229 23:04:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:58.229 23:04:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:58.229 23:04:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:58.229 23:04:24 -- target/rpc.sh@11 -- # loops=5 00:11:58.229 23:04:24 -- target/rpc.sh@23 -- # nvmftestinit 00:11:58.229 23:04:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:58.229 23:04:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:58.229 23:04:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:58.229 23:04:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:58.229 23:04:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:58.229 23:04:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:58.229 23:04:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:58.229 23:04:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:58.229 23:04:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:58.229 23:04:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:58.229 23:04:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:58.229 23:04:24 -- common/autotest_common.sh@10 -- # set +x 00:12:00.135 23:04:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:00.135 23:04:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:00.135 23:04:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:00.135 23:04:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:00.135 23:04:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:00.135 23:04:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:00.135 23:04:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:00.135 23:04:26 -- nvmf/common.sh@294 -- # net_devs=() 00:12:00.135 23:04:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:00.135 23:04:26 -- nvmf/common.sh@295 -- # e810=() 00:12:00.135 23:04:26 -- nvmf/common.sh@295 -- # local -ga e810 00:12:00.135 23:04:26 -- nvmf/common.sh@296 -- # x722=() 00:12:00.135 23:04:26 -- nvmf/common.sh@296 -- # local -ga x722 00:12:00.135 23:04:26 -- nvmf/common.sh@297 -- # mlx=() 00:12:00.135 23:04:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:00.135 23:04:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:00.135 23:04:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:00.135 23:04:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:00.135 23:04:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:00.135 23:04:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:00.135 23:04:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:00.135 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:00.135 23:04:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:00.135 23:04:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:00.135 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:00.135 23:04:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:00.135 23:04:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:00.135 23:04:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:00.135 23:04:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:00.135 23:04:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:00.135 23:04:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:00.135 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:00.135 23:04:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:00.135 23:04:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:00.135 23:04:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:00.135 23:04:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:00.135 23:04:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:00.135 23:04:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:00.135 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:00.135 23:04:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:00.135 23:04:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:00.135 23:04:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:00.135 23:04:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:00.135 23:04:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:00.135 23:04:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:00.135 23:04:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:00.135 23:04:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:00.135 23:04:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:00.135 23:04:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:00.135 23:04:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:00.135 23:04:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:00.135 23:04:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:00.135 23:04:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:00.135 23:04:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:00.135 23:04:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:00.135 23:04:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:00.136 23:04:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:00.136 23:04:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:00.136 23:04:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:00.136 23:04:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:00.136 23:04:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:00.395 23:04:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:00.395 23:04:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:00.395 23:04:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:00.395 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:00.395 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:12:00.395 00:12:00.395 --- 10.0.0.2 ping statistics --- 00:12:00.395 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:00.395 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:12:00.395 23:04:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:00.395 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:00.395 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:12:00.395 00:12:00.395 --- 10.0.0.1 ping statistics --- 00:12:00.395 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:00.395 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:12:00.395 23:04:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:00.395 23:04:26 -- nvmf/common.sh@410 -- # return 0 00:12:00.395 23:04:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:00.395 23:04:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:00.395 23:04:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:00.395 23:04:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:00.395 23:04:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:00.395 23:04:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:00.395 23:04:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:00.395 23:04:26 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:00.395 23:04:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:00.395 23:04:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:00.395 23:04:26 -- common/autotest_common.sh@10 -- # set +x 00:12:00.395 23:04:26 -- nvmf/common.sh@469 -- # nvmfpid=151427 00:12:00.395 23:04:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:00.395 23:04:26 -- nvmf/common.sh@470 -- # waitforlisten 151427 00:12:00.395 23:04:26 -- common/autotest_common.sh@829 -- # '[' -z 151427 ']' 00:12:00.395 23:04:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:00.395 23:04:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:00.395 23:04:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:00.395 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:00.395 23:04:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:00.395 23:04:26 -- common/autotest_common.sh@10 -- # set +x 00:12:00.395 [2024-11-26 23:04:26.614903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:00.395 [2024-11-26 23:04:26.614985] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:00.395 EAL: No free 2048 kB hugepages reported on node 1 00:12:00.395 [2024-11-26 23:04:26.683613] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:00.653 [2024-11-26 23:04:26.802573] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:00.653 [2024-11-26 23:04:26.802737] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:00.653 [2024-11-26 23:04:26.802758] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:00.653 [2024-11-26 23:04:26.802771] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:00.653 [2024-11-26 23:04:26.802828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:00.653 [2024-11-26 23:04:26.802883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:00.653 [2024-11-26 23:04:26.802937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:00.653 [2024-11-26 23:04:26.802941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:01.220 23:04:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:01.220 23:04:27 -- common/autotest_common.sh@862 -- # return 0 00:12:01.220 23:04:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:01.220 23:04:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:01.220 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.220 23:04:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:01.220 23:04:27 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:01.220 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.220 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.220 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.220 23:04:27 -- target/rpc.sh@26 -- # stats='{ 00:12:01.220 "tick_rate": 2700000000, 00:12:01.220 "poll_groups": [ 00:12:01.220 { 00:12:01.220 "name": "nvmf_tgt_poll_group_0", 00:12:01.220 "admin_qpairs": 0, 00:12:01.220 "io_qpairs": 0, 00:12:01.220 "current_admin_qpairs": 0, 00:12:01.220 "current_io_qpairs": 0, 00:12:01.220 "pending_bdev_io": 0, 00:12:01.220 "completed_nvme_io": 0, 00:12:01.220 "transports": [] 00:12:01.220 }, 00:12:01.220 { 00:12:01.220 "name": "nvmf_tgt_poll_group_1", 00:12:01.220 "admin_qpairs": 0, 00:12:01.220 "io_qpairs": 0, 00:12:01.220 "current_admin_qpairs": 0, 00:12:01.220 "current_io_qpairs": 0, 00:12:01.220 "pending_bdev_io": 0, 00:12:01.220 "completed_nvme_io": 0, 00:12:01.220 "transports": [] 00:12:01.220 }, 00:12:01.220 { 00:12:01.220 "name": "nvmf_tgt_poll_group_2", 00:12:01.220 "admin_qpairs": 0, 00:12:01.221 "io_qpairs": 0, 00:12:01.221 "current_admin_qpairs": 0, 00:12:01.221 "current_io_qpairs": 0, 00:12:01.221 "pending_bdev_io": 0, 00:12:01.221 "completed_nvme_io": 0, 00:12:01.221 "transports": [] 00:12:01.221 }, 00:12:01.221 { 00:12:01.221 "name": "nvmf_tgt_poll_group_3", 00:12:01.221 "admin_qpairs": 0, 00:12:01.221 "io_qpairs": 0, 00:12:01.221 "current_admin_qpairs": 0, 00:12:01.221 "current_io_qpairs": 0, 00:12:01.221 "pending_bdev_io": 0, 00:12:01.221 "completed_nvme_io": 0, 00:12:01.221 "transports": [] 00:12:01.221 } 00:12:01.221 ] 00:12:01.221 }' 00:12:01.221 23:04:27 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:01.221 23:04:27 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:01.221 23:04:27 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:01.221 23:04:27 -- target/rpc.sh@15 -- # wc -l 00:12:01.481 23:04:27 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:01.481 23:04:27 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:01.481 23:04:27 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:01.481 23:04:27 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:01.481 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.481 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.481 [2024-11-26 23:04:27.671263] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:01.481 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.481 23:04:27 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:01.481 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.481 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.481 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.481 23:04:27 -- target/rpc.sh@33 -- # stats='{ 00:12:01.481 "tick_rate": 2700000000, 00:12:01.481 "poll_groups": [ 00:12:01.481 { 00:12:01.481 "name": "nvmf_tgt_poll_group_0", 00:12:01.481 "admin_qpairs": 0, 00:12:01.481 "io_qpairs": 0, 00:12:01.481 "current_admin_qpairs": 0, 00:12:01.481 "current_io_qpairs": 0, 00:12:01.481 "pending_bdev_io": 0, 00:12:01.481 "completed_nvme_io": 0, 00:12:01.481 "transports": [ 00:12:01.481 { 00:12:01.481 "trtype": "TCP" 00:12:01.481 } 00:12:01.481 ] 00:12:01.481 }, 00:12:01.481 { 00:12:01.481 "name": "nvmf_tgt_poll_group_1", 00:12:01.481 "admin_qpairs": 0, 00:12:01.481 "io_qpairs": 0, 00:12:01.481 "current_admin_qpairs": 0, 00:12:01.481 "current_io_qpairs": 0, 00:12:01.481 "pending_bdev_io": 0, 00:12:01.481 "completed_nvme_io": 0, 00:12:01.481 "transports": [ 00:12:01.481 { 00:12:01.481 "trtype": "TCP" 00:12:01.481 } 00:12:01.481 ] 00:12:01.481 }, 00:12:01.481 { 00:12:01.481 "name": "nvmf_tgt_poll_group_2", 00:12:01.481 "admin_qpairs": 0, 00:12:01.481 "io_qpairs": 0, 00:12:01.481 "current_admin_qpairs": 0, 00:12:01.481 "current_io_qpairs": 0, 00:12:01.481 "pending_bdev_io": 0, 00:12:01.481 "completed_nvme_io": 0, 00:12:01.481 "transports": [ 00:12:01.481 { 00:12:01.481 "trtype": "TCP" 00:12:01.481 } 00:12:01.481 ] 00:12:01.481 }, 00:12:01.481 { 00:12:01.481 "name": "nvmf_tgt_poll_group_3", 00:12:01.481 "admin_qpairs": 0, 00:12:01.481 "io_qpairs": 0, 00:12:01.481 "current_admin_qpairs": 0, 00:12:01.481 "current_io_qpairs": 0, 00:12:01.481 "pending_bdev_io": 0, 00:12:01.481 "completed_nvme_io": 0, 00:12:01.481 "transports": [ 00:12:01.481 { 00:12:01.481 "trtype": "TCP" 00:12:01.481 } 00:12:01.481 ] 00:12:01.481 } 00:12:01.481 ] 00:12:01.481 }' 00:12:01.481 23:04:27 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:01.482 23:04:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:01.482 23:04:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:01.482 23:04:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:01.482 23:04:27 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:01.482 23:04:27 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:01.482 23:04:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:01.482 23:04:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:01.482 23:04:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:01.482 23:04:27 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:01.482 23:04:27 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:01.482 23:04:27 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:01.482 23:04:27 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:01.482 23:04:27 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:01.482 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.482 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.482 Malloc1 00:12:01.482 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.482 23:04:27 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:01.482 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.482 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.482 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.482 23:04:27 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:01.482 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.482 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.482 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.482 23:04:27 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:01.482 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.482 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.482 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.482 23:04:27 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:01.482 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.482 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.482 [2024-11-26 23:04:27.820650] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:01.482 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.482 23:04:27 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:01.482 23:04:27 -- common/autotest_common.sh@650 -- # local es=0 00:12:01.482 23:04:27 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:01.482 23:04:27 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:01.482 23:04:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.482 23:04:27 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:01.482 23:04:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.482 23:04:27 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:01.482 23:04:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.482 23:04:27 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:01.482 23:04:27 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:01.482 23:04:27 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:01.482 [2024-11-26 23:04:27.843071] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:01.482 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:01.482 could not add new controller: failed to write to nvme-fabrics device 00:12:01.482 23:04:27 -- common/autotest_common.sh@653 -- # es=1 00:12:01.482 23:04:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:01.482 23:04:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:01.482 23:04:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:01.482 23:04:27 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:01.482 23:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.482 23:04:27 -- common/autotest_common.sh@10 -- # set +x 00:12:01.743 23:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.743 23:04:27 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.312 23:04:28 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.312 23:04:28 -- common/autotest_common.sh@1187 -- # local i=0 00:12:02.312 23:04:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.312 23:04:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:02.312 23:04:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:04.221 23:04:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:04.221 23:04:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:04.221 23:04:30 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:04.221 23:04:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:04.221 23:04:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:04.221 23:04:30 -- common/autotest_common.sh@1197 -- # return 0 00:12:04.221 23:04:30 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:04.221 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.221 23:04:30 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:04.221 23:04:30 -- common/autotest_common.sh@1208 -- # local i=0 00:12:04.221 23:04:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:04.221 23:04:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.221 23:04:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:04.221 23:04:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.482 23:04:30 -- common/autotest_common.sh@1220 -- # return 0 00:12:04.482 23:04:30 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:04.482 23:04:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.482 23:04:30 -- common/autotest_common.sh@10 -- # set +x 00:12:04.482 23:04:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.482 23:04:30 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.482 23:04:30 -- common/autotest_common.sh@650 -- # local es=0 00:12:04.482 23:04:30 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.482 23:04:30 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:04.482 23:04:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:04.482 23:04:30 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:04.482 23:04:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:04.482 23:04:30 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:04.482 23:04:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:04.482 23:04:30 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:04.482 23:04:30 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:04.482 23:04:30 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.482 [2024-11-26 23:04:30.642729] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:04.482 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:04.482 could not add new controller: failed to write to nvme-fabrics device 00:12:04.482 23:04:30 -- common/autotest_common.sh@653 -- # es=1 00:12:04.482 23:04:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:04.482 23:04:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:04.482 23:04:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:04.482 23:04:30 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:04.482 23:04:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.482 23:04:30 -- common/autotest_common.sh@10 -- # set +x 00:12:04.482 23:04:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.482 23:04:30 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.051 23:04:31 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:05.051 23:04:31 -- common/autotest_common.sh@1187 -- # local i=0 00:12:05.051 23:04:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:05.051 23:04:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:05.051 23:04:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:07.597 23:04:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:07.597 23:04:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:07.597 23:04:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:07.597 23:04:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:07.597 23:04:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:07.597 23:04:33 -- common/autotest_common.sh@1197 -- # return 0 00:12:07.597 23:04:33 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:07.597 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.597 23:04:33 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:07.597 23:04:33 -- common/autotest_common.sh@1208 -- # local i=0 00:12:07.597 23:04:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:07.597 23:04:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.597 23:04:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:07.597 23:04:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.597 23:04:33 -- common/autotest_common.sh@1220 -- # return 0 00:12:07.597 23:04:33 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:07.597 23:04:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.597 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:12:07.597 23:04:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.597 23:04:33 -- target/rpc.sh@81 -- # seq 1 5 00:12:07.597 23:04:33 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:07.597 23:04:33 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:07.597 23:04:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.597 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:12:07.597 23:04:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.597 23:04:33 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:07.597 23:04:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.597 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:12:07.597 [2024-11-26 23:04:33.545695] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:07.597 23:04:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.597 23:04:33 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:07.597 23:04:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.597 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:12:07.597 23:04:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.597 23:04:33 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:07.597 23:04:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.597 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:12:07.597 23:04:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.597 23:04:33 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:08.164 23:04:34 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:08.164 23:04:34 -- common/autotest_common.sh@1187 -- # local i=0 00:12:08.164 23:04:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:08.165 23:04:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:08.165 23:04:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:10.071 23:04:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:10.071 23:04:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:10.071 23:04:36 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:10.071 23:04:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:10.071 23:04:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:10.071 23:04:36 -- common/autotest_common.sh@1197 -- # return 0 00:12:10.071 23:04:36 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:10.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.071 23:04:36 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:10.071 23:04:36 -- common/autotest_common.sh@1208 -- # local i=0 00:12:10.071 23:04:36 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:10.071 23:04:36 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.071 23:04:36 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:10.071 23:04:36 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.071 23:04:36 -- common/autotest_common.sh@1220 -- # return 0 00:12:10.071 23:04:36 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:10.071 23:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.071 23:04:36 -- common/autotest_common.sh@10 -- # set +x 00:12:10.071 23:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.071 23:04:36 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.071 23:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.071 23:04:36 -- common/autotest_common.sh@10 -- # set +x 00:12:10.071 23:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.071 23:04:36 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:10.071 23:04:36 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:10.071 23:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.071 23:04:36 -- common/autotest_common.sh@10 -- # set +x 00:12:10.071 23:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.071 23:04:36 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.071 23:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.071 23:04:36 -- common/autotest_common.sh@10 -- # set +x 00:12:10.071 [2024-11-26 23:04:36.414620] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.071 23:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.071 23:04:36 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:10.071 23:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.071 23:04:36 -- common/autotest_common.sh@10 -- # set +x 00:12:10.071 23:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.071 23:04:36 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:10.071 23:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.071 23:04:36 -- common/autotest_common.sh@10 -- # set +x 00:12:10.071 23:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.071 23:04:36 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:11.007 23:04:37 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:11.007 23:04:37 -- common/autotest_common.sh@1187 -- # local i=0 00:12:11.007 23:04:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:11.007 23:04:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:11.007 23:04:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:12.916 23:04:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:12.916 23:04:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:12.916 23:04:39 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:12.916 23:04:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:12.916 23:04:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:12.916 23:04:39 -- common/autotest_common.sh@1197 -- # return 0 00:12:12.916 23:04:39 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:12.916 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.916 23:04:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:12.916 23:04:39 -- common/autotest_common.sh@1208 -- # local i=0 00:12:12.916 23:04:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:12.916 23:04:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:12.916 23:04:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:12.916 23:04:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:12.916 23:04:39 -- common/autotest_common.sh@1220 -- # return 0 00:12:12.916 23:04:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:12.916 23:04:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.916 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:12:12.916 23:04:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.916 23:04:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.916 23:04:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.916 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:12:12.916 23:04:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.916 23:04:39 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:12.916 23:04:39 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:12.916 23:04:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.916 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:12:12.916 23:04:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.916 23:04:39 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:12.916 23:04:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.916 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:12:12.916 [2024-11-26 23:04:39.152445] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.916 23:04:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.916 23:04:39 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:12.916 23:04:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.916 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:12:12.916 23:04:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.916 23:04:39 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:12.916 23:04:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.916 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:12:12.916 23:04:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.916 23:04:39 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:13.482 23:04:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:13.482 23:04:39 -- common/autotest_common.sh@1187 -- # local i=0 00:12:13.482 23:04:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:13.482 23:04:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:13.482 23:04:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:16.022 23:04:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:16.022 23:04:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:16.022 23:04:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:16.022 23:04:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:16.022 23:04:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:16.022 23:04:41 -- common/autotest_common.sh@1197 -- # return 0 00:12:16.022 23:04:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:16.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.022 23:04:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:16.022 23:04:41 -- common/autotest_common.sh@1208 -- # local i=0 00:12:16.022 23:04:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:16.022 23:04:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.022 23:04:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:16.022 23:04:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.022 23:04:41 -- common/autotest_common.sh@1220 -- # return 0 00:12:16.022 23:04:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:16.022 23:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.022 23:04:41 -- common/autotest_common.sh@10 -- # set +x 00:12:16.022 23:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.022 23:04:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:16.022 23:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.022 23:04:41 -- common/autotest_common.sh@10 -- # set +x 00:12:16.022 23:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.022 23:04:41 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:16.022 23:04:41 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:16.022 23:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.022 23:04:41 -- common/autotest_common.sh@10 -- # set +x 00:12:16.022 23:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.022 23:04:41 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:16.022 23:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.022 23:04:41 -- common/autotest_common.sh@10 -- # set +x 00:12:16.022 [2024-11-26 23:04:41.983162] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:16.022 23:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.022 23:04:41 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:16.022 23:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.022 23:04:41 -- common/autotest_common.sh@10 -- # set +x 00:12:16.022 23:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.022 23:04:41 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:16.022 23:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.022 23:04:41 -- common/autotest_common.sh@10 -- # set +x 00:12:16.022 23:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.022 23:04:42 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:16.282 23:04:42 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:16.282 23:04:42 -- common/autotest_common.sh@1187 -- # local i=0 00:12:16.282 23:04:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:16.282 23:04:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:16.282 23:04:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:18.820 23:04:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:18.820 23:04:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:18.820 23:04:44 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:18.820 23:04:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:18.820 23:04:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:18.820 23:04:44 -- common/autotest_common.sh@1197 -- # return 0 00:12:18.820 23:04:44 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:18.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.820 23:04:44 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:18.820 23:04:44 -- common/autotest_common.sh@1208 -- # local i=0 00:12:18.820 23:04:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:18.820 23:04:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:18.820 23:04:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:18.820 23:04:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:18.820 23:04:44 -- common/autotest_common.sh@1220 -- # return 0 00:12:18.820 23:04:44 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:18.820 23:04:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.820 23:04:44 -- common/autotest_common.sh@10 -- # set +x 00:12:18.820 23:04:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.820 23:04:44 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.820 23:04:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.820 23:04:44 -- common/autotest_common.sh@10 -- # set +x 00:12:18.820 23:04:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.820 23:04:44 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:18.820 23:04:44 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:18.820 23:04:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.820 23:04:44 -- common/autotest_common.sh@10 -- # set +x 00:12:18.820 23:04:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.820 23:04:44 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:18.820 23:04:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.820 23:04:44 -- common/autotest_common.sh@10 -- # set +x 00:12:18.820 [2024-11-26 23:04:44.762909] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:18.820 23:04:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.820 23:04:44 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:18.820 23:04:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.820 23:04:44 -- common/autotest_common.sh@10 -- # set +x 00:12:18.820 23:04:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.821 23:04:44 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:18.821 23:04:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.821 23:04:44 -- common/autotest_common.sh@10 -- # set +x 00:12:18.821 23:04:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.821 23:04:44 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:19.079 23:04:45 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:19.079 23:04:45 -- common/autotest_common.sh@1187 -- # local i=0 00:12:19.079 23:04:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:19.079 23:04:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:19.079 23:04:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:21.623 23:04:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:21.623 23:04:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:21.623 23:04:47 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:21.623 23:04:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:21.623 23:04:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:21.623 23:04:47 -- common/autotest_common.sh@1197 -- # return 0 00:12:21.623 23:04:47 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:21.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.623 23:04:47 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:21.623 23:04:47 -- common/autotest_common.sh@1208 -- # local i=0 00:12:21.623 23:04:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:21.623 23:04:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:21.623 23:04:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:21.623 23:04:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:21.623 23:04:47 -- common/autotest_common.sh@1220 -- # return 0 00:12:21.623 23:04:47 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@99 -- # seq 1 5 00:12:21.623 23:04:47 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.623 23:04:47 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 [2024-11-26 23:04:47.601492] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.623 23:04:47 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 [2024-11-26 23:04:47.649562] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.623 23:04:47 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 [2024-11-26 23:04:47.697709] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.623 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.623 23:04:47 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.623 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.624 23:04:47 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 [2024-11-26 23:04:47.745890] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.624 23:04:47 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 [2024-11-26 23:04:47.794036] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:21.624 23:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.624 23:04:47 -- common/autotest_common.sh@10 -- # set +x 00:12:21.624 23:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.624 23:04:47 -- target/rpc.sh@110 -- # stats='{ 00:12:21.624 "tick_rate": 2700000000, 00:12:21.624 "poll_groups": [ 00:12:21.624 { 00:12:21.624 "name": "nvmf_tgt_poll_group_0", 00:12:21.624 "admin_qpairs": 2, 00:12:21.624 "io_qpairs": 84, 00:12:21.624 "current_admin_qpairs": 0, 00:12:21.624 "current_io_qpairs": 0, 00:12:21.624 "pending_bdev_io": 0, 00:12:21.624 "completed_nvme_io": 85, 00:12:21.624 "transports": [ 00:12:21.624 { 00:12:21.624 "trtype": "TCP" 00:12:21.624 } 00:12:21.624 ] 00:12:21.624 }, 00:12:21.624 { 00:12:21.624 "name": "nvmf_tgt_poll_group_1", 00:12:21.624 "admin_qpairs": 2, 00:12:21.624 "io_qpairs": 84, 00:12:21.624 "current_admin_qpairs": 0, 00:12:21.624 "current_io_qpairs": 0, 00:12:21.624 "pending_bdev_io": 0, 00:12:21.624 "completed_nvme_io": 186, 00:12:21.624 "transports": [ 00:12:21.624 { 00:12:21.624 "trtype": "TCP" 00:12:21.624 } 00:12:21.624 ] 00:12:21.624 }, 00:12:21.624 { 00:12:21.624 "name": "nvmf_tgt_poll_group_2", 00:12:21.624 "admin_qpairs": 1, 00:12:21.624 "io_qpairs": 84, 00:12:21.624 "current_admin_qpairs": 0, 00:12:21.624 "current_io_qpairs": 0, 00:12:21.624 "pending_bdev_io": 0, 00:12:21.624 "completed_nvme_io": 233, 00:12:21.624 "transports": [ 00:12:21.624 { 00:12:21.624 "trtype": "TCP" 00:12:21.624 } 00:12:21.624 ] 00:12:21.624 }, 00:12:21.624 { 00:12:21.624 "name": "nvmf_tgt_poll_group_3", 00:12:21.624 "admin_qpairs": 2, 00:12:21.624 "io_qpairs": 84, 00:12:21.624 "current_admin_qpairs": 0, 00:12:21.624 "current_io_qpairs": 0, 00:12:21.624 "pending_bdev_io": 0, 00:12:21.624 "completed_nvme_io": 182, 00:12:21.624 "transports": [ 00:12:21.624 { 00:12:21.624 "trtype": "TCP" 00:12:21.624 } 00:12:21.624 ] 00:12:21.624 } 00:12:21.624 ] 00:12:21.624 }' 00:12:21.624 23:04:47 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:21.624 23:04:47 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:21.624 23:04:47 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:21.624 23:04:47 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:21.624 23:04:47 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:21.624 23:04:47 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:21.624 23:04:47 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:21.624 23:04:47 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:21.624 23:04:47 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:21.624 23:04:47 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:21.624 23:04:47 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:21.624 23:04:47 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:21.624 23:04:47 -- target/rpc.sh@123 -- # nvmftestfini 00:12:21.624 23:04:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:21.624 23:04:47 -- nvmf/common.sh@116 -- # sync 00:12:21.624 23:04:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:21.624 23:04:47 -- nvmf/common.sh@119 -- # set +e 00:12:21.624 23:04:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:21.624 23:04:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:21.624 rmmod nvme_tcp 00:12:21.624 rmmod nvme_fabrics 00:12:21.624 rmmod nvme_keyring 00:12:21.624 23:04:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:21.624 23:04:47 -- nvmf/common.sh@123 -- # set -e 00:12:21.624 23:04:47 -- nvmf/common.sh@124 -- # return 0 00:12:21.624 23:04:47 -- nvmf/common.sh@477 -- # '[' -n 151427 ']' 00:12:21.624 23:04:47 -- nvmf/common.sh@478 -- # killprocess 151427 00:12:21.624 23:04:47 -- common/autotest_common.sh@936 -- # '[' -z 151427 ']' 00:12:21.624 23:04:47 -- common/autotest_common.sh@940 -- # kill -0 151427 00:12:21.624 23:04:47 -- common/autotest_common.sh@941 -- # uname 00:12:21.624 23:04:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:21.624 23:04:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 151427 00:12:21.624 23:04:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:21.624 23:04:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:21.624 23:04:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 151427' 00:12:21.624 killing process with pid 151427 00:12:21.624 23:04:48 -- common/autotest_common.sh@955 -- # kill 151427 00:12:21.624 23:04:48 -- common/autotest_common.sh@960 -- # wait 151427 00:12:22.194 23:04:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:22.194 23:04:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:22.194 23:04:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:22.194 23:04:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:22.194 23:04:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:22.194 23:04:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:22.194 23:04:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:22.194 23:04:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:24.106 23:04:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:24.106 00:12:24.106 real 0m26.036s 00:12:24.106 user 1m25.196s 00:12:24.106 sys 0m4.237s 00:12:24.106 23:04:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:24.106 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:12:24.106 ************************************ 00:12:24.106 END TEST nvmf_rpc 00:12:24.106 ************************************ 00:12:24.106 23:04:50 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:24.106 23:04:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:24.106 23:04:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:24.106 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:12:24.106 ************************************ 00:12:24.106 START TEST nvmf_invalid 00:12:24.106 ************************************ 00:12:24.106 23:04:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:24.106 * Looking for test storage... 00:12:24.106 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:24.106 23:04:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:24.106 23:04:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:24.106 23:04:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:24.368 23:04:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:24.368 23:04:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:24.368 23:04:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:24.368 23:04:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:24.368 23:04:50 -- scripts/common.sh@335 -- # IFS=.-: 00:12:24.368 23:04:50 -- scripts/common.sh@335 -- # read -ra ver1 00:12:24.368 23:04:50 -- scripts/common.sh@336 -- # IFS=.-: 00:12:24.368 23:04:50 -- scripts/common.sh@336 -- # read -ra ver2 00:12:24.368 23:04:50 -- scripts/common.sh@337 -- # local 'op=<' 00:12:24.368 23:04:50 -- scripts/common.sh@339 -- # ver1_l=2 00:12:24.368 23:04:50 -- scripts/common.sh@340 -- # ver2_l=1 00:12:24.368 23:04:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:24.368 23:04:50 -- scripts/common.sh@343 -- # case "$op" in 00:12:24.368 23:04:50 -- scripts/common.sh@344 -- # : 1 00:12:24.368 23:04:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:24.368 23:04:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:24.368 23:04:50 -- scripts/common.sh@364 -- # decimal 1 00:12:24.368 23:04:50 -- scripts/common.sh@352 -- # local d=1 00:12:24.368 23:04:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:24.368 23:04:50 -- scripts/common.sh@354 -- # echo 1 00:12:24.368 23:04:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:24.368 23:04:50 -- scripts/common.sh@365 -- # decimal 2 00:12:24.368 23:04:50 -- scripts/common.sh@352 -- # local d=2 00:12:24.368 23:04:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:24.368 23:04:50 -- scripts/common.sh@354 -- # echo 2 00:12:24.368 23:04:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:24.368 23:04:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:24.368 23:04:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:24.368 23:04:50 -- scripts/common.sh@367 -- # return 0 00:12:24.368 23:04:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:24.368 23:04:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:24.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:24.368 --rc genhtml_branch_coverage=1 00:12:24.368 --rc genhtml_function_coverage=1 00:12:24.368 --rc genhtml_legend=1 00:12:24.368 --rc geninfo_all_blocks=1 00:12:24.368 --rc geninfo_unexecuted_blocks=1 00:12:24.368 00:12:24.368 ' 00:12:24.369 23:04:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:24.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:24.369 --rc genhtml_branch_coverage=1 00:12:24.369 --rc genhtml_function_coverage=1 00:12:24.369 --rc genhtml_legend=1 00:12:24.369 --rc geninfo_all_blocks=1 00:12:24.369 --rc geninfo_unexecuted_blocks=1 00:12:24.369 00:12:24.369 ' 00:12:24.369 23:04:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:24.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:24.369 --rc genhtml_branch_coverage=1 00:12:24.369 --rc genhtml_function_coverage=1 00:12:24.369 --rc genhtml_legend=1 00:12:24.369 --rc geninfo_all_blocks=1 00:12:24.369 --rc geninfo_unexecuted_blocks=1 00:12:24.369 00:12:24.369 ' 00:12:24.369 23:04:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:24.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:24.369 --rc genhtml_branch_coverage=1 00:12:24.369 --rc genhtml_function_coverage=1 00:12:24.369 --rc genhtml_legend=1 00:12:24.369 --rc geninfo_all_blocks=1 00:12:24.369 --rc geninfo_unexecuted_blocks=1 00:12:24.369 00:12:24.369 ' 00:12:24.369 23:04:50 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:24.369 23:04:50 -- nvmf/common.sh@7 -- # uname -s 00:12:24.369 23:04:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:24.369 23:04:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:24.369 23:04:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:24.369 23:04:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:24.369 23:04:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:24.369 23:04:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:24.369 23:04:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:24.369 23:04:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:24.369 23:04:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:24.369 23:04:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:24.369 23:04:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:24.369 23:04:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:24.369 23:04:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:24.369 23:04:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:24.369 23:04:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:24.369 23:04:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:24.369 23:04:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:24.369 23:04:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:24.369 23:04:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:24.369 23:04:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.369 23:04:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.369 23:04:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.369 23:04:50 -- paths/export.sh@5 -- # export PATH 00:12:24.369 23:04:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.369 23:04:50 -- nvmf/common.sh@46 -- # : 0 00:12:24.369 23:04:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:24.369 23:04:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:24.369 23:04:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:24.369 23:04:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:24.369 23:04:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:24.369 23:04:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:24.369 23:04:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:24.369 23:04:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:24.369 23:04:50 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:24.369 23:04:50 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:24.369 23:04:50 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:24.369 23:04:50 -- target/invalid.sh@14 -- # target=foobar 00:12:24.369 23:04:50 -- target/invalid.sh@16 -- # RANDOM=0 00:12:24.369 23:04:50 -- target/invalid.sh@34 -- # nvmftestinit 00:12:24.369 23:04:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:24.369 23:04:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:24.369 23:04:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:24.369 23:04:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:24.369 23:04:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:24.369 23:04:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:24.369 23:04:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:24.369 23:04:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:24.369 23:04:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:24.369 23:04:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:24.369 23:04:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:24.369 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:12:26.273 23:04:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:26.273 23:04:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:26.273 23:04:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:26.273 23:04:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:26.273 23:04:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:26.273 23:04:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:26.273 23:04:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:26.273 23:04:52 -- nvmf/common.sh@294 -- # net_devs=() 00:12:26.273 23:04:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:26.273 23:04:52 -- nvmf/common.sh@295 -- # e810=() 00:12:26.273 23:04:52 -- nvmf/common.sh@295 -- # local -ga e810 00:12:26.273 23:04:52 -- nvmf/common.sh@296 -- # x722=() 00:12:26.273 23:04:52 -- nvmf/common.sh@296 -- # local -ga x722 00:12:26.273 23:04:52 -- nvmf/common.sh@297 -- # mlx=() 00:12:26.273 23:04:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:26.273 23:04:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:26.273 23:04:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:26.273 23:04:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:26.273 23:04:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:26.273 23:04:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:26.273 23:04:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:26.273 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:26.273 23:04:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:26.273 23:04:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:26.273 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:26.273 23:04:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:26.273 23:04:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:26.273 23:04:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:26.273 23:04:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:26.273 23:04:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:26.273 23:04:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:26.273 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:26.273 23:04:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:26.273 23:04:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:26.273 23:04:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:26.273 23:04:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:26.273 23:04:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:26.273 23:04:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:26.273 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:26.273 23:04:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:26.273 23:04:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:26.273 23:04:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:26.273 23:04:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:26.273 23:04:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:26.273 23:04:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:26.273 23:04:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:26.273 23:04:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:26.273 23:04:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:26.273 23:04:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:26.273 23:04:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:26.273 23:04:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:26.273 23:04:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:26.273 23:04:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:26.273 23:04:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:26.273 23:04:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:26.273 23:04:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:26.273 23:04:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:26.531 23:04:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:26.531 23:04:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:26.531 23:04:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:26.531 23:04:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:26.531 23:04:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:26.531 23:04:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:26.531 23:04:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:26.531 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:26.531 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:12:26.531 00:12:26.531 --- 10.0.0.2 ping statistics --- 00:12:26.531 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:26.531 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:12:26.531 23:04:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:26.531 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:26.531 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.138 ms 00:12:26.531 00:12:26.531 --- 10.0.0.1 ping statistics --- 00:12:26.531 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:26.531 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:12:26.532 23:04:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:26.532 23:04:52 -- nvmf/common.sh@410 -- # return 0 00:12:26.532 23:04:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:26.532 23:04:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:26.532 23:04:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:26.532 23:04:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:26.532 23:04:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:26.532 23:04:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:26.532 23:04:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:26.532 23:04:52 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:26.532 23:04:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:26.532 23:04:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:26.532 23:04:52 -- common/autotest_common.sh@10 -- # set +x 00:12:26.532 23:04:52 -- nvmf/common.sh@469 -- # nvmfpid=156143 00:12:26.532 23:04:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:26.532 23:04:52 -- nvmf/common.sh@470 -- # waitforlisten 156143 00:12:26.532 23:04:52 -- common/autotest_common.sh@829 -- # '[' -z 156143 ']' 00:12:26.532 23:04:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:26.532 23:04:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:26.532 23:04:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:26.532 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:26.532 23:04:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:26.532 23:04:52 -- common/autotest_common.sh@10 -- # set +x 00:12:26.532 [2024-11-26 23:04:52.903130] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:26.532 [2024-11-26 23:04:52.903213] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:26.792 EAL: No free 2048 kB hugepages reported on node 1 00:12:26.792 [2024-11-26 23:04:52.974023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:26.792 [2024-11-26 23:04:53.094208] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:26.792 [2024-11-26 23:04:53.094371] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:26.792 [2024-11-26 23:04:53.094392] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:26.792 [2024-11-26 23:04:53.094407] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:26.792 [2024-11-26 23:04:53.094489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:26.792 [2024-11-26 23:04:53.094574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:26.792 [2024-11-26 23:04:53.094601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:26.792 [2024-11-26 23:04:53.094605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:27.729 23:04:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:27.729 23:04:53 -- common/autotest_common.sh@862 -- # return 0 00:12:27.729 23:04:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:27.729 23:04:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:27.729 23:04:53 -- common/autotest_common.sh@10 -- # set +x 00:12:27.729 23:04:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:27.729 23:04:53 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:27.729 23:04:53 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode25902 00:12:27.987 [2024-11-26 23:04:54.165794] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:27.987 23:04:54 -- target/invalid.sh@40 -- # out='request: 00:12:27.987 { 00:12:27.987 "nqn": "nqn.2016-06.io.spdk:cnode25902", 00:12:27.987 "tgt_name": "foobar", 00:12:27.987 "method": "nvmf_create_subsystem", 00:12:27.987 "req_id": 1 00:12:27.987 } 00:12:27.987 Got JSON-RPC error response 00:12:27.987 response: 00:12:27.987 { 00:12:27.987 "code": -32603, 00:12:27.987 "message": "Unable to find target foobar" 00:12:27.987 }' 00:12:27.987 23:04:54 -- target/invalid.sh@41 -- # [[ request: 00:12:27.987 { 00:12:27.987 "nqn": "nqn.2016-06.io.spdk:cnode25902", 00:12:27.987 "tgt_name": "foobar", 00:12:27.987 "method": "nvmf_create_subsystem", 00:12:27.987 "req_id": 1 00:12:27.987 } 00:12:27.987 Got JSON-RPC error response 00:12:27.987 response: 00:12:27.987 { 00:12:27.987 "code": -32603, 00:12:27.987 "message": "Unable to find target foobar" 00:12:27.987 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:27.987 23:04:54 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:27.987 23:04:54 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode6669 00:12:28.245 [2024-11-26 23:04:54.474867] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6669: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:28.245 23:04:54 -- target/invalid.sh@45 -- # out='request: 00:12:28.245 { 00:12:28.245 "nqn": "nqn.2016-06.io.spdk:cnode6669", 00:12:28.245 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:28.245 "method": "nvmf_create_subsystem", 00:12:28.245 "req_id": 1 00:12:28.245 } 00:12:28.245 Got JSON-RPC error response 00:12:28.245 response: 00:12:28.245 { 00:12:28.245 "code": -32602, 00:12:28.245 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:28.245 }' 00:12:28.245 23:04:54 -- target/invalid.sh@46 -- # [[ request: 00:12:28.245 { 00:12:28.245 "nqn": "nqn.2016-06.io.spdk:cnode6669", 00:12:28.245 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:28.245 "method": "nvmf_create_subsystem", 00:12:28.245 "req_id": 1 00:12:28.245 } 00:12:28.245 Got JSON-RPC error response 00:12:28.245 response: 00:12:28.245 { 00:12:28.245 "code": -32602, 00:12:28.245 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:28.245 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:28.246 23:04:54 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:28.246 23:04:54 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode9857 00:12:28.504 [2024-11-26 23:04:54.731649] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9857: invalid model number 'SPDK_Controller' 00:12:28.504 23:04:54 -- target/invalid.sh@50 -- # out='request: 00:12:28.504 { 00:12:28.504 "nqn": "nqn.2016-06.io.spdk:cnode9857", 00:12:28.504 "model_number": "SPDK_Controller\u001f", 00:12:28.504 "method": "nvmf_create_subsystem", 00:12:28.504 "req_id": 1 00:12:28.504 } 00:12:28.504 Got JSON-RPC error response 00:12:28.504 response: 00:12:28.504 { 00:12:28.504 "code": -32602, 00:12:28.504 "message": "Invalid MN SPDK_Controller\u001f" 00:12:28.504 }' 00:12:28.504 23:04:54 -- target/invalid.sh@51 -- # [[ request: 00:12:28.504 { 00:12:28.504 "nqn": "nqn.2016-06.io.spdk:cnode9857", 00:12:28.504 "model_number": "SPDK_Controller\u001f", 00:12:28.504 "method": "nvmf_create_subsystem", 00:12:28.504 "req_id": 1 00:12:28.504 } 00:12:28.504 Got JSON-RPC error response 00:12:28.504 response: 00:12:28.504 { 00:12:28.504 "code": -32602, 00:12:28.504 "message": "Invalid MN SPDK_Controller\u001f" 00:12:28.504 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:28.504 23:04:54 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:28.504 23:04:54 -- target/invalid.sh@19 -- # local length=21 ll 00:12:28.504 23:04:54 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:28.504 23:04:54 -- target/invalid.sh@21 -- # local chars 00:12:28.504 23:04:54 -- target/invalid.sh@22 -- # local string 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 104 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=h 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 106 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=j 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 45 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=- 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 76 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=L 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 44 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=, 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 127 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 88 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=X 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 71 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=G 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 114 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=r 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 47 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=/ 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 122 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=z 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 64 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+=@ 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.504 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # printf %x 92 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:28.504 23:04:54 -- target/invalid.sh@25 -- # string+='\' 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # printf %x 44 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # string+=, 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # printf %x 99 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x63' 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # string+=c 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # printf %x 74 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # string+=J 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # printf %x 55 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # string+=7 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # printf %x 67 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # string+=C 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # printf %x 89 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # string+=Y 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # printf %x 109 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # string+=m 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # printf %x 61 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:28.505 23:04:54 -- target/invalid.sh@25 -- # string+== 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.505 23:04:54 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.505 23:04:54 -- target/invalid.sh@28 -- # [[ h == \- ]] 00:12:28.505 23:04:54 -- target/invalid.sh@31 -- # echo 'hj-L,XGr/z@\,cJ7CYm=' 00:12:28.505 23:04:54 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'hj-L,XGr/z@\,cJ7CYm=' nqn.2016-06.io.spdk:cnode6841 00:12:28.764 [2024-11-26 23:04:55.052668] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6841: invalid serial number 'hj-L,XGr/z@\,cJ7CYm=' 00:12:28.764 23:04:55 -- target/invalid.sh@54 -- # out='request: 00:12:28.764 { 00:12:28.764 "nqn": "nqn.2016-06.io.spdk:cnode6841", 00:12:28.764 "serial_number": "hj-L,\u007fXGr/z@\\,cJ7CYm=", 00:12:28.764 "method": "nvmf_create_subsystem", 00:12:28.764 "req_id": 1 00:12:28.764 } 00:12:28.764 Got JSON-RPC error response 00:12:28.764 response: 00:12:28.764 { 00:12:28.764 "code": -32602, 00:12:28.764 "message": "Invalid SN hj-L,\u007fXGr/z@\\,cJ7CYm=" 00:12:28.764 }' 00:12:28.764 23:04:55 -- target/invalid.sh@55 -- # [[ request: 00:12:28.764 { 00:12:28.764 "nqn": "nqn.2016-06.io.spdk:cnode6841", 00:12:28.764 "serial_number": "hj-L,\u007fXGr/z@\\,cJ7CYm=", 00:12:28.764 "method": "nvmf_create_subsystem", 00:12:28.764 "req_id": 1 00:12:28.764 } 00:12:28.764 Got JSON-RPC error response 00:12:28.764 response: 00:12:28.764 { 00:12:28.764 "code": -32602, 00:12:28.764 "message": "Invalid SN hj-L,\u007fXGr/z@\\,cJ7CYm=" 00:12:28.764 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:28.764 23:04:55 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:28.764 23:04:55 -- target/invalid.sh@19 -- # local length=41 ll 00:12:28.764 23:04:55 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:28.764 23:04:55 -- target/invalid.sh@21 -- # local chars 00:12:28.764 23:04:55 -- target/invalid.sh@22 -- # local string 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 58 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=: 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 99 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x63' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=c 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 65 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=A 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 39 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=\' 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 70 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=F 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 98 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x62' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=b 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 77 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=M 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 97 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=a 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 64 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=@ 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 124 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+='|' 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 91 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+='[' 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 57 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=9 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 119 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=w 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 75 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=K 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 127 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 123 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # string+='{' 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.764 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # printf %x 91 00:12:28.764 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # string+='[' 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # printf %x 90 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # string+=Z 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # printf %x 114 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # string+=r 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # printf %x 123 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # string+='{' 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # printf %x 102 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # string+=f 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # printf %x 68 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:28.765 23:04:55 -- target/invalid.sh@25 -- # string+=D 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.765 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # printf %x 45 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # string+=- 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # printf %x 110 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # string+=n 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # printf %x 58 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # string+=: 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # printf %x 74 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # string+=J 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # printf %x 62 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # string+='>' 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.023 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # printf %x 71 00:12:29.023 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=G 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 104 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=h 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 112 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=p 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 66 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=B 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 127 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 75 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=K 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 125 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+='}' 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 110 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=n 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 127 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 86 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=V 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 111 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=o 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 56 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=8 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 36 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+='$' 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # printf %x 78 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:29.024 23:04:55 -- target/invalid.sh@25 -- # string+=N 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.024 23:04:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.024 23:04:55 -- target/invalid.sh@28 -- # [[ : == \- ]] 00:12:29.024 23:04:55 -- target/invalid.sh@31 -- # echo ':cA'\''FbMa@|[9wK{[Zr{fD-n:J>GhpBK}nVo8$N' 00:12:29.024 23:04:55 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d ':cA'\''FbMa@|[9wK{[Zr{fD-n:J>GhpBK}nVo8$N' nqn.2016-06.io.spdk:cnode26913 00:12:29.283 [2024-11-26 23:04:55.446010] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26913: invalid model number ':cA'FbMa@|[9wK{[Zr{fD-n:J>GhpBK}nVo8$N' 00:12:29.283 23:04:55 -- target/invalid.sh@58 -- # out='request: 00:12:29.283 { 00:12:29.283 "nqn": "nqn.2016-06.io.spdk:cnode26913", 00:12:29.283 "model_number": ":cA'\''FbMa@|[9wK\u007f{[Zr{fD-n:J>GhpB\u007fK}n\u007fVo8$N", 00:12:29.283 "method": "nvmf_create_subsystem", 00:12:29.283 "req_id": 1 00:12:29.283 } 00:12:29.283 Got JSON-RPC error response 00:12:29.283 response: 00:12:29.283 { 00:12:29.283 "code": -32602, 00:12:29.283 "message": "Invalid MN :cA'\''FbMa@|[9wK\u007f{[Zr{fD-n:J>GhpB\u007fK}n\u007fVo8$N" 00:12:29.283 }' 00:12:29.283 23:04:55 -- target/invalid.sh@59 -- # [[ request: 00:12:29.283 { 00:12:29.283 "nqn": "nqn.2016-06.io.spdk:cnode26913", 00:12:29.283 "model_number": ":cA'FbMa@|[9wK\u007f{[Zr{fD-n:J>GhpB\u007fK}n\u007fVo8$N", 00:12:29.283 "method": "nvmf_create_subsystem", 00:12:29.283 "req_id": 1 00:12:29.283 } 00:12:29.283 Got JSON-RPC error response 00:12:29.283 response: 00:12:29.283 { 00:12:29.283 "code": -32602, 00:12:29.283 "message": "Invalid MN :cA'FbMa@|[9wK\u007f{[Zr{fD-n:J>GhpB\u007fK}n\u007fVo8$N" 00:12:29.283 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:29.283 23:04:55 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:29.541 [2024-11-26 23:04:55.690893] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:29.541 23:04:55 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:29.800 23:04:55 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:29.800 23:04:55 -- target/invalid.sh@67 -- # echo '' 00:12:29.800 23:04:55 -- target/invalid.sh@67 -- # head -n 1 00:12:29.800 23:04:55 -- target/invalid.sh@67 -- # IP= 00:12:29.800 23:04:55 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:30.058 [2024-11-26 23:04:56.212610] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:30.058 23:04:56 -- target/invalid.sh@69 -- # out='request: 00:12:30.058 { 00:12:30.058 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:30.058 "listen_address": { 00:12:30.058 "trtype": "tcp", 00:12:30.058 "traddr": "", 00:12:30.058 "trsvcid": "4421" 00:12:30.058 }, 00:12:30.058 "method": "nvmf_subsystem_remove_listener", 00:12:30.058 "req_id": 1 00:12:30.058 } 00:12:30.058 Got JSON-RPC error response 00:12:30.058 response: 00:12:30.058 { 00:12:30.058 "code": -32602, 00:12:30.058 "message": "Invalid parameters" 00:12:30.058 }' 00:12:30.058 23:04:56 -- target/invalid.sh@70 -- # [[ request: 00:12:30.058 { 00:12:30.058 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:30.058 "listen_address": { 00:12:30.058 "trtype": "tcp", 00:12:30.058 "traddr": "", 00:12:30.058 "trsvcid": "4421" 00:12:30.058 }, 00:12:30.058 "method": "nvmf_subsystem_remove_listener", 00:12:30.059 "req_id": 1 00:12:30.059 } 00:12:30.059 Got JSON-RPC error response 00:12:30.059 response: 00:12:30.059 { 00:12:30.059 "code": -32602, 00:12:30.059 "message": "Invalid parameters" 00:12:30.059 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:30.059 23:04:56 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode23329 -i 0 00:12:30.318 [2024-11-26 23:04:56.457365] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23329: invalid cntlid range [0-65519] 00:12:30.318 23:04:56 -- target/invalid.sh@73 -- # out='request: 00:12:30.318 { 00:12:30.318 "nqn": "nqn.2016-06.io.spdk:cnode23329", 00:12:30.318 "min_cntlid": 0, 00:12:30.318 "method": "nvmf_create_subsystem", 00:12:30.318 "req_id": 1 00:12:30.318 } 00:12:30.318 Got JSON-RPC error response 00:12:30.318 response: 00:12:30.318 { 00:12:30.318 "code": -32602, 00:12:30.318 "message": "Invalid cntlid range [0-65519]" 00:12:30.318 }' 00:12:30.318 23:04:56 -- target/invalid.sh@74 -- # [[ request: 00:12:30.318 { 00:12:30.318 "nqn": "nqn.2016-06.io.spdk:cnode23329", 00:12:30.318 "min_cntlid": 0, 00:12:30.318 "method": "nvmf_create_subsystem", 00:12:30.318 "req_id": 1 00:12:30.318 } 00:12:30.318 Got JSON-RPC error response 00:12:30.318 response: 00:12:30.318 { 00:12:30.318 "code": -32602, 00:12:30.318 "message": "Invalid cntlid range [0-65519]" 00:12:30.318 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:30.318 23:04:56 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24404 -i 65520 00:12:30.318 [2024-11-26 23:04:56.702194] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24404: invalid cntlid range [65520-65519] 00:12:30.579 23:04:56 -- target/invalid.sh@75 -- # out='request: 00:12:30.579 { 00:12:30.579 "nqn": "nqn.2016-06.io.spdk:cnode24404", 00:12:30.579 "min_cntlid": 65520, 00:12:30.579 "method": "nvmf_create_subsystem", 00:12:30.579 "req_id": 1 00:12:30.579 } 00:12:30.579 Got JSON-RPC error response 00:12:30.579 response: 00:12:30.579 { 00:12:30.579 "code": -32602, 00:12:30.579 "message": "Invalid cntlid range [65520-65519]" 00:12:30.579 }' 00:12:30.579 23:04:56 -- target/invalid.sh@76 -- # [[ request: 00:12:30.579 { 00:12:30.579 "nqn": "nqn.2016-06.io.spdk:cnode24404", 00:12:30.579 "min_cntlid": 65520, 00:12:30.579 "method": "nvmf_create_subsystem", 00:12:30.579 "req_id": 1 00:12:30.579 } 00:12:30.579 Got JSON-RPC error response 00:12:30.579 response: 00:12:30.579 { 00:12:30.579 "code": -32602, 00:12:30.579 "message": "Invalid cntlid range [65520-65519]" 00:12:30.579 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:30.579 23:04:56 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8993 -I 0 00:12:30.579 [2024-11-26 23:04:56.955055] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8993: invalid cntlid range [1-0] 00:12:30.839 23:04:56 -- target/invalid.sh@77 -- # out='request: 00:12:30.839 { 00:12:30.839 "nqn": "nqn.2016-06.io.spdk:cnode8993", 00:12:30.839 "max_cntlid": 0, 00:12:30.839 "method": "nvmf_create_subsystem", 00:12:30.839 "req_id": 1 00:12:30.839 } 00:12:30.839 Got JSON-RPC error response 00:12:30.839 response: 00:12:30.839 { 00:12:30.839 "code": -32602, 00:12:30.839 "message": "Invalid cntlid range [1-0]" 00:12:30.839 }' 00:12:30.839 23:04:56 -- target/invalid.sh@78 -- # [[ request: 00:12:30.839 { 00:12:30.839 "nqn": "nqn.2016-06.io.spdk:cnode8993", 00:12:30.839 "max_cntlid": 0, 00:12:30.839 "method": "nvmf_create_subsystem", 00:12:30.839 "req_id": 1 00:12:30.839 } 00:12:30.839 Got JSON-RPC error response 00:12:30.839 response: 00:12:30.839 { 00:12:30.839 "code": -32602, 00:12:30.839 "message": "Invalid cntlid range [1-0]" 00:12:30.839 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:30.839 23:04:56 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode26155 -I 65520 00:12:30.839 [2024-11-26 23:04:57.211943] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26155: invalid cntlid range [1-65520] 00:12:31.098 23:04:57 -- target/invalid.sh@79 -- # out='request: 00:12:31.098 { 00:12:31.098 "nqn": "nqn.2016-06.io.spdk:cnode26155", 00:12:31.098 "max_cntlid": 65520, 00:12:31.098 "method": "nvmf_create_subsystem", 00:12:31.098 "req_id": 1 00:12:31.098 } 00:12:31.098 Got JSON-RPC error response 00:12:31.098 response: 00:12:31.098 { 00:12:31.098 "code": -32602, 00:12:31.098 "message": "Invalid cntlid range [1-65520]" 00:12:31.098 }' 00:12:31.098 23:04:57 -- target/invalid.sh@80 -- # [[ request: 00:12:31.098 { 00:12:31.098 "nqn": "nqn.2016-06.io.spdk:cnode26155", 00:12:31.098 "max_cntlid": 65520, 00:12:31.098 "method": "nvmf_create_subsystem", 00:12:31.098 "req_id": 1 00:12:31.098 } 00:12:31.098 Got JSON-RPC error response 00:12:31.098 response: 00:12:31.098 { 00:12:31.098 "code": -32602, 00:12:31.098 "message": "Invalid cntlid range [1-65520]" 00:12:31.098 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.098 23:04:57 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode15338 -i 6 -I 5 00:12:31.098 [2024-11-26 23:04:57.472828] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15338: invalid cntlid range [6-5] 00:12:31.360 23:04:57 -- target/invalid.sh@83 -- # out='request: 00:12:31.360 { 00:12:31.360 "nqn": "nqn.2016-06.io.spdk:cnode15338", 00:12:31.360 "min_cntlid": 6, 00:12:31.360 "max_cntlid": 5, 00:12:31.360 "method": "nvmf_create_subsystem", 00:12:31.360 "req_id": 1 00:12:31.360 } 00:12:31.360 Got JSON-RPC error response 00:12:31.360 response: 00:12:31.360 { 00:12:31.360 "code": -32602, 00:12:31.360 "message": "Invalid cntlid range [6-5]" 00:12:31.360 }' 00:12:31.360 23:04:57 -- target/invalid.sh@84 -- # [[ request: 00:12:31.360 { 00:12:31.360 "nqn": "nqn.2016-06.io.spdk:cnode15338", 00:12:31.360 "min_cntlid": 6, 00:12:31.360 "max_cntlid": 5, 00:12:31.360 "method": "nvmf_create_subsystem", 00:12:31.360 "req_id": 1 00:12:31.360 } 00:12:31.360 Got JSON-RPC error response 00:12:31.360 response: 00:12:31.360 { 00:12:31.360 "code": -32602, 00:12:31.360 "message": "Invalid cntlid range [6-5]" 00:12:31.360 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.360 23:04:57 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:31.360 23:04:57 -- target/invalid.sh@87 -- # out='request: 00:12:31.360 { 00:12:31.360 "name": "foobar", 00:12:31.360 "method": "nvmf_delete_target", 00:12:31.360 "req_id": 1 00:12:31.360 } 00:12:31.360 Got JSON-RPC error response 00:12:31.360 response: 00:12:31.360 { 00:12:31.360 "code": -32602, 00:12:31.360 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:31.360 }' 00:12:31.360 23:04:57 -- target/invalid.sh@88 -- # [[ request: 00:12:31.360 { 00:12:31.360 "name": "foobar", 00:12:31.360 "method": "nvmf_delete_target", 00:12:31.360 "req_id": 1 00:12:31.360 } 00:12:31.360 Got JSON-RPC error response 00:12:31.360 response: 00:12:31.360 { 00:12:31.360 "code": -32602, 00:12:31.360 "message": "The specified target doesn't exist, cannot delete it." 00:12:31.360 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:31.360 23:04:57 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:31.361 23:04:57 -- target/invalid.sh@91 -- # nvmftestfini 00:12:31.361 23:04:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:31.361 23:04:57 -- nvmf/common.sh@116 -- # sync 00:12:31.361 23:04:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:31.361 23:04:57 -- nvmf/common.sh@119 -- # set +e 00:12:31.361 23:04:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:31.361 23:04:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:31.361 rmmod nvme_tcp 00:12:31.361 rmmod nvme_fabrics 00:12:31.361 rmmod nvme_keyring 00:12:31.361 23:04:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:31.361 23:04:57 -- nvmf/common.sh@123 -- # set -e 00:12:31.361 23:04:57 -- nvmf/common.sh@124 -- # return 0 00:12:31.361 23:04:57 -- nvmf/common.sh@477 -- # '[' -n 156143 ']' 00:12:31.361 23:04:57 -- nvmf/common.sh@478 -- # killprocess 156143 00:12:31.361 23:04:57 -- common/autotest_common.sh@936 -- # '[' -z 156143 ']' 00:12:31.361 23:04:57 -- common/autotest_common.sh@940 -- # kill -0 156143 00:12:31.361 23:04:57 -- common/autotest_common.sh@941 -- # uname 00:12:31.361 23:04:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:31.361 23:04:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 156143 00:12:31.361 23:04:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:31.361 23:04:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:31.361 23:04:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 156143' 00:12:31.361 killing process with pid 156143 00:12:31.361 23:04:57 -- common/autotest_common.sh@955 -- # kill 156143 00:12:31.361 23:04:57 -- common/autotest_common.sh@960 -- # wait 156143 00:12:31.619 23:04:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:31.619 23:04:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:31.619 23:04:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:31.619 23:04:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:31.619 23:04:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:31.619 23:04:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:31.619 23:04:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:31.619 23:04:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:34.172 23:05:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:34.172 00:12:34.172 real 0m9.667s 00:12:34.172 user 0m23.542s 00:12:34.172 sys 0m2.453s 00:12:34.172 23:05:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:34.172 23:05:00 -- common/autotest_common.sh@10 -- # set +x 00:12:34.172 ************************************ 00:12:34.172 END TEST nvmf_invalid 00:12:34.172 ************************************ 00:12:34.172 23:05:00 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:34.172 23:05:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:34.172 23:05:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:34.172 23:05:00 -- common/autotest_common.sh@10 -- # set +x 00:12:34.172 ************************************ 00:12:34.172 START TEST nvmf_abort 00:12:34.172 ************************************ 00:12:34.172 23:05:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:34.172 * Looking for test storage... 00:12:34.172 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:34.172 23:05:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:34.172 23:05:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:34.172 23:05:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:34.172 23:05:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:34.172 23:05:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:34.172 23:05:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:34.172 23:05:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:34.172 23:05:00 -- scripts/common.sh@335 -- # IFS=.-: 00:12:34.172 23:05:00 -- scripts/common.sh@335 -- # read -ra ver1 00:12:34.172 23:05:00 -- scripts/common.sh@336 -- # IFS=.-: 00:12:34.172 23:05:00 -- scripts/common.sh@336 -- # read -ra ver2 00:12:34.172 23:05:00 -- scripts/common.sh@337 -- # local 'op=<' 00:12:34.172 23:05:00 -- scripts/common.sh@339 -- # ver1_l=2 00:12:34.172 23:05:00 -- scripts/common.sh@340 -- # ver2_l=1 00:12:34.172 23:05:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:34.172 23:05:00 -- scripts/common.sh@343 -- # case "$op" in 00:12:34.172 23:05:00 -- scripts/common.sh@344 -- # : 1 00:12:34.172 23:05:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:34.172 23:05:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:34.172 23:05:00 -- scripts/common.sh@364 -- # decimal 1 00:12:34.172 23:05:00 -- scripts/common.sh@352 -- # local d=1 00:12:34.172 23:05:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:34.172 23:05:00 -- scripts/common.sh@354 -- # echo 1 00:12:34.172 23:05:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:34.172 23:05:00 -- scripts/common.sh@365 -- # decimal 2 00:12:34.172 23:05:00 -- scripts/common.sh@352 -- # local d=2 00:12:34.172 23:05:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:34.172 23:05:00 -- scripts/common.sh@354 -- # echo 2 00:12:34.172 23:05:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:34.172 23:05:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:34.172 23:05:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:34.172 23:05:00 -- scripts/common.sh@367 -- # return 0 00:12:34.172 23:05:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:34.172 23:05:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:34.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.172 --rc genhtml_branch_coverage=1 00:12:34.172 --rc genhtml_function_coverage=1 00:12:34.172 --rc genhtml_legend=1 00:12:34.172 --rc geninfo_all_blocks=1 00:12:34.172 --rc geninfo_unexecuted_blocks=1 00:12:34.172 00:12:34.172 ' 00:12:34.172 23:05:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:34.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.172 --rc genhtml_branch_coverage=1 00:12:34.173 --rc genhtml_function_coverage=1 00:12:34.173 --rc genhtml_legend=1 00:12:34.173 --rc geninfo_all_blocks=1 00:12:34.173 --rc geninfo_unexecuted_blocks=1 00:12:34.173 00:12:34.173 ' 00:12:34.173 23:05:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:34.173 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.173 --rc genhtml_branch_coverage=1 00:12:34.173 --rc genhtml_function_coverage=1 00:12:34.173 --rc genhtml_legend=1 00:12:34.173 --rc geninfo_all_blocks=1 00:12:34.173 --rc geninfo_unexecuted_blocks=1 00:12:34.173 00:12:34.173 ' 00:12:34.173 23:05:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:34.173 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.173 --rc genhtml_branch_coverage=1 00:12:34.173 --rc genhtml_function_coverage=1 00:12:34.173 --rc genhtml_legend=1 00:12:34.173 --rc geninfo_all_blocks=1 00:12:34.173 --rc geninfo_unexecuted_blocks=1 00:12:34.173 00:12:34.173 ' 00:12:34.173 23:05:00 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:34.173 23:05:00 -- nvmf/common.sh@7 -- # uname -s 00:12:34.173 23:05:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:34.173 23:05:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:34.173 23:05:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:34.173 23:05:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:34.173 23:05:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:34.173 23:05:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:34.173 23:05:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:34.173 23:05:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:34.173 23:05:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:34.173 23:05:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:34.173 23:05:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:34.173 23:05:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:34.173 23:05:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:34.173 23:05:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:34.173 23:05:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:34.173 23:05:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:34.173 23:05:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:34.173 23:05:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:34.173 23:05:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:34.173 23:05:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.173 23:05:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.173 23:05:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.173 23:05:00 -- paths/export.sh@5 -- # export PATH 00:12:34.173 23:05:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.173 23:05:00 -- nvmf/common.sh@46 -- # : 0 00:12:34.173 23:05:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:34.173 23:05:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:34.173 23:05:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:34.173 23:05:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:34.173 23:05:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:34.173 23:05:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:34.173 23:05:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:34.173 23:05:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:34.173 23:05:00 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:34.173 23:05:00 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:34.173 23:05:00 -- target/abort.sh@14 -- # nvmftestinit 00:12:34.173 23:05:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:34.173 23:05:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:34.173 23:05:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:34.173 23:05:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:34.173 23:05:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:34.173 23:05:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:34.173 23:05:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:34.173 23:05:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:34.173 23:05:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:34.173 23:05:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:34.173 23:05:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:34.173 23:05:00 -- common/autotest_common.sh@10 -- # set +x 00:12:36.075 23:05:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:36.075 23:05:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:36.075 23:05:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:36.075 23:05:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:36.075 23:05:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:36.075 23:05:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:36.075 23:05:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:36.075 23:05:02 -- nvmf/common.sh@294 -- # net_devs=() 00:12:36.075 23:05:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:36.075 23:05:02 -- nvmf/common.sh@295 -- # e810=() 00:12:36.075 23:05:02 -- nvmf/common.sh@295 -- # local -ga e810 00:12:36.075 23:05:02 -- nvmf/common.sh@296 -- # x722=() 00:12:36.075 23:05:02 -- nvmf/common.sh@296 -- # local -ga x722 00:12:36.075 23:05:02 -- nvmf/common.sh@297 -- # mlx=() 00:12:36.075 23:05:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:36.075 23:05:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:36.075 23:05:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:36.075 23:05:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:36.075 23:05:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:36.075 23:05:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:36.075 23:05:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:36.075 23:05:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:36.076 23:05:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:36.076 23:05:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:36.076 23:05:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:36.076 23:05:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:36.076 23:05:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:36.076 23:05:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:36.076 23:05:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:36.076 23:05:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:36.076 23:05:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:36.076 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:36.076 23:05:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:36.076 23:05:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:36.076 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:36.076 23:05:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:36.076 23:05:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:36.076 23:05:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:36.076 23:05:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:36.076 23:05:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:36.076 23:05:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:36.076 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:36.076 23:05:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:36.076 23:05:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:36.076 23:05:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:36.076 23:05:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:36.076 23:05:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:36.076 23:05:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:36.076 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:36.076 23:05:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:36.076 23:05:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:36.076 23:05:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:36.076 23:05:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:36.076 23:05:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:36.076 23:05:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:36.076 23:05:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:36.076 23:05:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:36.076 23:05:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:36.076 23:05:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:36.076 23:05:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:36.076 23:05:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:36.076 23:05:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:36.076 23:05:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:36.076 23:05:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:36.076 23:05:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:36.076 23:05:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:36.076 23:05:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:36.076 23:05:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:36.076 23:05:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:36.076 23:05:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:36.076 23:05:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:36.076 23:05:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:36.076 23:05:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:36.076 23:05:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:36.076 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:36.076 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:12:36.076 00:12:36.076 --- 10.0.0.2 ping statistics --- 00:12:36.076 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:36.076 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:12:36.076 23:05:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:36.336 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:36.336 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:12:36.336 00:12:36.336 --- 10.0.0.1 ping statistics --- 00:12:36.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:36.336 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:12:36.336 23:05:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:36.336 23:05:02 -- nvmf/common.sh@410 -- # return 0 00:12:36.336 23:05:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:36.336 23:05:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:36.336 23:05:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:36.336 23:05:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:36.336 23:05:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:36.336 23:05:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:36.336 23:05:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:36.336 23:05:02 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:36.336 23:05:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:36.336 23:05:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:36.336 23:05:02 -- common/autotest_common.sh@10 -- # set +x 00:12:36.336 23:05:02 -- nvmf/common.sh@469 -- # nvmfpid=158817 00:12:36.336 23:05:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:36.336 23:05:02 -- nvmf/common.sh@470 -- # waitforlisten 158817 00:12:36.336 23:05:02 -- common/autotest_common.sh@829 -- # '[' -z 158817 ']' 00:12:36.336 23:05:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:36.336 23:05:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:36.336 23:05:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:36.336 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:36.336 23:05:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:36.336 23:05:02 -- common/autotest_common.sh@10 -- # set +x 00:12:36.336 [2024-11-26 23:05:02.559117] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:36.336 [2024-11-26 23:05:02.559192] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:36.336 EAL: No free 2048 kB hugepages reported on node 1 00:12:36.336 [2024-11-26 23:05:02.624345] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:36.595 [2024-11-26 23:05:02.737593] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:36.595 [2024-11-26 23:05:02.737743] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:36.595 [2024-11-26 23:05:02.737761] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:36.595 [2024-11-26 23:05:02.737774] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:36.595 [2024-11-26 23:05:02.737880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:36.595 [2024-11-26 23:05:02.738004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:36.595 [2024-11-26 23:05:02.738008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:37.532 23:05:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:37.532 23:05:03 -- common/autotest_common.sh@862 -- # return 0 00:12:37.532 23:05:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:37.532 23:05:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:37.532 23:05:03 -- common/autotest_common.sh@10 -- # set +x 00:12:37.532 23:05:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:37.533 23:05:03 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:37.533 23:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.533 23:05:03 -- common/autotest_common.sh@10 -- # set +x 00:12:37.533 [2024-11-26 23:05:03.608096] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:37.533 23:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.533 23:05:03 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:37.533 23:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.533 23:05:03 -- common/autotest_common.sh@10 -- # set +x 00:12:37.533 Malloc0 00:12:37.533 23:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.533 23:05:03 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:37.533 23:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.533 23:05:03 -- common/autotest_common.sh@10 -- # set +x 00:12:37.533 Delay0 00:12:37.533 23:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.533 23:05:03 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:37.533 23:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.533 23:05:03 -- common/autotest_common.sh@10 -- # set +x 00:12:37.533 23:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.533 23:05:03 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:37.533 23:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.533 23:05:03 -- common/autotest_common.sh@10 -- # set +x 00:12:37.533 23:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.533 23:05:03 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:37.533 23:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.533 23:05:03 -- common/autotest_common.sh@10 -- # set +x 00:12:37.533 [2024-11-26 23:05:03.686759] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:37.533 23:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.533 23:05:03 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:37.533 23:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.533 23:05:03 -- common/autotest_common.sh@10 -- # set +x 00:12:37.533 23:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.533 23:05:03 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:37.533 EAL: No free 2048 kB hugepages reported on node 1 00:12:37.533 [2024-11-26 23:05:03.833671] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:40.072 Initializing NVMe Controllers 00:12:40.072 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:40.072 controller IO queue size 128 less than required 00:12:40.072 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:40.072 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:40.072 Initialization complete. Launching workers. 00:12:40.073 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 125, failed: 31244 00:12:40.073 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 31307, failed to submit 62 00:12:40.073 success 31244, unsuccess 63, failed 0 00:12:40.073 23:05:05 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:40.073 23:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.073 23:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:40.073 23:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.073 23:05:05 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:40.073 23:05:05 -- target/abort.sh@38 -- # nvmftestfini 00:12:40.073 23:05:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:40.073 23:05:05 -- nvmf/common.sh@116 -- # sync 00:12:40.073 23:05:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:40.073 23:05:05 -- nvmf/common.sh@119 -- # set +e 00:12:40.073 23:05:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:40.073 23:05:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:40.073 rmmod nvme_tcp 00:12:40.073 rmmod nvme_fabrics 00:12:40.073 rmmod nvme_keyring 00:12:40.073 23:05:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:40.073 23:05:05 -- nvmf/common.sh@123 -- # set -e 00:12:40.073 23:05:05 -- nvmf/common.sh@124 -- # return 0 00:12:40.073 23:05:05 -- nvmf/common.sh@477 -- # '[' -n 158817 ']' 00:12:40.073 23:05:05 -- nvmf/common.sh@478 -- # killprocess 158817 00:12:40.073 23:05:05 -- common/autotest_common.sh@936 -- # '[' -z 158817 ']' 00:12:40.073 23:05:05 -- common/autotest_common.sh@940 -- # kill -0 158817 00:12:40.073 23:05:05 -- common/autotest_common.sh@941 -- # uname 00:12:40.073 23:05:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:40.073 23:05:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 158817 00:12:40.073 23:05:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:40.073 23:05:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:40.073 23:05:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 158817' 00:12:40.073 killing process with pid 158817 00:12:40.073 23:05:05 -- common/autotest_common.sh@955 -- # kill 158817 00:12:40.073 23:05:05 -- common/autotest_common.sh@960 -- # wait 158817 00:12:40.073 23:05:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:40.073 23:05:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:40.073 23:05:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:40.073 23:05:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:40.073 23:05:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:40.073 23:05:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:40.073 23:05:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:40.073 23:05:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:41.977 23:05:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:41.977 00:12:41.977 real 0m8.244s 00:12:41.977 user 0m13.050s 00:12:41.977 sys 0m2.601s 00:12:41.977 23:05:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:41.977 23:05:08 -- common/autotest_common.sh@10 -- # set +x 00:12:41.977 ************************************ 00:12:41.977 END TEST nvmf_abort 00:12:41.977 ************************************ 00:12:41.977 23:05:08 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:41.977 23:05:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:41.977 23:05:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:41.977 23:05:08 -- common/autotest_common.sh@10 -- # set +x 00:12:41.977 ************************************ 00:12:41.977 START TEST nvmf_ns_hotplug_stress 00:12:41.977 ************************************ 00:12:41.977 23:05:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:42.236 * Looking for test storage... 00:12:42.236 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:42.236 23:05:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:42.236 23:05:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:42.236 23:05:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:42.236 23:05:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:42.236 23:05:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:42.236 23:05:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:42.236 23:05:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:42.236 23:05:08 -- scripts/common.sh@335 -- # IFS=.-: 00:12:42.236 23:05:08 -- scripts/common.sh@335 -- # read -ra ver1 00:12:42.236 23:05:08 -- scripts/common.sh@336 -- # IFS=.-: 00:12:42.236 23:05:08 -- scripts/common.sh@336 -- # read -ra ver2 00:12:42.236 23:05:08 -- scripts/common.sh@337 -- # local 'op=<' 00:12:42.236 23:05:08 -- scripts/common.sh@339 -- # ver1_l=2 00:12:42.236 23:05:08 -- scripts/common.sh@340 -- # ver2_l=1 00:12:42.236 23:05:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:42.236 23:05:08 -- scripts/common.sh@343 -- # case "$op" in 00:12:42.236 23:05:08 -- scripts/common.sh@344 -- # : 1 00:12:42.236 23:05:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:42.236 23:05:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:42.236 23:05:08 -- scripts/common.sh@364 -- # decimal 1 00:12:42.236 23:05:08 -- scripts/common.sh@352 -- # local d=1 00:12:42.236 23:05:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:42.236 23:05:08 -- scripts/common.sh@354 -- # echo 1 00:12:42.236 23:05:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:42.236 23:05:08 -- scripts/common.sh@365 -- # decimal 2 00:12:42.236 23:05:08 -- scripts/common.sh@352 -- # local d=2 00:12:42.236 23:05:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:42.236 23:05:08 -- scripts/common.sh@354 -- # echo 2 00:12:42.236 23:05:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:42.236 23:05:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:42.236 23:05:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:42.236 23:05:08 -- scripts/common.sh@367 -- # return 0 00:12:42.236 23:05:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:42.236 23:05:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:42.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:42.236 --rc genhtml_branch_coverage=1 00:12:42.236 --rc genhtml_function_coverage=1 00:12:42.236 --rc genhtml_legend=1 00:12:42.236 --rc geninfo_all_blocks=1 00:12:42.236 --rc geninfo_unexecuted_blocks=1 00:12:42.236 00:12:42.236 ' 00:12:42.236 23:05:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:42.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:42.236 --rc genhtml_branch_coverage=1 00:12:42.236 --rc genhtml_function_coverage=1 00:12:42.236 --rc genhtml_legend=1 00:12:42.236 --rc geninfo_all_blocks=1 00:12:42.236 --rc geninfo_unexecuted_blocks=1 00:12:42.236 00:12:42.236 ' 00:12:42.236 23:05:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:42.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:42.236 --rc genhtml_branch_coverage=1 00:12:42.236 --rc genhtml_function_coverage=1 00:12:42.236 --rc genhtml_legend=1 00:12:42.236 --rc geninfo_all_blocks=1 00:12:42.236 --rc geninfo_unexecuted_blocks=1 00:12:42.236 00:12:42.236 ' 00:12:42.236 23:05:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:42.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:42.236 --rc genhtml_branch_coverage=1 00:12:42.236 --rc genhtml_function_coverage=1 00:12:42.236 --rc genhtml_legend=1 00:12:42.236 --rc geninfo_all_blocks=1 00:12:42.236 --rc geninfo_unexecuted_blocks=1 00:12:42.236 00:12:42.236 ' 00:12:42.236 23:05:08 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:42.236 23:05:08 -- nvmf/common.sh@7 -- # uname -s 00:12:42.236 23:05:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:42.236 23:05:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:42.236 23:05:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:42.236 23:05:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:42.236 23:05:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:42.236 23:05:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:42.236 23:05:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:42.236 23:05:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:42.236 23:05:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:42.236 23:05:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:42.236 23:05:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:42.236 23:05:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:42.236 23:05:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:42.236 23:05:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:42.236 23:05:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:42.236 23:05:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:42.236 23:05:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:42.236 23:05:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:42.236 23:05:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:42.236 23:05:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:42.236 23:05:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:42.236 23:05:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:42.236 23:05:08 -- paths/export.sh@5 -- # export PATH 00:12:42.236 23:05:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:42.236 23:05:08 -- nvmf/common.sh@46 -- # : 0 00:12:42.236 23:05:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:42.236 23:05:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:42.236 23:05:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:42.236 23:05:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:42.236 23:05:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:42.236 23:05:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:42.236 23:05:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:42.236 23:05:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:42.236 23:05:08 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:42.236 23:05:08 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:42.236 23:05:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:42.236 23:05:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:42.237 23:05:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:42.237 23:05:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:42.237 23:05:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:42.237 23:05:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:42.237 23:05:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:42.237 23:05:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:42.237 23:05:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:42.237 23:05:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:42.237 23:05:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:42.237 23:05:08 -- common/autotest_common.sh@10 -- # set +x 00:12:44.145 23:05:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:44.145 23:05:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:44.145 23:05:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:44.145 23:05:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:44.145 23:05:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:44.145 23:05:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:44.145 23:05:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:44.145 23:05:10 -- nvmf/common.sh@294 -- # net_devs=() 00:12:44.145 23:05:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:44.145 23:05:10 -- nvmf/common.sh@295 -- # e810=() 00:12:44.145 23:05:10 -- nvmf/common.sh@295 -- # local -ga e810 00:12:44.145 23:05:10 -- nvmf/common.sh@296 -- # x722=() 00:12:44.145 23:05:10 -- nvmf/common.sh@296 -- # local -ga x722 00:12:44.145 23:05:10 -- nvmf/common.sh@297 -- # mlx=() 00:12:44.145 23:05:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:44.145 23:05:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:44.145 23:05:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:44.145 23:05:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:44.145 23:05:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:44.145 23:05:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:44.145 23:05:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:44.145 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:44.145 23:05:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:44.145 23:05:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:44.145 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:44.145 23:05:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:44.145 23:05:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:44.145 23:05:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:44.145 23:05:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:44.145 23:05:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:44.145 23:05:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:44.145 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:44.145 23:05:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:44.145 23:05:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:44.145 23:05:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:44.145 23:05:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:44.145 23:05:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:44.145 23:05:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:44.145 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:44.145 23:05:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:44.145 23:05:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:44.145 23:05:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:44.145 23:05:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:44.145 23:05:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:44.145 23:05:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:44.145 23:05:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:44.145 23:05:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:44.145 23:05:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:44.145 23:05:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:44.145 23:05:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:44.145 23:05:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:44.145 23:05:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:44.145 23:05:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:44.145 23:05:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:44.146 23:05:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:44.146 23:05:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:44.146 23:05:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:44.405 23:05:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:44.405 23:05:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:44.405 23:05:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:44.405 23:05:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:44.405 23:05:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:44.405 23:05:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:44.405 23:05:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:44.405 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:44.405 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:12:44.405 00:12:44.405 --- 10.0.0.2 ping statistics --- 00:12:44.405 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:44.405 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:12:44.405 23:05:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:44.405 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:44.405 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:12:44.405 00:12:44.405 --- 10.0.0.1 ping statistics --- 00:12:44.405 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:44.405 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:12:44.405 23:05:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:44.405 23:05:10 -- nvmf/common.sh@410 -- # return 0 00:12:44.405 23:05:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:44.405 23:05:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:44.405 23:05:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:44.405 23:05:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:44.405 23:05:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:44.405 23:05:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:44.405 23:05:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:44.405 23:05:10 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:44.405 23:05:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:44.405 23:05:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:44.405 23:05:10 -- common/autotest_common.sh@10 -- # set +x 00:12:44.405 23:05:10 -- nvmf/common.sh@469 -- # nvmfpid=161202 00:12:44.405 23:05:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:44.405 23:05:10 -- nvmf/common.sh@470 -- # waitforlisten 161202 00:12:44.405 23:05:10 -- common/autotest_common.sh@829 -- # '[' -z 161202 ']' 00:12:44.405 23:05:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:44.405 23:05:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:44.405 23:05:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:44.405 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:44.405 23:05:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:44.405 23:05:10 -- common/autotest_common.sh@10 -- # set +x 00:12:44.405 [2024-11-26 23:05:10.691570] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:44.405 [2024-11-26 23:05:10.691641] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:44.405 EAL: No free 2048 kB hugepages reported on node 1 00:12:44.405 [2024-11-26 23:05:10.761217] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:44.666 [2024-11-26 23:05:10.882758] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:44.666 [2024-11-26 23:05:10.882915] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:44.666 [2024-11-26 23:05:10.882931] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:44.666 [2024-11-26 23:05:10.882945] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:44.666 [2024-11-26 23:05:10.883009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:44.666 [2024-11-26 23:05:10.883033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:44.666 [2024-11-26 23:05:10.883036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:45.600 23:05:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:45.600 23:05:11 -- common/autotest_common.sh@862 -- # return 0 00:12:45.600 23:05:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:45.600 23:05:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:45.600 23:05:11 -- common/autotest_common.sh@10 -- # set +x 00:12:45.600 23:05:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:45.600 23:05:11 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:45.600 23:05:11 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:45.601 [2024-11-26 23:05:11.917378] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:45.601 23:05:11 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:45.858 23:05:12 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:46.115 [2024-11-26 23:05:12.424496] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:46.115 23:05:12 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:46.373 23:05:12 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:46.631 Malloc0 00:12:46.631 23:05:12 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:46.890 Delay0 00:12:46.890 23:05:13 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.148 23:05:13 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:47.406 NULL1 00:12:47.406 23:05:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:47.664 23:05:13 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=161648 00:12:47.664 23:05:13 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:47.664 23:05:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:47.664 23:05:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.664 EAL: No free 2048 kB hugepages reported on node 1 00:12:47.922 23:05:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.180 23:05:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:48.180 23:05:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:48.438 true 00:12:48.438 23:05:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:48.438 23:05:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.695 23:05:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.953 23:05:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:48.953 23:05:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:49.211 true 00:12:49.211 23:05:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:49.211 23:05:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.148 Read completed with error (sct=0, sc=11) 00:12:50.148 23:05:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.406 23:05:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:50.406 23:05:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:50.664 true 00:12:50.664 23:05:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:50.664 23:05:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.922 23:05:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.179 23:05:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:51.179 23:05:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:51.437 true 00:12:51.437 23:05:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:51.437 23:05:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.374 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.374 23:05:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.374 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.374 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.374 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.632 23:05:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:52.632 23:05:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:52.890 true 00:12:52.890 23:05:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:52.890 23:05:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.148 23:05:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.406 23:05:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:53.406 23:05:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:53.664 true 00:12:53.664 23:05:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:53.664 23:05:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:54.600 23:05:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:54.858 23:05:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:54.858 23:05:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:55.116 true 00:12:55.116 23:05:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:55.116 23:05:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.374 23:05:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.632 23:05:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:55.632 23:05:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:55.890 true 00:12:55.890 23:05:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:55.890 23:05:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.828 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.828 23:05:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.086 23:05:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:57.086 23:05:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:57.344 true 00:12:57.344 23:05:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:57.344 23:05:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.602 23:05:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.860 23:05:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:57.860 23:05:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:58.118 true 00:12:58.118 23:05:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:58.118 23:05:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.055 23:05:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.055 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:59.055 23:05:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:59.055 23:05:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:59.312 true 00:12:59.312 23:05:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:12:59.312 23:05:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.569 23:05:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.827 23:05:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:59.827 23:05:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:00.085 true 00:13:00.085 23:05:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:00.085 23:05:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.024 23:05:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.281 23:05:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:01.281 23:05:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:01.539 true 00:13:01.539 23:05:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:01.539 23:05:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.796 23:05:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.053 23:05:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:02.053 23:05:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:02.311 true 00:13:02.311 23:05:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:02.311 23:05:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.569 23:05:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.827 23:05:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:02.827 23:05:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:03.085 true 00:13:03.085 23:05:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:03.085 23:05:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.463 23:05:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.463 23:05:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:04.463 23:05:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:04.721 true 00:13:04.721 23:05:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:04.721 23:05:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.978 23:05:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.236 23:05:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:05.236 23:05:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:05.495 true 00:13:05.495 23:05:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:05.495 23:05:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.429 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:06.429 23:05:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.429 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:06.429 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:06.429 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:06.688 23:05:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:06.688 23:05:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:06.946 true 00:13:06.946 23:05:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:06.946 23:05:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.204 23:05:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.463 23:05:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:07.463 23:05:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:07.721 true 00:13:07.721 23:05:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:07.721 23:05:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.658 23:05:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.915 23:05:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:08.915 23:05:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:09.173 true 00:13:09.173 23:05:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:09.173 23:05:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.432 23:05:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.690 23:05:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:09.690 23:05:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:09.947 true 00:13:09.947 23:05:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:09.947 23:05:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.205 23:05:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.463 23:05:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:10.463 23:05:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:10.721 true 00:13:10.721 23:05:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:10.721 23:05:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.657 23:05:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.916 23:05:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:11.916 23:05:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:12.174 true 00:13:12.174 23:05:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:12.174 23:05:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.432 23:05:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.689 23:05:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:12.689 23:05:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:12.947 true 00:13:12.947 23:05:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:12.947 23:05:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.883 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:13.883 23:05:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:13.883 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.141 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.141 23:05:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:14.141 23:05:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:14.398 true 00:13:14.398 23:05:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:14.398 23:05:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.656 23:05:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.914 23:05:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:14.914 23:05:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:15.171 true 00:13:15.171 23:05:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:15.171 23:05:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.107 23:05:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:16.107 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:16.107 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:16.107 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:16.364 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:16.364 23:05:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:16.364 23:05:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:16.621 true 00:13:16.621 23:05:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:16.621 23:05:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.878 23:05:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.136 23:05:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:17.136 23:05:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:17.393 true 00:13:17.393 23:05:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:17.393 23:05:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.329 Initializing NVMe Controllers 00:13:18.329 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:18.329 Controller IO queue size 128, less than required. 00:13:18.329 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:18.329 Controller IO queue size 128, less than required. 00:13:18.329 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:18.329 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:18.329 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:18.329 Initialization complete. Launching workers. 00:13:18.329 ======================================================== 00:13:18.329 Latency(us) 00:13:18.329 Device Information : IOPS MiB/s Average min max 00:13:18.329 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 822.97 0.40 75486.16 2026.94 1043482.06 00:13:18.329 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10990.43 5.37 11612.64 1613.08 525005.42 00:13:18.329 ======================================================== 00:13:18.329 Total : 11813.40 5.77 16062.31 1613.08 1043482.06 00:13:18.329 00:13:18.329 23:05:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.587 23:05:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:18.587 23:05:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:18.845 true 00:13:18.845 23:05:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 161648 00:13:18.845 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (161648) - No such process 00:13:18.845 23:05:45 -- target/ns_hotplug_stress.sh@53 -- # wait 161648 00:13:18.845 23:05:45 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.103 23:05:45 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:19.362 23:05:45 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:19.362 23:05:45 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:19.362 23:05:45 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:19.362 23:05:45 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:19.362 23:05:45 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:19.620 null0 00:13:19.620 23:05:45 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:19.620 23:05:45 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:19.620 23:05:45 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:19.878 null1 00:13:19.878 23:05:46 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:19.878 23:05:46 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:19.878 23:05:46 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:20.136 null2 00:13:20.136 23:05:46 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.136 23:05:46 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.136 23:05:46 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:20.394 null3 00:13:20.394 23:05:46 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.394 23:05:46 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.394 23:05:46 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:20.652 null4 00:13:20.652 23:05:46 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.652 23:05:46 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.652 23:05:46 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:20.911 null5 00:13:20.911 23:05:47 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.911 23:05:47 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.911 23:05:47 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:21.169 null6 00:13:21.169 23:05:47 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.169 23:05:47 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.169 23:05:47 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:21.428 null7 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.428 23:05:47 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@66 -- # wait 165809 165810 165812 165814 165816 165818 165820 165822 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.429 23:05:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:21.687 23:05:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:21.687 23:05:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:21.687 23:05:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:21.687 23:05:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:21.687 23:05:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:21.687 23:05:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.687 23:05:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.687 23:05:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.945 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.203 23:05:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.203 23:05:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.203 23:05:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.203 23:05:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.203 23:05:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.203 23:05:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.203 23:05:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.203 23:05:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.461 23:05:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.720 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.720 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.720 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.720 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.720 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.720 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.720 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.720 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.978 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.236 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:23.236 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.236 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.493 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.493 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.493 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.493 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.493 23:05:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.750 23:05:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.007 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.007 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.007 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.007 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.007 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.007 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.007 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.007 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.265 23:05:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.523 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.523 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.523 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.523 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.523 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.524 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.524 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.524 23:05:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.782 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:25.040 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.040 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:25.040 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.040 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.040 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:25.040 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.040 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.040 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.299 23:05:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:25.557 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.557 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.557 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.557 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:25.557 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:25.557 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.557 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.557 23:05:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.815 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:26.073 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.073 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:26.073 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:26.073 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.073 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:26.073 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:26.073 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.073 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.331 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.590 23:05:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:26.848 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:26.848 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.848 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.848 23:05:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:26.848 23:05:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:26.848 23:05:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:26.848 23:05:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.848 23:05:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:27.106 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:27.107 23:05:53 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:27.107 23:05:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:27.107 23:05:53 -- nvmf/common.sh@116 -- # sync 00:13:27.107 23:05:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:27.107 23:05:53 -- nvmf/common.sh@119 -- # set +e 00:13:27.107 23:05:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:27.107 23:05:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:27.107 rmmod nvme_tcp 00:13:27.107 rmmod nvme_fabrics 00:13:27.107 rmmod nvme_keyring 00:13:27.107 23:05:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:27.107 23:05:53 -- nvmf/common.sh@123 -- # set -e 00:13:27.107 23:05:53 -- nvmf/common.sh@124 -- # return 0 00:13:27.107 23:05:53 -- nvmf/common.sh@477 -- # '[' -n 161202 ']' 00:13:27.107 23:05:53 -- nvmf/common.sh@478 -- # killprocess 161202 00:13:27.107 23:05:53 -- common/autotest_common.sh@936 -- # '[' -z 161202 ']' 00:13:27.107 23:05:53 -- common/autotest_common.sh@940 -- # kill -0 161202 00:13:27.107 23:05:53 -- common/autotest_common.sh@941 -- # uname 00:13:27.107 23:05:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:27.107 23:05:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 161202 00:13:27.107 23:05:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:27.107 23:05:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:27.107 23:05:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 161202' 00:13:27.107 killing process with pid 161202 00:13:27.107 23:05:53 -- common/autotest_common.sh@955 -- # kill 161202 00:13:27.107 23:05:53 -- common/autotest_common.sh@960 -- # wait 161202 00:13:27.366 23:05:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:27.366 23:05:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:27.366 23:05:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:27.366 23:05:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:27.366 23:05:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:27.366 23:05:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.367 23:05:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:27.367 23:05:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:29.902 23:05:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:29.902 00:13:29.902 real 0m47.368s 00:13:29.902 user 3m37.422s 00:13:29.902 sys 0m14.892s 00:13:29.902 23:05:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:29.902 23:05:55 -- common/autotest_common.sh@10 -- # set +x 00:13:29.902 ************************************ 00:13:29.902 END TEST nvmf_ns_hotplug_stress 00:13:29.902 ************************************ 00:13:29.902 23:05:55 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:29.902 23:05:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:29.902 23:05:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:29.902 23:05:55 -- common/autotest_common.sh@10 -- # set +x 00:13:29.902 ************************************ 00:13:29.902 START TEST nvmf_connect_stress 00:13:29.902 ************************************ 00:13:29.902 23:05:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:29.902 * Looking for test storage... 00:13:29.902 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:29.902 23:05:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:29.902 23:05:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:29.902 23:05:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:29.902 23:05:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:29.902 23:05:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:29.902 23:05:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:29.902 23:05:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:29.902 23:05:55 -- scripts/common.sh@335 -- # IFS=.-: 00:13:29.902 23:05:55 -- scripts/common.sh@335 -- # read -ra ver1 00:13:29.902 23:05:55 -- scripts/common.sh@336 -- # IFS=.-: 00:13:29.902 23:05:55 -- scripts/common.sh@336 -- # read -ra ver2 00:13:29.902 23:05:55 -- scripts/common.sh@337 -- # local 'op=<' 00:13:29.902 23:05:55 -- scripts/common.sh@339 -- # ver1_l=2 00:13:29.902 23:05:55 -- scripts/common.sh@340 -- # ver2_l=1 00:13:29.902 23:05:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:29.902 23:05:55 -- scripts/common.sh@343 -- # case "$op" in 00:13:29.902 23:05:55 -- scripts/common.sh@344 -- # : 1 00:13:29.902 23:05:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:29.902 23:05:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:29.903 23:05:55 -- scripts/common.sh@364 -- # decimal 1 00:13:29.903 23:05:55 -- scripts/common.sh@352 -- # local d=1 00:13:29.903 23:05:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:29.903 23:05:55 -- scripts/common.sh@354 -- # echo 1 00:13:29.903 23:05:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:29.903 23:05:55 -- scripts/common.sh@365 -- # decimal 2 00:13:29.903 23:05:55 -- scripts/common.sh@352 -- # local d=2 00:13:29.903 23:05:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:29.903 23:05:55 -- scripts/common.sh@354 -- # echo 2 00:13:29.903 23:05:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:29.903 23:05:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:29.903 23:05:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:29.903 23:05:55 -- scripts/common.sh@367 -- # return 0 00:13:29.903 23:05:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:29.903 23:05:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:29.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.903 --rc genhtml_branch_coverage=1 00:13:29.903 --rc genhtml_function_coverage=1 00:13:29.903 --rc genhtml_legend=1 00:13:29.903 --rc geninfo_all_blocks=1 00:13:29.903 --rc geninfo_unexecuted_blocks=1 00:13:29.903 00:13:29.903 ' 00:13:29.903 23:05:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:29.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.903 --rc genhtml_branch_coverage=1 00:13:29.903 --rc genhtml_function_coverage=1 00:13:29.903 --rc genhtml_legend=1 00:13:29.903 --rc geninfo_all_blocks=1 00:13:29.903 --rc geninfo_unexecuted_blocks=1 00:13:29.903 00:13:29.903 ' 00:13:29.903 23:05:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:29.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.903 --rc genhtml_branch_coverage=1 00:13:29.903 --rc genhtml_function_coverage=1 00:13:29.903 --rc genhtml_legend=1 00:13:29.903 --rc geninfo_all_blocks=1 00:13:29.903 --rc geninfo_unexecuted_blocks=1 00:13:29.903 00:13:29.903 ' 00:13:29.903 23:05:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:29.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.903 --rc genhtml_branch_coverage=1 00:13:29.903 --rc genhtml_function_coverage=1 00:13:29.903 --rc genhtml_legend=1 00:13:29.903 --rc geninfo_all_blocks=1 00:13:29.903 --rc geninfo_unexecuted_blocks=1 00:13:29.903 00:13:29.903 ' 00:13:29.903 23:05:55 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:29.903 23:05:55 -- nvmf/common.sh@7 -- # uname -s 00:13:29.903 23:05:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:29.903 23:05:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:29.903 23:05:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:29.903 23:05:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:29.903 23:05:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:29.903 23:05:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:29.903 23:05:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:29.903 23:05:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:29.903 23:05:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:29.903 23:05:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:29.903 23:05:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:29.903 23:05:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:29.903 23:05:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:29.903 23:05:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:29.903 23:05:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:29.903 23:05:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:29.903 23:05:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:29.903 23:05:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:29.903 23:05:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:29.903 23:05:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.903 23:05:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.903 23:05:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.903 23:05:55 -- paths/export.sh@5 -- # export PATH 00:13:29.903 23:05:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.903 23:05:55 -- nvmf/common.sh@46 -- # : 0 00:13:29.903 23:05:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:29.903 23:05:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:29.903 23:05:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:29.903 23:05:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:29.903 23:05:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:29.903 23:05:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:29.903 23:05:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:29.903 23:05:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:29.903 23:05:55 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:29.903 23:05:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:29.903 23:05:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:29.903 23:05:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:29.903 23:05:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:29.903 23:05:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:29.903 23:05:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.903 23:05:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.903 23:05:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:29.903 23:05:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:29.903 23:05:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:29.903 23:05:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:29.903 23:05:55 -- common/autotest_common.sh@10 -- # set +x 00:13:31.808 23:05:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:31.808 23:05:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:31.808 23:05:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:31.808 23:05:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:31.808 23:05:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:31.808 23:05:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:31.808 23:05:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:31.808 23:05:57 -- nvmf/common.sh@294 -- # net_devs=() 00:13:31.808 23:05:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:31.808 23:05:57 -- nvmf/common.sh@295 -- # e810=() 00:13:31.808 23:05:57 -- nvmf/common.sh@295 -- # local -ga e810 00:13:31.808 23:05:57 -- nvmf/common.sh@296 -- # x722=() 00:13:31.808 23:05:57 -- nvmf/common.sh@296 -- # local -ga x722 00:13:31.808 23:05:57 -- nvmf/common.sh@297 -- # mlx=() 00:13:31.808 23:05:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:31.808 23:05:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:31.808 23:05:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:31.808 23:05:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:31.808 23:05:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:31.808 23:05:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:31.808 23:05:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:31.808 23:05:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:31.808 23:05:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:31.808 23:05:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:31.808 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:31.809 23:05:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:31.809 23:05:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:31.809 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:31.809 23:05:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:31.809 23:05:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:31.809 23:05:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:31.809 23:05:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:31.809 23:05:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:31.809 23:05:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:31.809 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:31.809 23:05:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:31.809 23:05:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:31.809 23:05:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:31.809 23:05:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:31.809 23:05:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:31.809 23:05:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:31.809 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:31.809 23:05:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:31.809 23:05:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:31.809 23:05:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:31.809 23:05:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:31.809 23:05:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:31.809 23:05:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:31.809 23:05:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:31.809 23:05:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:31.809 23:05:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:31.809 23:05:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:31.809 23:05:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:31.809 23:05:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:31.809 23:05:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:31.809 23:05:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:31.809 23:05:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:31.809 23:05:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:31.809 23:05:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:31.809 23:05:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:31.809 23:05:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:31.809 23:05:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:31.809 23:05:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:31.809 23:05:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:31.809 23:05:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:31.809 23:05:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:31.809 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:31.809 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:13:31.809 00:13:31.809 --- 10.0.0.2 ping statistics --- 00:13:31.809 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:31.809 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:13:31.809 23:05:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:31.809 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:31.809 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:13:31.809 00:13:31.809 --- 10.0.0.1 ping statistics --- 00:13:31.809 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:31.809 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:13:31.809 23:05:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:31.809 23:05:57 -- nvmf/common.sh@410 -- # return 0 00:13:31.809 23:05:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:31.809 23:05:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:31.809 23:05:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:31.809 23:05:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:31.809 23:05:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:31.809 23:05:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:31.809 23:05:57 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:31.809 23:05:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:31.809 23:05:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:31.809 23:05:57 -- common/autotest_common.sh@10 -- # set +x 00:13:31.809 23:05:57 -- nvmf/common.sh@469 -- # nvmfpid=168665 00:13:31.809 23:05:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:31.809 23:05:57 -- nvmf/common.sh@470 -- # waitforlisten 168665 00:13:31.809 23:05:57 -- common/autotest_common.sh@829 -- # '[' -z 168665 ']' 00:13:31.809 23:05:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:31.809 23:05:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:31.809 23:05:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:31.809 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:31.809 23:05:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:31.809 23:05:57 -- common/autotest_common.sh@10 -- # set +x 00:13:31.809 [2024-11-26 23:05:57.923481] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:31.809 [2024-11-26 23:05:57.923605] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:31.809 EAL: No free 2048 kB hugepages reported on node 1 00:13:31.809 [2024-11-26 23:05:57.990421] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:31.809 [2024-11-26 23:05:58.101020] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:31.809 [2024-11-26 23:05:58.101202] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:31.809 [2024-11-26 23:05:58.101220] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:31.809 [2024-11-26 23:05:58.101233] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:31.809 [2024-11-26 23:05:58.101319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:31.809 [2024-11-26 23:05:58.101446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:31.809 [2024-11-26 23:05:58.101449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:32.748 23:05:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:32.748 23:05:58 -- common/autotest_common.sh@862 -- # return 0 00:13:32.748 23:05:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:32.748 23:05:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:32.748 23:05:58 -- common/autotest_common.sh@10 -- # set +x 00:13:32.748 23:05:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:32.748 23:05:58 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:32.748 23:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.748 23:05:58 -- common/autotest_common.sh@10 -- # set +x 00:13:32.748 [2024-11-26 23:05:58.924914] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:32.748 23:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.748 23:05:58 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:32.748 23:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.748 23:05:58 -- common/autotest_common.sh@10 -- # set +x 00:13:32.748 23:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.748 23:05:58 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.748 23:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.748 23:05:58 -- common/autotest_common.sh@10 -- # set +x 00:13:32.748 [2024-11-26 23:05:58.954693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.748 23:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.748 23:05:58 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:32.748 23:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.748 23:05:58 -- common/autotest_common.sh@10 -- # set +x 00:13:32.748 NULL1 00:13:32.748 23:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.748 23:05:58 -- target/connect_stress.sh@21 -- # PERF_PID=168783 00:13:32.748 23:05:58 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:32.748 23:05:58 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:32.748 23:05:58 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:58 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:58 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:59 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:59 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:59 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:59 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:59 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:32.748 23:05:59 -- target/connect_stress.sh@28 -- # cat 00:13:32.748 23:05:59 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:32.748 23:05:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.748 23:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.748 23:05:59 -- common/autotest_common.sh@10 -- # set +x 00:13:33.006 23:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.006 23:05:59 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:33.006 23:05:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.006 23:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.006 23:05:59 -- common/autotest_common.sh@10 -- # set +x 00:13:33.265 23:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.265 23:05:59 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:33.265 23:05:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.265 23:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.525 23:05:59 -- common/autotest_common.sh@10 -- # set +x 00:13:33.783 23:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.783 23:05:59 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:33.783 23:05:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.783 23:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.783 23:05:59 -- common/autotest_common.sh@10 -- # set +x 00:13:34.040 23:06:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.040 23:06:00 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:34.040 23:06:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.040 23:06:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.040 23:06:00 -- common/autotest_common.sh@10 -- # set +x 00:13:34.297 23:06:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.297 23:06:00 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:34.297 23:06:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.297 23:06:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.297 23:06:00 -- common/autotest_common.sh@10 -- # set +x 00:13:34.555 23:06:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.555 23:06:00 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:34.555 23:06:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.555 23:06:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.555 23:06:00 -- common/autotest_common.sh@10 -- # set +x 00:13:35.119 23:06:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.119 23:06:01 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:35.119 23:06:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.119 23:06:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.119 23:06:01 -- common/autotest_common.sh@10 -- # set +x 00:13:35.377 23:06:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.377 23:06:01 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:35.377 23:06:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.377 23:06:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.377 23:06:01 -- common/autotest_common.sh@10 -- # set +x 00:13:35.635 23:06:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.635 23:06:01 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:35.635 23:06:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.635 23:06:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.635 23:06:01 -- common/autotest_common.sh@10 -- # set +x 00:13:35.895 23:06:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.895 23:06:02 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:35.895 23:06:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.895 23:06:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.895 23:06:02 -- common/autotest_common.sh@10 -- # set +x 00:13:36.466 23:06:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.466 23:06:02 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:36.466 23:06:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.466 23:06:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.466 23:06:02 -- common/autotest_common.sh@10 -- # set +x 00:13:36.725 23:06:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.725 23:06:02 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:36.725 23:06:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.725 23:06:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.725 23:06:02 -- common/autotest_common.sh@10 -- # set +x 00:13:36.983 23:06:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.983 23:06:03 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:36.983 23:06:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.983 23:06:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.983 23:06:03 -- common/autotest_common.sh@10 -- # set +x 00:13:37.243 23:06:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.243 23:06:03 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:37.243 23:06:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.243 23:06:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.243 23:06:03 -- common/autotest_common.sh@10 -- # set +x 00:13:37.503 23:06:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.503 23:06:03 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:37.503 23:06:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.503 23:06:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.503 23:06:03 -- common/autotest_common.sh@10 -- # set +x 00:13:38.072 23:06:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.072 23:06:04 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:38.072 23:06:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.072 23:06:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.072 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:13:38.330 23:06:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.330 23:06:04 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:38.330 23:06:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.330 23:06:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.330 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:13:38.588 23:06:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.588 23:06:04 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:38.588 23:06:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.588 23:06:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.588 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:13:38.848 23:06:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.848 23:06:05 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:38.848 23:06:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.848 23:06:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.848 23:06:05 -- common/autotest_common.sh@10 -- # set +x 00:13:39.107 23:06:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.107 23:06:05 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:39.107 23:06:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.107 23:06:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.107 23:06:05 -- common/autotest_common.sh@10 -- # set +x 00:13:39.674 23:06:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.674 23:06:05 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:39.674 23:06:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.674 23:06:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.674 23:06:05 -- common/autotest_common.sh@10 -- # set +x 00:13:39.934 23:06:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.934 23:06:06 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:39.934 23:06:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.934 23:06:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.934 23:06:06 -- common/autotest_common.sh@10 -- # set +x 00:13:40.203 23:06:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.203 23:06:06 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:40.203 23:06:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.203 23:06:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.203 23:06:06 -- common/autotest_common.sh@10 -- # set +x 00:13:40.469 23:06:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.469 23:06:06 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:40.469 23:06:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.469 23:06:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.469 23:06:06 -- common/autotest_common.sh@10 -- # set +x 00:13:40.730 23:06:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.730 23:06:07 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:40.730 23:06:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.730 23:06:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.730 23:06:07 -- common/autotest_common.sh@10 -- # set +x 00:13:40.995 23:06:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.995 23:06:07 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:40.995 23:06:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.995 23:06:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.995 23:06:07 -- common/autotest_common.sh@10 -- # set +x 00:13:41.619 23:06:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.620 23:06:07 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:41.620 23:06:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.620 23:06:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.620 23:06:07 -- common/autotest_common.sh@10 -- # set +x 00:13:41.890 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.890 23:06:08 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:41.890 23:06:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.890 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.890 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:13:42.158 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.158 23:06:08 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:42.158 23:06:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.158 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.158 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:13:42.431 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.431 23:06:08 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:42.431 23:06:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.431 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.431 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:13:42.724 23:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.724 23:06:08 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:42.724 23:06:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.724 23:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.724 23:06:08 -- common/autotest_common.sh@10 -- # set +x 00:13:42.724 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:43.014 23:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.014 23:06:09 -- target/connect_stress.sh@34 -- # kill -0 168783 00:13:43.014 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (168783) - No such process 00:13:43.014 23:06:09 -- target/connect_stress.sh@38 -- # wait 168783 00:13:43.014 23:06:09 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:43.014 23:06:09 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:43.014 23:06:09 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:43.014 23:06:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:43.014 23:06:09 -- nvmf/common.sh@116 -- # sync 00:13:43.014 23:06:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:43.014 23:06:09 -- nvmf/common.sh@119 -- # set +e 00:13:43.014 23:06:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:43.014 23:06:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:43.014 rmmod nvme_tcp 00:13:43.014 rmmod nvme_fabrics 00:13:43.014 rmmod nvme_keyring 00:13:43.014 23:06:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:43.014 23:06:09 -- nvmf/common.sh@123 -- # set -e 00:13:43.014 23:06:09 -- nvmf/common.sh@124 -- # return 0 00:13:43.014 23:06:09 -- nvmf/common.sh@477 -- # '[' -n 168665 ']' 00:13:43.014 23:06:09 -- nvmf/common.sh@478 -- # killprocess 168665 00:13:43.014 23:06:09 -- common/autotest_common.sh@936 -- # '[' -z 168665 ']' 00:13:43.014 23:06:09 -- common/autotest_common.sh@940 -- # kill -0 168665 00:13:43.014 23:06:09 -- common/autotest_common.sh@941 -- # uname 00:13:43.014 23:06:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:43.014 23:06:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 168665 00:13:43.296 23:06:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:43.296 23:06:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:43.296 23:06:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 168665' 00:13:43.296 killing process with pid 168665 00:13:43.296 23:06:09 -- common/autotest_common.sh@955 -- # kill 168665 00:13:43.296 23:06:09 -- common/autotest_common.sh@960 -- # wait 168665 00:13:43.296 23:06:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:43.296 23:06:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:43.296 23:06:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:43.296 23:06:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:43.296 23:06:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:43.296 23:06:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.296 23:06:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.296 23:06:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:45.351 23:06:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:45.351 00:13:45.351 real 0m15.973s 00:13:45.351 user 0m42.358s 00:13:45.351 sys 0m4.358s 00:13:45.351 23:06:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:45.351 23:06:11 -- common/autotest_common.sh@10 -- # set +x 00:13:45.351 ************************************ 00:13:45.351 END TEST nvmf_connect_stress 00:13:45.351 ************************************ 00:13:45.351 23:06:11 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:45.351 23:06:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:45.351 23:06:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:45.351 23:06:11 -- common/autotest_common.sh@10 -- # set +x 00:13:45.351 ************************************ 00:13:45.351 START TEST nvmf_fused_ordering 00:13:45.351 ************************************ 00:13:45.351 23:06:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:45.622 * Looking for test storage... 00:13:45.622 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:45.622 23:06:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:45.622 23:06:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:45.622 23:06:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:45.622 23:06:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:45.622 23:06:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:45.622 23:06:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:45.622 23:06:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:45.622 23:06:11 -- scripts/common.sh@335 -- # IFS=.-: 00:13:45.622 23:06:11 -- scripts/common.sh@335 -- # read -ra ver1 00:13:45.622 23:06:11 -- scripts/common.sh@336 -- # IFS=.-: 00:13:45.622 23:06:11 -- scripts/common.sh@336 -- # read -ra ver2 00:13:45.622 23:06:11 -- scripts/common.sh@337 -- # local 'op=<' 00:13:45.622 23:06:11 -- scripts/common.sh@339 -- # ver1_l=2 00:13:45.622 23:06:11 -- scripts/common.sh@340 -- # ver2_l=1 00:13:45.622 23:06:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:45.622 23:06:11 -- scripts/common.sh@343 -- # case "$op" in 00:13:45.622 23:06:11 -- scripts/common.sh@344 -- # : 1 00:13:45.622 23:06:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:45.622 23:06:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:45.622 23:06:11 -- scripts/common.sh@364 -- # decimal 1 00:13:45.622 23:06:11 -- scripts/common.sh@352 -- # local d=1 00:13:45.622 23:06:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:45.622 23:06:11 -- scripts/common.sh@354 -- # echo 1 00:13:45.622 23:06:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:45.622 23:06:11 -- scripts/common.sh@365 -- # decimal 2 00:13:45.622 23:06:11 -- scripts/common.sh@352 -- # local d=2 00:13:45.622 23:06:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:45.622 23:06:11 -- scripts/common.sh@354 -- # echo 2 00:13:45.622 23:06:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:45.622 23:06:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:45.622 23:06:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:45.622 23:06:11 -- scripts/common.sh@367 -- # return 0 00:13:45.622 23:06:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:45.622 23:06:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:45.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.622 --rc genhtml_branch_coverage=1 00:13:45.622 --rc genhtml_function_coverage=1 00:13:45.622 --rc genhtml_legend=1 00:13:45.622 --rc geninfo_all_blocks=1 00:13:45.622 --rc geninfo_unexecuted_blocks=1 00:13:45.622 00:13:45.622 ' 00:13:45.622 23:06:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:45.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.622 --rc genhtml_branch_coverage=1 00:13:45.622 --rc genhtml_function_coverage=1 00:13:45.622 --rc genhtml_legend=1 00:13:45.622 --rc geninfo_all_blocks=1 00:13:45.622 --rc geninfo_unexecuted_blocks=1 00:13:45.622 00:13:45.622 ' 00:13:45.622 23:06:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:45.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.622 --rc genhtml_branch_coverage=1 00:13:45.622 --rc genhtml_function_coverage=1 00:13:45.622 --rc genhtml_legend=1 00:13:45.622 --rc geninfo_all_blocks=1 00:13:45.622 --rc geninfo_unexecuted_blocks=1 00:13:45.622 00:13:45.622 ' 00:13:45.622 23:06:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:45.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.622 --rc genhtml_branch_coverage=1 00:13:45.622 --rc genhtml_function_coverage=1 00:13:45.622 --rc genhtml_legend=1 00:13:45.622 --rc geninfo_all_blocks=1 00:13:45.622 --rc geninfo_unexecuted_blocks=1 00:13:45.622 00:13:45.622 ' 00:13:45.622 23:06:11 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:45.622 23:06:11 -- nvmf/common.sh@7 -- # uname -s 00:13:45.622 23:06:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:45.622 23:06:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:45.622 23:06:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:45.622 23:06:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:45.622 23:06:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:45.622 23:06:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:45.622 23:06:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:45.622 23:06:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:45.622 23:06:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:45.622 23:06:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:45.622 23:06:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:45.622 23:06:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:45.622 23:06:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:45.622 23:06:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:45.622 23:06:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:45.622 23:06:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:45.622 23:06:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:45.622 23:06:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:45.622 23:06:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:45.623 23:06:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.623 23:06:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.623 23:06:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.623 23:06:11 -- paths/export.sh@5 -- # export PATH 00:13:45.623 23:06:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.623 23:06:11 -- nvmf/common.sh@46 -- # : 0 00:13:45.623 23:06:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:45.623 23:06:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:45.623 23:06:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:45.623 23:06:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:45.623 23:06:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:45.623 23:06:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:45.623 23:06:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:45.623 23:06:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:45.623 23:06:11 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:45.623 23:06:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:45.623 23:06:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:45.623 23:06:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:45.623 23:06:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:45.623 23:06:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:45.623 23:06:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:45.623 23:06:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:45.623 23:06:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:45.623 23:06:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:45.623 23:06:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:45.623 23:06:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:45.623 23:06:11 -- common/autotest_common.sh@10 -- # set +x 00:13:47.611 23:06:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:47.611 23:06:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:47.611 23:06:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:47.611 23:06:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:47.611 23:06:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:47.611 23:06:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:47.611 23:06:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:47.611 23:06:13 -- nvmf/common.sh@294 -- # net_devs=() 00:13:47.611 23:06:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:47.611 23:06:13 -- nvmf/common.sh@295 -- # e810=() 00:13:47.611 23:06:13 -- nvmf/common.sh@295 -- # local -ga e810 00:13:47.611 23:06:13 -- nvmf/common.sh@296 -- # x722=() 00:13:47.611 23:06:13 -- nvmf/common.sh@296 -- # local -ga x722 00:13:47.611 23:06:13 -- nvmf/common.sh@297 -- # mlx=() 00:13:47.611 23:06:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:47.611 23:06:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:47.611 23:06:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:47.611 23:06:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:47.611 23:06:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:47.611 23:06:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:47.611 23:06:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:47.611 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:47.611 23:06:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:47.611 23:06:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:47.611 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:47.611 23:06:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:47.611 23:06:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:47.611 23:06:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:47.611 23:06:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:47.611 23:06:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:47.611 23:06:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:47.611 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:47.611 23:06:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:47.611 23:06:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:47.611 23:06:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:47.611 23:06:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:47.611 23:06:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:47.611 23:06:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:47.611 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:47.611 23:06:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:47.611 23:06:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:47.611 23:06:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:47.611 23:06:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:47.611 23:06:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:47.611 23:06:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:47.611 23:06:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:47.611 23:06:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:47.611 23:06:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:47.611 23:06:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:47.612 23:06:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:47.612 23:06:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:47.612 23:06:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:47.612 23:06:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:47.612 23:06:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:47.612 23:06:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:47.612 23:06:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:47.612 23:06:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:47.612 23:06:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:47.612 23:06:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:47.612 23:06:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:47.612 23:06:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:47.612 23:06:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:47.910 23:06:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:47.910 23:06:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:47.910 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:47.910 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:13:47.910 00:13:47.910 --- 10.0.0.2 ping statistics --- 00:13:47.910 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:47.910 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:13:47.910 23:06:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:47.910 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:47.910 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:13:47.910 00:13:47.910 --- 10.0.0.1 ping statistics --- 00:13:47.910 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:47.910 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:13:47.910 23:06:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:47.910 23:06:13 -- nvmf/common.sh@410 -- # return 0 00:13:47.910 23:06:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:47.910 23:06:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:47.910 23:06:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:47.910 23:06:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:47.910 23:06:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:47.910 23:06:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:47.910 23:06:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:47.910 23:06:14 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:47.910 23:06:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:47.910 23:06:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:47.910 23:06:14 -- common/autotest_common.sh@10 -- # set +x 00:13:47.910 23:06:14 -- nvmf/common.sh@469 -- # nvmfpid=172728 00:13:47.910 23:06:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:47.910 23:06:14 -- nvmf/common.sh@470 -- # waitforlisten 172728 00:13:47.910 23:06:14 -- common/autotest_common.sh@829 -- # '[' -z 172728 ']' 00:13:47.910 23:06:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:47.910 23:06:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:47.910 23:06:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:47.910 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:47.910 23:06:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:47.910 23:06:14 -- common/autotest_common.sh@10 -- # set +x 00:13:47.910 [2024-11-26 23:06:14.058314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:47.910 [2024-11-26 23:06:14.058392] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:47.910 EAL: No free 2048 kB hugepages reported on node 1 00:13:47.910 [2024-11-26 23:06:14.126630] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:47.910 [2024-11-26 23:06:14.242646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:47.910 [2024-11-26 23:06:14.242831] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:47.910 [2024-11-26 23:06:14.242870] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:47.910 [2024-11-26 23:06:14.242882] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:47.910 [2024-11-26 23:06:14.242910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:48.934 23:06:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:48.934 23:06:15 -- common/autotest_common.sh@862 -- # return 0 00:13:48.934 23:06:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:48.934 23:06:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:48.934 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:48.934 23:06:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:48.934 23:06:15 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:48.934 23:06:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.934 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:48.934 [2024-11-26 23:06:15.092435] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:48.934 23:06:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.934 23:06:15 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:48.934 23:06:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.934 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:48.934 23:06:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.934 23:06:15 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:48.934 23:06:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.934 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:48.934 [2024-11-26 23:06:15.108638] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:48.934 23:06:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.934 23:06:15 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:48.934 23:06:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.934 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:48.934 NULL1 00:13:48.934 23:06:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.934 23:06:15 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:48.934 23:06:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.934 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:48.934 23:06:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.934 23:06:15 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:48.934 23:06:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.934 23:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:48.934 23:06:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.934 23:06:15 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:48.934 [2024-11-26 23:06:15.153418] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:48.934 [2024-11-26 23:06:15.153457] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid172893 ] 00:13:48.934 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.583 Attached to nqn.2016-06.io.spdk:cnode1 00:13:49.583 Namespace ID: 1 size: 1GB 00:13:49.583 fused_ordering(0) 00:13:49.583 fused_ordering(1) 00:13:49.583 fused_ordering(2) 00:13:49.583 fused_ordering(3) 00:13:49.583 fused_ordering(4) 00:13:49.583 fused_ordering(5) 00:13:49.583 fused_ordering(6) 00:13:49.583 fused_ordering(7) 00:13:49.583 fused_ordering(8) 00:13:49.583 fused_ordering(9) 00:13:49.583 fused_ordering(10) 00:13:49.583 fused_ordering(11) 00:13:49.583 fused_ordering(12) 00:13:49.583 fused_ordering(13) 00:13:49.583 fused_ordering(14) 00:13:49.583 fused_ordering(15) 00:13:49.583 fused_ordering(16) 00:13:49.583 fused_ordering(17) 00:13:49.583 fused_ordering(18) 00:13:49.583 fused_ordering(19) 00:13:49.583 fused_ordering(20) 00:13:49.583 fused_ordering(21) 00:13:49.583 fused_ordering(22) 00:13:49.583 fused_ordering(23) 00:13:49.583 fused_ordering(24) 00:13:49.583 fused_ordering(25) 00:13:49.583 fused_ordering(26) 00:13:49.583 fused_ordering(27) 00:13:49.583 fused_ordering(28) 00:13:49.583 fused_ordering(29) 00:13:49.584 fused_ordering(30) 00:13:49.584 fused_ordering(31) 00:13:49.584 fused_ordering(32) 00:13:49.584 fused_ordering(33) 00:13:49.584 fused_ordering(34) 00:13:49.584 fused_ordering(35) 00:13:49.584 fused_ordering(36) 00:13:49.584 fused_ordering(37) 00:13:49.584 fused_ordering(38) 00:13:49.584 fused_ordering(39) 00:13:49.584 fused_ordering(40) 00:13:49.584 fused_ordering(41) 00:13:49.584 fused_ordering(42) 00:13:49.584 fused_ordering(43) 00:13:49.584 fused_ordering(44) 00:13:49.584 fused_ordering(45) 00:13:49.584 fused_ordering(46) 00:13:49.584 fused_ordering(47) 00:13:49.584 fused_ordering(48) 00:13:49.584 fused_ordering(49) 00:13:49.584 fused_ordering(50) 00:13:49.584 fused_ordering(51) 00:13:49.584 fused_ordering(52) 00:13:49.584 fused_ordering(53) 00:13:49.584 fused_ordering(54) 00:13:49.584 fused_ordering(55) 00:13:49.584 fused_ordering(56) 00:13:49.584 fused_ordering(57) 00:13:49.584 fused_ordering(58) 00:13:49.584 fused_ordering(59) 00:13:49.584 fused_ordering(60) 00:13:49.584 fused_ordering(61) 00:13:49.584 fused_ordering(62) 00:13:49.584 fused_ordering(63) 00:13:49.584 fused_ordering(64) 00:13:49.584 fused_ordering(65) 00:13:49.584 fused_ordering(66) 00:13:49.584 fused_ordering(67) 00:13:49.584 fused_ordering(68) 00:13:49.584 fused_ordering(69) 00:13:49.584 fused_ordering(70) 00:13:49.584 fused_ordering(71) 00:13:49.584 fused_ordering(72) 00:13:49.584 fused_ordering(73) 00:13:49.584 fused_ordering(74) 00:13:49.584 fused_ordering(75) 00:13:49.584 fused_ordering(76) 00:13:49.584 fused_ordering(77) 00:13:49.584 fused_ordering(78) 00:13:49.584 fused_ordering(79) 00:13:49.584 fused_ordering(80) 00:13:49.584 fused_ordering(81) 00:13:49.584 fused_ordering(82) 00:13:49.584 fused_ordering(83) 00:13:49.584 fused_ordering(84) 00:13:49.584 fused_ordering(85) 00:13:49.584 fused_ordering(86) 00:13:49.584 fused_ordering(87) 00:13:49.584 fused_ordering(88) 00:13:49.584 fused_ordering(89) 00:13:49.584 fused_ordering(90) 00:13:49.584 fused_ordering(91) 00:13:49.584 fused_ordering(92) 00:13:49.584 fused_ordering(93) 00:13:49.584 fused_ordering(94) 00:13:49.584 fused_ordering(95) 00:13:49.584 fused_ordering(96) 00:13:49.584 fused_ordering(97) 00:13:49.584 fused_ordering(98) 00:13:49.584 fused_ordering(99) 00:13:49.584 fused_ordering(100) 00:13:49.584 fused_ordering(101) 00:13:49.584 fused_ordering(102) 00:13:49.584 fused_ordering(103) 00:13:49.584 fused_ordering(104) 00:13:49.584 fused_ordering(105) 00:13:49.584 fused_ordering(106) 00:13:49.584 fused_ordering(107) 00:13:49.584 fused_ordering(108) 00:13:49.584 fused_ordering(109) 00:13:49.584 fused_ordering(110) 00:13:49.584 fused_ordering(111) 00:13:49.584 fused_ordering(112) 00:13:49.584 fused_ordering(113) 00:13:49.584 fused_ordering(114) 00:13:49.584 fused_ordering(115) 00:13:49.584 fused_ordering(116) 00:13:49.584 fused_ordering(117) 00:13:49.584 fused_ordering(118) 00:13:49.584 fused_ordering(119) 00:13:49.584 fused_ordering(120) 00:13:49.584 fused_ordering(121) 00:13:49.584 fused_ordering(122) 00:13:49.584 fused_ordering(123) 00:13:49.584 fused_ordering(124) 00:13:49.584 fused_ordering(125) 00:13:49.584 fused_ordering(126) 00:13:49.584 fused_ordering(127) 00:13:49.584 fused_ordering(128) 00:13:49.584 fused_ordering(129) 00:13:49.584 fused_ordering(130) 00:13:49.584 fused_ordering(131) 00:13:49.584 fused_ordering(132) 00:13:49.584 fused_ordering(133) 00:13:49.584 fused_ordering(134) 00:13:49.584 fused_ordering(135) 00:13:49.584 fused_ordering(136) 00:13:49.584 fused_ordering(137) 00:13:49.584 fused_ordering(138) 00:13:49.584 fused_ordering(139) 00:13:49.584 fused_ordering(140) 00:13:49.584 fused_ordering(141) 00:13:49.584 fused_ordering(142) 00:13:49.584 fused_ordering(143) 00:13:49.584 fused_ordering(144) 00:13:49.584 fused_ordering(145) 00:13:49.584 fused_ordering(146) 00:13:49.584 fused_ordering(147) 00:13:49.584 fused_ordering(148) 00:13:49.584 fused_ordering(149) 00:13:49.584 fused_ordering(150) 00:13:49.584 fused_ordering(151) 00:13:49.584 fused_ordering(152) 00:13:49.584 fused_ordering(153) 00:13:49.584 fused_ordering(154) 00:13:49.584 fused_ordering(155) 00:13:49.584 fused_ordering(156) 00:13:49.584 fused_ordering(157) 00:13:49.584 fused_ordering(158) 00:13:49.584 fused_ordering(159) 00:13:49.584 fused_ordering(160) 00:13:49.584 fused_ordering(161) 00:13:49.584 fused_ordering(162) 00:13:49.584 fused_ordering(163) 00:13:49.584 fused_ordering(164) 00:13:49.584 fused_ordering(165) 00:13:49.584 fused_ordering(166) 00:13:49.584 fused_ordering(167) 00:13:49.584 fused_ordering(168) 00:13:49.584 fused_ordering(169) 00:13:49.584 fused_ordering(170) 00:13:49.584 fused_ordering(171) 00:13:49.584 fused_ordering(172) 00:13:49.584 fused_ordering(173) 00:13:49.584 fused_ordering(174) 00:13:49.584 fused_ordering(175) 00:13:49.584 fused_ordering(176) 00:13:49.584 fused_ordering(177) 00:13:49.584 fused_ordering(178) 00:13:49.584 fused_ordering(179) 00:13:49.584 fused_ordering(180) 00:13:49.584 fused_ordering(181) 00:13:49.584 fused_ordering(182) 00:13:49.584 fused_ordering(183) 00:13:49.584 fused_ordering(184) 00:13:49.584 fused_ordering(185) 00:13:49.584 fused_ordering(186) 00:13:49.584 fused_ordering(187) 00:13:49.584 fused_ordering(188) 00:13:49.584 fused_ordering(189) 00:13:49.584 fused_ordering(190) 00:13:49.584 fused_ordering(191) 00:13:49.584 fused_ordering(192) 00:13:49.584 fused_ordering(193) 00:13:49.584 fused_ordering(194) 00:13:49.584 fused_ordering(195) 00:13:49.584 fused_ordering(196) 00:13:49.584 fused_ordering(197) 00:13:49.584 fused_ordering(198) 00:13:49.584 fused_ordering(199) 00:13:49.584 fused_ordering(200) 00:13:49.584 fused_ordering(201) 00:13:49.584 fused_ordering(202) 00:13:49.584 fused_ordering(203) 00:13:49.584 fused_ordering(204) 00:13:49.584 fused_ordering(205) 00:13:49.885 fused_ordering(206) 00:13:49.885 fused_ordering(207) 00:13:49.885 fused_ordering(208) 00:13:49.885 fused_ordering(209) 00:13:49.885 fused_ordering(210) 00:13:49.885 fused_ordering(211) 00:13:49.885 fused_ordering(212) 00:13:49.885 fused_ordering(213) 00:13:49.885 fused_ordering(214) 00:13:49.885 fused_ordering(215) 00:13:49.885 fused_ordering(216) 00:13:49.885 fused_ordering(217) 00:13:49.885 fused_ordering(218) 00:13:49.885 fused_ordering(219) 00:13:49.885 fused_ordering(220) 00:13:49.885 fused_ordering(221) 00:13:49.885 fused_ordering(222) 00:13:49.885 fused_ordering(223) 00:13:49.885 fused_ordering(224) 00:13:49.885 fused_ordering(225) 00:13:49.885 fused_ordering(226) 00:13:49.885 fused_ordering(227) 00:13:49.885 fused_ordering(228) 00:13:49.885 fused_ordering(229) 00:13:49.885 fused_ordering(230) 00:13:49.885 fused_ordering(231) 00:13:49.885 fused_ordering(232) 00:13:49.885 fused_ordering(233) 00:13:49.885 fused_ordering(234) 00:13:49.885 fused_ordering(235) 00:13:49.885 fused_ordering(236) 00:13:49.885 fused_ordering(237) 00:13:49.885 fused_ordering(238) 00:13:49.885 fused_ordering(239) 00:13:49.885 fused_ordering(240) 00:13:49.885 fused_ordering(241) 00:13:49.885 fused_ordering(242) 00:13:49.885 fused_ordering(243) 00:13:49.885 fused_ordering(244) 00:13:49.885 fused_ordering(245) 00:13:49.885 fused_ordering(246) 00:13:49.885 fused_ordering(247) 00:13:49.885 fused_ordering(248) 00:13:49.885 fused_ordering(249) 00:13:49.885 fused_ordering(250) 00:13:49.885 fused_ordering(251) 00:13:49.885 fused_ordering(252) 00:13:49.885 fused_ordering(253) 00:13:49.885 fused_ordering(254) 00:13:49.885 fused_ordering(255) 00:13:49.885 fused_ordering(256) 00:13:49.885 fused_ordering(257) 00:13:49.885 fused_ordering(258) 00:13:49.885 fused_ordering(259) 00:13:49.885 fused_ordering(260) 00:13:49.885 fused_ordering(261) 00:13:49.885 fused_ordering(262) 00:13:49.885 fused_ordering(263) 00:13:49.885 fused_ordering(264) 00:13:49.885 fused_ordering(265) 00:13:49.885 fused_ordering(266) 00:13:49.885 fused_ordering(267) 00:13:49.885 fused_ordering(268) 00:13:49.885 fused_ordering(269) 00:13:49.885 fused_ordering(270) 00:13:49.885 fused_ordering(271) 00:13:49.885 fused_ordering(272) 00:13:49.885 fused_ordering(273) 00:13:49.885 fused_ordering(274) 00:13:49.885 fused_ordering(275) 00:13:49.885 fused_ordering(276) 00:13:49.885 fused_ordering(277) 00:13:49.885 fused_ordering(278) 00:13:49.885 fused_ordering(279) 00:13:49.885 fused_ordering(280) 00:13:49.885 fused_ordering(281) 00:13:49.885 fused_ordering(282) 00:13:49.885 fused_ordering(283) 00:13:49.885 fused_ordering(284) 00:13:49.885 fused_ordering(285) 00:13:49.885 fused_ordering(286) 00:13:49.885 fused_ordering(287) 00:13:49.885 fused_ordering(288) 00:13:49.885 fused_ordering(289) 00:13:49.885 fused_ordering(290) 00:13:49.885 fused_ordering(291) 00:13:49.885 fused_ordering(292) 00:13:49.885 fused_ordering(293) 00:13:49.885 fused_ordering(294) 00:13:49.885 fused_ordering(295) 00:13:49.885 fused_ordering(296) 00:13:49.885 fused_ordering(297) 00:13:49.885 fused_ordering(298) 00:13:49.885 fused_ordering(299) 00:13:49.885 fused_ordering(300) 00:13:49.885 fused_ordering(301) 00:13:49.885 fused_ordering(302) 00:13:49.885 fused_ordering(303) 00:13:49.885 fused_ordering(304) 00:13:49.885 fused_ordering(305) 00:13:49.885 fused_ordering(306) 00:13:49.885 fused_ordering(307) 00:13:49.885 fused_ordering(308) 00:13:49.885 fused_ordering(309) 00:13:49.885 fused_ordering(310) 00:13:49.885 fused_ordering(311) 00:13:49.886 fused_ordering(312) 00:13:49.886 fused_ordering(313) 00:13:49.886 fused_ordering(314) 00:13:49.886 fused_ordering(315) 00:13:49.886 fused_ordering(316) 00:13:49.886 fused_ordering(317) 00:13:49.886 fused_ordering(318) 00:13:49.886 fused_ordering(319) 00:13:49.886 fused_ordering(320) 00:13:49.886 fused_ordering(321) 00:13:49.886 fused_ordering(322) 00:13:49.886 fused_ordering(323) 00:13:49.886 fused_ordering(324) 00:13:49.886 fused_ordering(325) 00:13:49.886 fused_ordering(326) 00:13:49.886 fused_ordering(327) 00:13:49.886 fused_ordering(328) 00:13:49.886 fused_ordering(329) 00:13:49.886 fused_ordering(330) 00:13:49.886 fused_ordering(331) 00:13:49.886 fused_ordering(332) 00:13:49.886 fused_ordering(333) 00:13:49.886 fused_ordering(334) 00:13:49.886 fused_ordering(335) 00:13:49.886 fused_ordering(336) 00:13:49.886 fused_ordering(337) 00:13:49.886 fused_ordering(338) 00:13:49.886 fused_ordering(339) 00:13:49.886 fused_ordering(340) 00:13:49.886 fused_ordering(341) 00:13:49.886 fused_ordering(342) 00:13:49.886 fused_ordering(343) 00:13:49.886 fused_ordering(344) 00:13:49.886 fused_ordering(345) 00:13:49.886 fused_ordering(346) 00:13:49.886 fused_ordering(347) 00:13:49.886 fused_ordering(348) 00:13:49.886 fused_ordering(349) 00:13:49.886 fused_ordering(350) 00:13:49.886 fused_ordering(351) 00:13:49.886 fused_ordering(352) 00:13:49.886 fused_ordering(353) 00:13:49.886 fused_ordering(354) 00:13:49.886 fused_ordering(355) 00:13:49.886 fused_ordering(356) 00:13:49.886 fused_ordering(357) 00:13:49.886 fused_ordering(358) 00:13:49.886 fused_ordering(359) 00:13:49.886 fused_ordering(360) 00:13:49.886 fused_ordering(361) 00:13:49.886 fused_ordering(362) 00:13:49.886 fused_ordering(363) 00:13:49.886 fused_ordering(364) 00:13:49.886 fused_ordering(365) 00:13:49.886 fused_ordering(366) 00:13:49.886 fused_ordering(367) 00:13:49.886 fused_ordering(368) 00:13:49.886 fused_ordering(369) 00:13:49.886 fused_ordering(370) 00:13:49.886 fused_ordering(371) 00:13:49.886 fused_ordering(372) 00:13:49.886 fused_ordering(373) 00:13:49.886 fused_ordering(374) 00:13:49.886 fused_ordering(375) 00:13:49.886 fused_ordering(376) 00:13:49.886 fused_ordering(377) 00:13:49.886 fused_ordering(378) 00:13:49.886 fused_ordering(379) 00:13:49.886 fused_ordering(380) 00:13:49.886 fused_ordering(381) 00:13:49.886 fused_ordering(382) 00:13:49.886 fused_ordering(383) 00:13:49.886 fused_ordering(384) 00:13:49.886 fused_ordering(385) 00:13:49.886 fused_ordering(386) 00:13:49.886 fused_ordering(387) 00:13:49.886 fused_ordering(388) 00:13:49.886 fused_ordering(389) 00:13:49.886 fused_ordering(390) 00:13:49.886 fused_ordering(391) 00:13:49.886 fused_ordering(392) 00:13:49.886 fused_ordering(393) 00:13:49.886 fused_ordering(394) 00:13:49.886 fused_ordering(395) 00:13:49.886 fused_ordering(396) 00:13:49.886 fused_ordering(397) 00:13:49.886 fused_ordering(398) 00:13:49.886 fused_ordering(399) 00:13:49.886 fused_ordering(400) 00:13:49.886 fused_ordering(401) 00:13:49.886 fused_ordering(402) 00:13:49.886 fused_ordering(403) 00:13:49.886 fused_ordering(404) 00:13:49.886 fused_ordering(405) 00:13:49.886 fused_ordering(406) 00:13:49.886 fused_ordering(407) 00:13:49.886 fused_ordering(408) 00:13:49.886 fused_ordering(409) 00:13:49.886 fused_ordering(410) 00:13:50.161 fused_ordering(411) 00:13:50.161 fused_ordering(412) 00:13:50.161 fused_ordering(413) 00:13:50.161 fused_ordering(414) 00:13:50.161 fused_ordering(415) 00:13:50.161 fused_ordering(416) 00:13:50.161 fused_ordering(417) 00:13:50.161 fused_ordering(418) 00:13:50.161 fused_ordering(419) 00:13:50.161 fused_ordering(420) 00:13:50.161 fused_ordering(421) 00:13:50.161 fused_ordering(422) 00:13:50.161 fused_ordering(423) 00:13:50.161 fused_ordering(424) 00:13:50.161 fused_ordering(425) 00:13:50.161 fused_ordering(426) 00:13:50.161 fused_ordering(427) 00:13:50.161 fused_ordering(428) 00:13:50.161 fused_ordering(429) 00:13:50.161 fused_ordering(430) 00:13:50.161 fused_ordering(431) 00:13:50.161 fused_ordering(432) 00:13:50.161 fused_ordering(433) 00:13:50.161 fused_ordering(434) 00:13:50.161 fused_ordering(435) 00:13:50.161 fused_ordering(436) 00:13:50.161 fused_ordering(437) 00:13:50.161 fused_ordering(438) 00:13:50.161 fused_ordering(439) 00:13:50.161 fused_ordering(440) 00:13:50.161 fused_ordering(441) 00:13:50.161 fused_ordering(442) 00:13:50.161 fused_ordering(443) 00:13:50.161 fused_ordering(444) 00:13:50.161 fused_ordering(445) 00:13:50.161 fused_ordering(446) 00:13:50.161 fused_ordering(447) 00:13:50.161 fused_ordering(448) 00:13:50.161 fused_ordering(449) 00:13:50.161 fused_ordering(450) 00:13:50.161 fused_ordering(451) 00:13:50.161 fused_ordering(452) 00:13:50.161 fused_ordering(453) 00:13:50.161 fused_ordering(454) 00:13:50.161 fused_ordering(455) 00:13:50.161 fused_ordering(456) 00:13:50.161 fused_ordering(457) 00:13:50.161 fused_ordering(458) 00:13:50.161 fused_ordering(459) 00:13:50.161 fused_ordering(460) 00:13:50.161 fused_ordering(461) 00:13:50.161 fused_ordering(462) 00:13:50.161 fused_ordering(463) 00:13:50.161 fused_ordering(464) 00:13:50.161 fused_ordering(465) 00:13:50.161 fused_ordering(466) 00:13:50.161 fused_ordering(467) 00:13:50.161 fused_ordering(468) 00:13:50.161 fused_ordering(469) 00:13:50.161 fused_ordering(470) 00:13:50.161 fused_ordering(471) 00:13:50.161 fused_ordering(472) 00:13:50.161 fused_ordering(473) 00:13:50.161 fused_ordering(474) 00:13:50.161 fused_ordering(475) 00:13:50.161 fused_ordering(476) 00:13:50.161 fused_ordering(477) 00:13:50.161 fused_ordering(478) 00:13:50.161 fused_ordering(479) 00:13:50.161 fused_ordering(480) 00:13:50.161 fused_ordering(481) 00:13:50.161 fused_ordering(482) 00:13:50.161 fused_ordering(483) 00:13:50.161 fused_ordering(484) 00:13:50.161 fused_ordering(485) 00:13:50.161 fused_ordering(486) 00:13:50.161 fused_ordering(487) 00:13:50.161 fused_ordering(488) 00:13:50.161 fused_ordering(489) 00:13:50.161 fused_ordering(490) 00:13:50.161 fused_ordering(491) 00:13:50.161 fused_ordering(492) 00:13:50.161 fused_ordering(493) 00:13:50.161 fused_ordering(494) 00:13:50.161 fused_ordering(495) 00:13:50.161 fused_ordering(496) 00:13:50.161 fused_ordering(497) 00:13:50.161 fused_ordering(498) 00:13:50.161 fused_ordering(499) 00:13:50.161 fused_ordering(500) 00:13:50.161 fused_ordering(501) 00:13:50.161 fused_ordering(502) 00:13:50.161 fused_ordering(503) 00:13:50.161 fused_ordering(504) 00:13:50.161 fused_ordering(505) 00:13:50.161 fused_ordering(506) 00:13:50.161 fused_ordering(507) 00:13:50.161 fused_ordering(508) 00:13:50.161 fused_ordering(509) 00:13:50.161 fused_ordering(510) 00:13:50.161 fused_ordering(511) 00:13:50.161 fused_ordering(512) 00:13:50.161 fused_ordering(513) 00:13:50.161 fused_ordering(514) 00:13:50.161 fused_ordering(515) 00:13:50.161 fused_ordering(516) 00:13:50.161 fused_ordering(517) 00:13:50.161 fused_ordering(518) 00:13:50.161 fused_ordering(519) 00:13:50.161 fused_ordering(520) 00:13:50.161 fused_ordering(521) 00:13:50.161 fused_ordering(522) 00:13:50.161 fused_ordering(523) 00:13:50.161 fused_ordering(524) 00:13:50.161 fused_ordering(525) 00:13:50.161 fused_ordering(526) 00:13:50.161 fused_ordering(527) 00:13:50.161 fused_ordering(528) 00:13:50.161 fused_ordering(529) 00:13:50.161 fused_ordering(530) 00:13:50.161 fused_ordering(531) 00:13:50.161 fused_ordering(532) 00:13:50.161 fused_ordering(533) 00:13:50.161 fused_ordering(534) 00:13:50.161 fused_ordering(535) 00:13:50.161 fused_ordering(536) 00:13:50.161 fused_ordering(537) 00:13:50.161 fused_ordering(538) 00:13:50.161 fused_ordering(539) 00:13:50.161 fused_ordering(540) 00:13:50.161 fused_ordering(541) 00:13:50.161 fused_ordering(542) 00:13:50.161 fused_ordering(543) 00:13:50.161 fused_ordering(544) 00:13:50.161 fused_ordering(545) 00:13:50.161 fused_ordering(546) 00:13:50.161 fused_ordering(547) 00:13:50.161 fused_ordering(548) 00:13:50.161 fused_ordering(549) 00:13:50.162 fused_ordering(550) 00:13:50.162 fused_ordering(551) 00:13:50.162 fused_ordering(552) 00:13:50.162 fused_ordering(553) 00:13:50.162 fused_ordering(554) 00:13:50.162 fused_ordering(555) 00:13:50.162 fused_ordering(556) 00:13:50.162 fused_ordering(557) 00:13:50.162 fused_ordering(558) 00:13:50.162 fused_ordering(559) 00:13:50.162 fused_ordering(560) 00:13:50.162 fused_ordering(561) 00:13:50.162 fused_ordering(562) 00:13:50.162 fused_ordering(563) 00:13:50.162 fused_ordering(564) 00:13:50.162 fused_ordering(565) 00:13:50.162 fused_ordering(566) 00:13:50.162 fused_ordering(567) 00:13:50.162 fused_ordering(568) 00:13:50.162 fused_ordering(569) 00:13:50.162 fused_ordering(570) 00:13:50.162 fused_ordering(571) 00:13:50.162 fused_ordering(572) 00:13:50.162 fused_ordering(573) 00:13:50.162 fused_ordering(574) 00:13:50.162 fused_ordering(575) 00:13:50.162 fused_ordering(576) 00:13:50.162 fused_ordering(577) 00:13:50.162 fused_ordering(578) 00:13:50.162 fused_ordering(579) 00:13:50.162 fused_ordering(580) 00:13:50.162 fused_ordering(581) 00:13:50.162 fused_ordering(582) 00:13:50.162 fused_ordering(583) 00:13:50.162 fused_ordering(584) 00:13:50.162 fused_ordering(585) 00:13:50.162 fused_ordering(586) 00:13:50.162 fused_ordering(587) 00:13:50.162 fused_ordering(588) 00:13:50.162 fused_ordering(589) 00:13:50.162 fused_ordering(590) 00:13:50.162 fused_ordering(591) 00:13:50.162 fused_ordering(592) 00:13:50.162 fused_ordering(593) 00:13:50.162 fused_ordering(594) 00:13:50.162 fused_ordering(595) 00:13:50.162 fused_ordering(596) 00:13:50.162 fused_ordering(597) 00:13:50.162 fused_ordering(598) 00:13:50.162 fused_ordering(599) 00:13:50.162 fused_ordering(600) 00:13:50.162 fused_ordering(601) 00:13:50.162 fused_ordering(602) 00:13:50.162 fused_ordering(603) 00:13:50.162 fused_ordering(604) 00:13:50.162 fused_ordering(605) 00:13:50.162 fused_ordering(606) 00:13:50.162 fused_ordering(607) 00:13:50.162 fused_ordering(608) 00:13:50.162 fused_ordering(609) 00:13:50.162 fused_ordering(610) 00:13:50.162 fused_ordering(611) 00:13:50.162 fused_ordering(612) 00:13:50.162 fused_ordering(613) 00:13:50.162 fused_ordering(614) 00:13:50.162 fused_ordering(615) 00:13:50.811 fused_ordering(616) 00:13:50.811 fused_ordering(617) 00:13:50.811 fused_ordering(618) 00:13:50.811 fused_ordering(619) 00:13:50.811 fused_ordering(620) 00:13:50.811 fused_ordering(621) 00:13:50.811 fused_ordering(622) 00:13:50.811 fused_ordering(623) 00:13:50.811 fused_ordering(624) 00:13:50.811 fused_ordering(625) 00:13:50.811 fused_ordering(626) 00:13:50.811 fused_ordering(627) 00:13:50.811 fused_ordering(628) 00:13:50.811 fused_ordering(629) 00:13:50.811 fused_ordering(630) 00:13:50.811 fused_ordering(631) 00:13:50.811 fused_ordering(632) 00:13:50.811 fused_ordering(633) 00:13:50.811 fused_ordering(634) 00:13:50.811 fused_ordering(635) 00:13:50.811 fused_ordering(636) 00:13:50.811 fused_ordering(637) 00:13:50.811 fused_ordering(638) 00:13:50.811 fused_ordering(639) 00:13:50.811 fused_ordering(640) 00:13:50.811 fused_ordering(641) 00:13:50.811 fused_ordering(642) 00:13:50.811 fused_ordering(643) 00:13:50.811 fused_ordering(644) 00:13:50.811 fused_ordering(645) 00:13:50.811 fused_ordering(646) 00:13:50.811 fused_ordering(647) 00:13:50.811 fused_ordering(648) 00:13:50.811 fused_ordering(649) 00:13:50.811 fused_ordering(650) 00:13:50.811 fused_ordering(651) 00:13:50.811 fused_ordering(652) 00:13:50.811 fused_ordering(653) 00:13:50.811 fused_ordering(654) 00:13:50.811 fused_ordering(655) 00:13:50.811 fused_ordering(656) 00:13:50.811 fused_ordering(657) 00:13:50.811 fused_ordering(658) 00:13:50.811 fused_ordering(659) 00:13:50.811 fused_ordering(660) 00:13:50.811 fused_ordering(661) 00:13:50.811 fused_ordering(662) 00:13:50.811 fused_ordering(663) 00:13:50.811 fused_ordering(664) 00:13:50.811 fused_ordering(665) 00:13:50.811 fused_ordering(666) 00:13:50.811 fused_ordering(667) 00:13:50.811 fused_ordering(668) 00:13:50.811 fused_ordering(669) 00:13:50.811 fused_ordering(670) 00:13:50.812 fused_ordering(671) 00:13:50.812 fused_ordering(672) 00:13:50.812 fused_ordering(673) 00:13:50.812 fused_ordering(674) 00:13:50.812 fused_ordering(675) 00:13:50.812 fused_ordering(676) 00:13:50.812 fused_ordering(677) 00:13:50.812 fused_ordering(678) 00:13:50.812 fused_ordering(679) 00:13:50.812 fused_ordering(680) 00:13:50.812 fused_ordering(681) 00:13:50.812 fused_ordering(682) 00:13:50.812 fused_ordering(683) 00:13:50.812 fused_ordering(684) 00:13:50.812 fused_ordering(685) 00:13:50.812 fused_ordering(686) 00:13:50.812 fused_ordering(687) 00:13:50.812 fused_ordering(688) 00:13:50.812 fused_ordering(689) 00:13:50.812 fused_ordering(690) 00:13:50.812 fused_ordering(691) 00:13:50.812 fused_ordering(692) 00:13:50.812 fused_ordering(693) 00:13:50.812 fused_ordering(694) 00:13:50.812 fused_ordering(695) 00:13:50.812 fused_ordering(696) 00:13:50.812 fused_ordering(697) 00:13:50.812 fused_ordering(698) 00:13:50.812 fused_ordering(699) 00:13:50.812 fused_ordering(700) 00:13:50.812 fused_ordering(701) 00:13:50.812 fused_ordering(702) 00:13:50.812 fused_ordering(703) 00:13:50.812 fused_ordering(704) 00:13:50.812 fused_ordering(705) 00:13:50.812 fused_ordering(706) 00:13:50.812 fused_ordering(707) 00:13:50.812 fused_ordering(708) 00:13:50.812 fused_ordering(709) 00:13:50.812 fused_ordering(710) 00:13:50.812 fused_ordering(711) 00:13:50.812 fused_ordering(712) 00:13:50.812 fused_ordering(713) 00:13:50.812 fused_ordering(714) 00:13:50.812 fused_ordering(715) 00:13:50.812 fused_ordering(716) 00:13:50.812 fused_ordering(717) 00:13:50.812 fused_ordering(718) 00:13:50.812 fused_ordering(719) 00:13:50.812 fused_ordering(720) 00:13:50.812 fused_ordering(721) 00:13:50.812 fused_ordering(722) 00:13:50.812 fused_ordering(723) 00:13:50.812 fused_ordering(724) 00:13:50.812 fused_ordering(725) 00:13:50.812 fused_ordering(726) 00:13:50.812 fused_ordering(727) 00:13:50.812 fused_ordering(728) 00:13:50.812 fused_ordering(729) 00:13:50.812 fused_ordering(730) 00:13:50.812 fused_ordering(731) 00:13:50.812 fused_ordering(732) 00:13:50.812 fused_ordering(733) 00:13:50.812 fused_ordering(734) 00:13:50.812 fused_ordering(735) 00:13:50.812 fused_ordering(736) 00:13:50.812 fused_ordering(737) 00:13:50.812 fused_ordering(738) 00:13:50.812 fused_ordering(739) 00:13:50.812 fused_ordering(740) 00:13:50.812 fused_ordering(741) 00:13:50.812 fused_ordering(742) 00:13:50.812 fused_ordering(743) 00:13:50.812 fused_ordering(744) 00:13:50.812 fused_ordering(745) 00:13:50.812 fused_ordering(746) 00:13:50.812 fused_ordering(747) 00:13:50.812 fused_ordering(748) 00:13:50.812 fused_ordering(749) 00:13:50.812 fused_ordering(750) 00:13:50.812 fused_ordering(751) 00:13:50.812 fused_ordering(752) 00:13:50.812 fused_ordering(753) 00:13:50.812 fused_ordering(754) 00:13:50.812 fused_ordering(755) 00:13:50.812 fused_ordering(756) 00:13:50.812 fused_ordering(757) 00:13:50.812 fused_ordering(758) 00:13:50.812 fused_ordering(759) 00:13:50.812 fused_ordering(760) 00:13:50.812 fused_ordering(761) 00:13:50.812 fused_ordering(762) 00:13:50.812 fused_ordering(763) 00:13:50.812 fused_ordering(764) 00:13:50.812 fused_ordering(765) 00:13:50.812 fused_ordering(766) 00:13:50.812 fused_ordering(767) 00:13:50.812 fused_ordering(768) 00:13:50.812 fused_ordering(769) 00:13:50.812 fused_ordering(770) 00:13:50.812 fused_ordering(771) 00:13:50.812 fused_ordering(772) 00:13:50.812 fused_ordering(773) 00:13:50.812 fused_ordering(774) 00:13:50.812 fused_ordering(775) 00:13:50.812 fused_ordering(776) 00:13:50.812 fused_ordering(777) 00:13:50.812 fused_ordering(778) 00:13:50.812 fused_ordering(779) 00:13:50.812 fused_ordering(780) 00:13:50.812 fused_ordering(781) 00:13:50.812 fused_ordering(782) 00:13:50.812 fused_ordering(783) 00:13:50.812 fused_ordering(784) 00:13:50.812 fused_ordering(785) 00:13:50.812 fused_ordering(786) 00:13:50.812 fused_ordering(787) 00:13:50.812 fused_ordering(788) 00:13:50.812 fused_ordering(789) 00:13:50.812 fused_ordering(790) 00:13:50.812 fused_ordering(791) 00:13:50.812 fused_ordering(792) 00:13:50.812 fused_ordering(793) 00:13:50.812 fused_ordering(794) 00:13:50.812 fused_ordering(795) 00:13:50.812 fused_ordering(796) 00:13:50.812 fused_ordering(797) 00:13:50.812 fused_ordering(798) 00:13:50.812 fused_ordering(799) 00:13:50.812 fused_ordering(800) 00:13:50.812 fused_ordering(801) 00:13:50.812 fused_ordering(802) 00:13:50.812 fused_ordering(803) 00:13:50.812 fused_ordering(804) 00:13:50.812 fused_ordering(805) 00:13:50.812 fused_ordering(806) 00:13:50.812 fused_ordering(807) 00:13:50.812 fused_ordering(808) 00:13:50.812 fused_ordering(809) 00:13:50.812 fused_ordering(810) 00:13:50.812 fused_ordering(811) 00:13:50.812 fused_ordering(812) 00:13:50.812 fused_ordering(813) 00:13:50.812 fused_ordering(814) 00:13:50.812 fused_ordering(815) 00:13:50.812 fused_ordering(816) 00:13:50.812 fused_ordering(817) 00:13:50.812 fused_ordering(818) 00:13:50.812 fused_ordering(819) 00:13:50.812 fused_ordering(820) 00:13:51.114 fused_ordering(821) 00:13:51.114 fused_ordering(822) 00:13:51.114 fused_ordering(823) 00:13:51.115 fused_ordering(824) 00:13:51.115 fused_ordering(825) 00:13:51.115 fused_ordering(826) 00:13:51.115 fused_ordering(827) 00:13:51.115 fused_ordering(828) 00:13:51.115 fused_ordering(829) 00:13:51.115 fused_ordering(830) 00:13:51.115 fused_ordering(831) 00:13:51.115 fused_ordering(832) 00:13:51.115 fused_ordering(833) 00:13:51.115 fused_ordering(834) 00:13:51.115 fused_ordering(835) 00:13:51.115 fused_ordering(836) 00:13:51.115 fused_ordering(837) 00:13:51.115 fused_ordering(838) 00:13:51.115 fused_ordering(839) 00:13:51.115 fused_ordering(840) 00:13:51.115 fused_ordering(841) 00:13:51.115 fused_ordering(842) 00:13:51.115 fused_ordering(843) 00:13:51.115 fused_ordering(844) 00:13:51.115 fused_ordering(845) 00:13:51.115 fused_ordering(846) 00:13:51.115 fused_ordering(847) 00:13:51.115 fused_ordering(848) 00:13:51.115 fused_ordering(849) 00:13:51.115 fused_ordering(850) 00:13:51.115 fused_ordering(851) 00:13:51.115 fused_ordering(852) 00:13:51.115 fused_ordering(853) 00:13:51.115 fused_ordering(854) 00:13:51.115 fused_ordering(855) 00:13:51.115 fused_ordering(856) 00:13:51.115 fused_ordering(857) 00:13:51.115 fused_ordering(858) 00:13:51.115 fused_ordering(859) 00:13:51.115 fused_ordering(860) 00:13:51.115 fused_ordering(861) 00:13:51.115 fused_ordering(862) 00:13:51.115 fused_ordering(863) 00:13:51.115 fused_ordering(864) 00:13:51.115 fused_ordering(865) 00:13:51.115 fused_ordering(866) 00:13:51.115 fused_ordering(867) 00:13:51.115 fused_ordering(868) 00:13:51.115 fused_ordering(869) 00:13:51.115 fused_ordering(870) 00:13:51.115 fused_ordering(871) 00:13:51.115 fused_ordering(872) 00:13:51.115 fused_ordering(873) 00:13:51.115 fused_ordering(874) 00:13:51.115 fused_ordering(875) 00:13:51.115 fused_ordering(876) 00:13:51.115 fused_ordering(877) 00:13:51.115 fused_ordering(878) 00:13:51.115 fused_ordering(879) 00:13:51.115 fused_ordering(880) 00:13:51.115 fused_ordering(881) 00:13:51.115 fused_ordering(882) 00:13:51.115 fused_ordering(883) 00:13:51.115 fused_ordering(884) 00:13:51.115 fused_ordering(885) 00:13:51.115 fused_ordering(886) 00:13:51.115 fused_ordering(887) 00:13:51.115 fused_ordering(888) 00:13:51.115 fused_ordering(889) 00:13:51.115 fused_ordering(890) 00:13:51.115 fused_ordering(891) 00:13:51.115 fused_ordering(892) 00:13:51.115 fused_ordering(893) 00:13:51.115 fused_ordering(894) 00:13:51.115 fused_ordering(895) 00:13:51.115 fused_ordering(896) 00:13:51.115 fused_ordering(897) 00:13:51.115 fused_ordering(898) 00:13:51.115 fused_ordering(899) 00:13:51.115 fused_ordering(900) 00:13:51.115 fused_ordering(901) 00:13:51.115 fused_ordering(902) 00:13:51.115 fused_ordering(903) 00:13:51.115 fused_ordering(904) 00:13:51.115 fused_ordering(905) 00:13:51.115 fused_ordering(906) 00:13:51.115 fused_ordering(907) 00:13:51.115 fused_ordering(908) 00:13:51.115 fused_ordering(909) 00:13:51.115 fused_ordering(910) 00:13:51.115 fused_ordering(911) 00:13:51.115 fused_ordering(912) 00:13:51.115 fused_ordering(913) 00:13:51.115 fused_ordering(914) 00:13:51.115 fused_ordering(915) 00:13:51.115 fused_ordering(916) 00:13:51.115 fused_ordering(917) 00:13:51.115 fused_ordering(918) 00:13:51.115 fused_ordering(919) 00:13:51.115 fused_ordering(920) 00:13:51.115 fused_ordering(921) 00:13:51.115 fused_ordering(922) 00:13:51.115 fused_ordering(923) 00:13:51.115 fused_ordering(924) 00:13:51.115 fused_ordering(925) 00:13:51.115 fused_ordering(926) 00:13:51.115 fused_ordering(927) 00:13:51.115 fused_ordering(928) 00:13:51.115 fused_ordering(929) 00:13:51.115 fused_ordering(930) 00:13:51.115 fused_ordering(931) 00:13:51.115 fused_ordering(932) 00:13:51.115 fused_ordering(933) 00:13:51.115 fused_ordering(934) 00:13:51.115 fused_ordering(935) 00:13:51.115 fused_ordering(936) 00:13:51.115 fused_ordering(937) 00:13:51.115 fused_ordering(938) 00:13:51.115 fused_ordering(939) 00:13:51.115 fused_ordering(940) 00:13:51.115 fused_ordering(941) 00:13:51.115 fused_ordering(942) 00:13:51.115 fused_ordering(943) 00:13:51.115 fused_ordering(944) 00:13:51.115 fused_ordering(945) 00:13:51.115 fused_ordering(946) 00:13:51.115 fused_ordering(947) 00:13:51.115 fused_ordering(948) 00:13:51.115 fused_ordering(949) 00:13:51.115 fused_ordering(950) 00:13:51.115 fused_ordering(951) 00:13:51.115 fused_ordering(952) 00:13:51.115 fused_ordering(953) 00:13:51.115 fused_ordering(954) 00:13:51.115 fused_ordering(955) 00:13:51.115 fused_ordering(956) 00:13:51.115 fused_ordering(957) 00:13:51.115 fused_ordering(958) 00:13:51.115 fused_ordering(959) 00:13:51.115 fused_ordering(960) 00:13:51.115 fused_ordering(961) 00:13:51.115 fused_ordering(962) 00:13:51.115 fused_ordering(963) 00:13:51.115 fused_ordering(964) 00:13:51.115 fused_ordering(965) 00:13:51.115 fused_ordering(966) 00:13:51.115 fused_ordering(967) 00:13:51.115 fused_ordering(968) 00:13:51.115 fused_ordering(969) 00:13:51.115 fused_ordering(970) 00:13:51.115 fused_ordering(971) 00:13:51.115 fused_ordering(972) 00:13:51.115 fused_ordering(973) 00:13:51.115 fused_ordering(974) 00:13:51.115 fused_ordering(975) 00:13:51.115 fused_ordering(976) 00:13:51.115 fused_ordering(977) 00:13:51.115 fused_ordering(978) 00:13:51.115 fused_ordering(979) 00:13:51.115 fused_ordering(980) 00:13:51.115 fused_ordering(981) 00:13:51.115 fused_ordering(982) 00:13:51.115 fused_ordering(983) 00:13:51.115 fused_ordering(984) 00:13:51.115 fused_ordering(985) 00:13:51.115 fused_ordering(986) 00:13:51.115 fused_ordering(987) 00:13:51.115 fused_ordering(988) 00:13:51.115 fused_ordering(989) 00:13:51.115 fused_ordering(990) 00:13:51.115 fused_ordering(991) 00:13:51.115 fused_ordering(992) 00:13:51.115 fused_ordering(993) 00:13:51.115 fused_ordering(994) 00:13:51.115 fused_ordering(995) 00:13:51.115 fused_ordering(996) 00:13:51.115 fused_ordering(997) 00:13:51.115 fused_ordering(998) 00:13:51.115 fused_ordering(999) 00:13:51.115 fused_ordering(1000) 00:13:51.115 fused_ordering(1001) 00:13:51.115 fused_ordering(1002) 00:13:51.115 fused_ordering(1003) 00:13:51.115 fused_ordering(1004) 00:13:51.115 fused_ordering(1005) 00:13:51.115 fused_ordering(1006) 00:13:51.115 fused_ordering(1007) 00:13:51.115 fused_ordering(1008) 00:13:51.115 fused_ordering(1009) 00:13:51.115 fused_ordering(1010) 00:13:51.115 fused_ordering(1011) 00:13:51.115 fused_ordering(1012) 00:13:51.115 fused_ordering(1013) 00:13:51.115 fused_ordering(1014) 00:13:51.115 fused_ordering(1015) 00:13:51.115 fused_ordering(1016) 00:13:51.115 fused_ordering(1017) 00:13:51.115 fused_ordering(1018) 00:13:51.115 fused_ordering(1019) 00:13:51.115 fused_ordering(1020) 00:13:51.115 fused_ordering(1021) 00:13:51.115 fused_ordering(1022) 00:13:51.115 fused_ordering(1023) 00:13:51.115 23:06:17 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:51.115 23:06:17 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:51.115 23:06:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:51.115 23:06:17 -- nvmf/common.sh@116 -- # sync 00:13:51.115 23:06:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:51.115 23:06:17 -- nvmf/common.sh@119 -- # set +e 00:13:51.115 23:06:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:51.115 23:06:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:51.115 rmmod nvme_tcp 00:13:51.115 rmmod nvme_fabrics 00:13:51.115 rmmod nvme_keyring 00:13:51.115 23:06:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:51.115 23:06:17 -- nvmf/common.sh@123 -- # set -e 00:13:51.115 23:06:17 -- nvmf/common.sh@124 -- # return 0 00:13:51.115 23:06:17 -- nvmf/common.sh@477 -- # '[' -n 172728 ']' 00:13:51.115 23:06:17 -- nvmf/common.sh@478 -- # killprocess 172728 00:13:51.115 23:06:17 -- common/autotest_common.sh@936 -- # '[' -z 172728 ']' 00:13:51.115 23:06:17 -- common/autotest_common.sh@940 -- # kill -0 172728 00:13:51.115 23:06:17 -- common/autotest_common.sh@941 -- # uname 00:13:51.115 23:06:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:51.115 23:06:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 172728 00:13:51.376 23:06:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:51.376 23:06:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:51.376 23:06:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 172728' 00:13:51.376 killing process with pid 172728 00:13:51.376 23:06:17 -- common/autotest_common.sh@955 -- # kill 172728 00:13:51.376 23:06:17 -- common/autotest_common.sh@960 -- # wait 172728 00:13:51.638 23:06:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:51.638 23:06:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:51.638 23:06:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:51.638 23:06:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:51.638 23:06:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:51.638 23:06:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.638 23:06:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.638 23:06:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.543 23:06:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:53.543 00:13:53.543 real 0m8.097s 00:13:53.543 user 0m6.199s 00:13:53.543 sys 0m2.790s 00:13:53.543 23:06:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:53.543 23:06:19 -- common/autotest_common.sh@10 -- # set +x 00:13:53.543 ************************************ 00:13:53.543 END TEST nvmf_fused_ordering 00:13:53.543 ************************************ 00:13:53.543 23:06:19 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:53.543 23:06:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:53.543 23:06:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:53.543 23:06:19 -- common/autotest_common.sh@10 -- # set +x 00:13:53.543 ************************************ 00:13:53.543 START TEST nvmf_delete_subsystem 00:13:53.543 ************************************ 00:13:53.543 23:06:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:53.543 * Looking for test storage... 00:13:53.543 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:53.543 23:06:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:53.543 23:06:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:53.543 23:06:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:53.804 23:06:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:53.804 23:06:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:53.804 23:06:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:53.804 23:06:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:53.804 23:06:19 -- scripts/common.sh@335 -- # IFS=.-: 00:13:53.804 23:06:19 -- scripts/common.sh@335 -- # read -ra ver1 00:13:53.804 23:06:19 -- scripts/common.sh@336 -- # IFS=.-: 00:13:53.804 23:06:19 -- scripts/common.sh@336 -- # read -ra ver2 00:13:53.804 23:06:19 -- scripts/common.sh@337 -- # local 'op=<' 00:13:53.804 23:06:19 -- scripts/common.sh@339 -- # ver1_l=2 00:13:53.804 23:06:19 -- scripts/common.sh@340 -- # ver2_l=1 00:13:53.804 23:06:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:53.804 23:06:19 -- scripts/common.sh@343 -- # case "$op" in 00:13:53.804 23:06:19 -- scripts/common.sh@344 -- # : 1 00:13:53.804 23:06:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:53.804 23:06:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:53.804 23:06:19 -- scripts/common.sh@364 -- # decimal 1 00:13:53.804 23:06:19 -- scripts/common.sh@352 -- # local d=1 00:13:53.804 23:06:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:53.804 23:06:19 -- scripts/common.sh@354 -- # echo 1 00:13:53.804 23:06:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:53.804 23:06:19 -- scripts/common.sh@365 -- # decimal 2 00:13:53.804 23:06:19 -- scripts/common.sh@352 -- # local d=2 00:13:53.804 23:06:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:53.804 23:06:19 -- scripts/common.sh@354 -- # echo 2 00:13:53.804 23:06:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:53.804 23:06:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:53.804 23:06:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:53.804 23:06:19 -- scripts/common.sh@367 -- # return 0 00:13:53.804 23:06:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:53.804 23:06:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:53.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.804 --rc genhtml_branch_coverage=1 00:13:53.804 --rc genhtml_function_coverage=1 00:13:53.804 --rc genhtml_legend=1 00:13:53.804 --rc geninfo_all_blocks=1 00:13:53.804 --rc geninfo_unexecuted_blocks=1 00:13:53.804 00:13:53.804 ' 00:13:53.804 23:06:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:53.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.804 --rc genhtml_branch_coverage=1 00:13:53.804 --rc genhtml_function_coverage=1 00:13:53.804 --rc genhtml_legend=1 00:13:53.804 --rc geninfo_all_blocks=1 00:13:53.804 --rc geninfo_unexecuted_blocks=1 00:13:53.804 00:13:53.804 ' 00:13:53.804 23:06:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:53.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.804 --rc genhtml_branch_coverage=1 00:13:53.804 --rc genhtml_function_coverage=1 00:13:53.804 --rc genhtml_legend=1 00:13:53.804 --rc geninfo_all_blocks=1 00:13:53.804 --rc geninfo_unexecuted_blocks=1 00:13:53.804 00:13:53.804 ' 00:13:53.804 23:06:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:53.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.804 --rc genhtml_branch_coverage=1 00:13:53.804 --rc genhtml_function_coverage=1 00:13:53.804 --rc genhtml_legend=1 00:13:53.804 --rc geninfo_all_blocks=1 00:13:53.804 --rc geninfo_unexecuted_blocks=1 00:13:53.804 00:13:53.804 ' 00:13:53.804 23:06:19 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:53.804 23:06:19 -- nvmf/common.sh@7 -- # uname -s 00:13:53.804 23:06:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:53.804 23:06:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:53.804 23:06:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:53.804 23:06:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:53.804 23:06:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:53.804 23:06:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:53.804 23:06:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:53.804 23:06:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:53.804 23:06:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:53.804 23:06:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:53.804 23:06:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.804 23:06:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.804 23:06:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:53.804 23:06:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:53.804 23:06:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:53.804 23:06:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:53.804 23:06:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:53.804 23:06:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:53.804 23:06:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:53.804 23:06:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.805 23:06:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.805 23:06:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.805 23:06:19 -- paths/export.sh@5 -- # export PATH 00:13:53.805 23:06:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.805 23:06:19 -- nvmf/common.sh@46 -- # : 0 00:13:53.805 23:06:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:53.805 23:06:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:53.805 23:06:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:53.805 23:06:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:53.805 23:06:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:53.805 23:06:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:53.805 23:06:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:53.805 23:06:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:53.805 23:06:20 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:53.805 23:06:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:53.805 23:06:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:53.805 23:06:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:53.805 23:06:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:53.805 23:06:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:53.805 23:06:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:53.805 23:06:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:53.805 23:06:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.805 23:06:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:53.805 23:06:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:53.805 23:06:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:53.805 23:06:20 -- common/autotest_common.sh@10 -- # set +x 00:13:55.709 23:06:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.709 23:06:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:55.709 23:06:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:55.709 23:06:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:55.709 23:06:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:55.709 23:06:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:55.709 23:06:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:55.709 23:06:22 -- nvmf/common.sh@294 -- # net_devs=() 00:13:55.709 23:06:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:55.709 23:06:22 -- nvmf/common.sh@295 -- # e810=() 00:13:55.709 23:06:22 -- nvmf/common.sh@295 -- # local -ga e810 00:13:55.709 23:06:22 -- nvmf/common.sh@296 -- # x722=() 00:13:55.709 23:06:22 -- nvmf/common.sh@296 -- # local -ga x722 00:13:55.709 23:06:22 -- nvmf/common.sh@297 -- # mlx=() 00:13:55.709 23:06:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:55.709 23:06:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.709 23:06:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:55.709 23:06:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:55.709 23:06:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:55.709 23:06:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.709 23:06:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:55.709 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:55.709 23:06:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.709 23:06:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:55.709 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:55.709 23:06:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:55.709 23:06:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:55.709 23:06:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.709 23:06:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.709 23:06:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.709 23:06:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.709 23:06:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:55.709 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:55.709 23:06:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.710 23:06:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.710 23:06:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.710 23:06:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.710 23:06:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.710 23:06:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:55.710 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:55.710 23:06:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.710 23:06:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:55.710 23:06:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:55.710 23:06:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:55.710 23:06:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:55.710 23:06:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:55.710 23:06:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.710 23:06:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.710 23:06:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.710 23:06:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:55.710 23:06:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.710 23:06:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.710 23:06:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:55.710 23:06:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.710 23:06:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.710 23:06:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:55.710 23:06:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:55.710 23:06:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.710 23:06:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.970 23:06:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.970 23:06:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.970 23:06:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:55.970 23:06:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.970 23:06:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.970 23:06:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.970 23:06:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:55.970 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.970 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.375 ms 00:13:55.970 00:13:55.970 --- 10.0.0.2 ping statistics --- 00:13:55.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.970 rtt min/avg/max/mdev = 0.375/0.375/0.375/0.000 ms 00:13:55.970 23:06:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.970 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.970 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:13:55.970 00:13:55.970 --- 10.0.0.1 ping statistics --- 00:13:55.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.970 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:13:55.970 23:06:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.970 23:06:22 -- nvmf/common.sh@410 -- # return 0 00:13:55.970 23:06:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:55.970 23:06:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.970 23:06:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:55.970 23:06:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:55.970 23:06:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.970 23:06:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:55.970 23:06:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:55.970 23:06:22 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:55.970 23:06:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:55.970 23:06:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:55.970 23:06:22 -- common/autotest_common.sh@10 -- # set +x 00:13:55.970 23:06:22 -- nvmf/common.sh@469 -- # nvmfpid=175133 00:13:55.970 23:06:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:55.970 23:06:22 -- nvmf/common.sh@470 -- # waitforlisten 175133 00:13:55.970 23:06:22 -- common/autotest_common.sh@829 -- # '[' -z 175133 ']' 00:13:55.970 23:06:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.970 23:06:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:55.970 23:06:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.970 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.970 23:06:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:55.970 23:06:22 -- common/autotest_common.sh@10 -- # set +x 00:13:55.970 [2024-11-26 23:06:22.233211] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:55.970 [2024-11-26 23:06:22.233302] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.970 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.970 [2024-11-26 23:06:22.297649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:56.228 [2024-11-26 23:06:22.408109] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:56.228 [2024-11-26 23:06:22.408291] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:56.228 [2024-11-26 23:06:22.408310] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:56.229 [2024-11-26 23:06:22.408323] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:56.229 [2024-11-26 23:06:22.408445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:56.229 [2024-11-26 23:06:22.408450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:57.166 23:06:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:57.166 23:06:23 -- common/autotest_common.sh@862 -- # return 0 00:13:57.166 23:06:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:57.166 23:06:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:57.166 23:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:57.166 23:06:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:57.166 23:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.166 23:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:57.166 [2024-11-26 23:06:23.232708] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:57.166 23:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:57.166 23:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.166 23:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:57.166 23:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:57.166 23:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.166 23:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:57.166 [2024-11-26 23:06:23.248927] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:57.166 23:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:57.166 23:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.166 23:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:57.166 NULL1 00:13:57.166 23:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:57.166 23:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.166 23:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:57.166 Delay0 00:13:57.166 23:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.166 23:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.166 23:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:57.166 23:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@28 -- # perf_pid=175292 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:57.166 23:06:23 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:57.166 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.166 [2024-11-26 23:06:23.323644] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:59.068 23:06:25 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:59.068 23:06:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.068 23:06:25 -- common/autotest_common.sh@10 -- # set +x 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 starting I/O failed: -6 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Write completed with error (sct=0, sc=8) 00:13:59.328 Read completed with error (sct=0, sc=8) 00:13:59.328 starting I/O failed: -6 00:13:59.328 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Write completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 starting I/O failed: -6 00:13:59.329 Read completed with error (sct=0, sc=8) 00:13:59.329 [2024-11-26 23:06:25.616846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf984c0 is same with the state(5) to be set 00:14:00.268 [2024-11-26 23:06:26.581207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfb1960 is same with the state(5) to be set 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 [2024-11-26 23:06:26.617619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f136800bf20 is same with the state(5) to be set 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 [2024-11-26 23:06:26.618034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf98770 is same with the state(5) to be set 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 [2024-11-26 23:06:26.618315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f136800c600 is same with the state(5) to be set 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Write completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.268 Read completed with error (sct=0, sc=8) 00:14:00.269 Read completed with error (sct=0, sc=8) 00:14:00.269 Write completed with error (sct=0, sc=8) 00:14:00.269 Write completed with error (sct=0, sc=8) 00:14:00.269 Read completed with error (sct=0, sc=8) 00:14:00.269 Read completed with error (sct=0, sc=8) 00:14:00.269 Read completed with error (sct=0, sc=8) 00:14:00.269 Read completed with error (sct=0, sc=8) 00:14:00.269 [2024-11-26 23:06:26.618648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfb83d0 is same with the state(5) to be set 00:14:00.269 [2024-11-26 23:06:26.619658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfb1960 (9): Bad file descriptor 00:14:00.269 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:00.269 23:06:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.269 23:06:26 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:00.269 23:06:26 -- target/delete_subsystem.sh@35 -- # kill -0 175292 00:14:00.269 23:06:26 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:00.269 Initializing NVMe Controllers 00:14:00.269 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:00.269 Controller IO queue size 128, less than required. 00:14:00.269 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:00.269 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:00.269 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:00.269 Initialization complete. Launching workers. 00:14:00.269 ======================================================== 00:14:00.269 Latency(us) 00:14:00.269 Device Information : IOPS MiB/s Average min max 00:14:00.269 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 188.02 0.09 902426.62 719.99 1014510.09 00:14:00.269 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 187.53 0.09 896741.92 625.24 1012534.32 00:14:00.269 ======================================================== 00:14:00.269 Total : 375.55 0.18 899588.03 625.24 1014510.09 00:14:00.269 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@35 -- # kill -0 175292 00:14:00.834 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (175292) - No such process 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@45 -- # NOT wait 175292 00:14:00.834 23:06:27 -- common/autotest_common.sh@650 -- # local es=0 00:14:00.834 23:06:27 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 175292 00:14:00.834 23:06:27 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:00.834 23:06:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:00.834 23:06:27 -- common/autotest_common.sh@642 -- # type -t wait 00:14:00.834 23:06:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:00.834 23:06:27 -- common/autotest_common.sh@653 -- # wait 175292 00:14:00.834 23:06:27 -- common/autotest_common.sh@653 -- # es=1 00:14:00.834 23:06:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:00.834 23:06:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:00.834 23:06:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:00.834 23:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.834 23:06:27 -- common/autotest_common.sh@10 -- # set +x 00:14:00.834 23:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:00.834 23:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.834 23:06:27 -- common/autotest_common.sh@10 -- # set +x 00:14:00.834 [2024-11-26 23:06:27.143425] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:00.834 23:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.834 23:06:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.834 23:06:27 -- common/autotest_common.sh@10 -- # set +x 00:14:00.834 23:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@54 -- # perf_pid=175714 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@57 -- # kill -0 175714 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:00.834 23:06:27 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:00.834 EAL: No free 2048 kB hugepages reported on node 1 00:14:00.834 [2024-11-26 23:06:27.206073] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:01.401 23:06:27 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:01.401 23:06:27 -- target/delete_subsystem.sh@57 -- # kill -0 175714 00:14:01.401 23:06:27 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:01.968 23:06:28 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:01.968 23:06:28 -- target/delete_subsystem.sh@57 -- # kill -0 175714 00:14:01.968 23:06:28 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.536 23:06:28 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.536 23:06:28 -- target/delete_subsystem.sh@57 -- # kill -0 175714 00:14:02.536 23:06:28 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.795 23:06:29 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.795 23:06:29 -- target/delete_subsystem.sh@57 -- # kill -0 175714 00:14:02.795 23:06:29 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:03.359 23:06:29 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:03.359 23:06:29 -- target/delete_subsystem.sh@57 -- # kill -0 175714 00:14:03.359 23:06:29 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:03.930 23:06:30 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:03.930 23:06:30 -- target/delete_subsystem.sh@57 -- # kill -0 175714 00:14:03.930 23:06:30 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.190 Initializing NVMe Controllers 00:14:04.190 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:04.190 Controller IO queue size 128, less than required. 00:14:04.190 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:04.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:04.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:04.190 Initialization complete. Launching workers. 00:14:04.190 ======================================================== 00:14:04.190 Latency(us) 00:14:04.190 Device Information : IOPS MiB/s Average min max 00:14:04.190 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004479.87 1000192.09 1042220.52 00:14:04.190 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004140.04 1000199.44 1012064.98 00:14:04.190 ======================================================== 00:14:04.190 Total : 256.00 0.12 1004309.96 1000192.09 1042220.52 00:14:04.190 00:14:04.451 23:06:30 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:04.451 23:06:30 -- target/delete_subsystem.sh@57 -- # kill -0 175714 00:14:04.451 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (175714) - No such process 00:14:04.451 23:06:30 -- target/delete_subsystem.sh@67 -- # wait 175714 00:14:04.451 23:06:30 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:04.451 23:06:30 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:04.451 23:06:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:04.451 23:06:30 -- nvmf/common.sh@116 -- # sync 00:14:04.451 23:06:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:04.451 23:06:30 -- nvmf/common.sh@119 -- # set +e 00:14:04.451 23:06:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:04.451 23:06:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:04.451 rmmod nvme_tcp 00:14:04.451 rmmod nvme_fabrics 00:14:04.451 rmmod nvme_keyring 00:14:04.451 23:06:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:04.451 23:06:30 -- nvmf/common.sh@123 -- # set -e 00:14:04.451 23:06:30 -- nvmf/common.sh@124 -- # return 0 00:14:04.451 23:06:30 -- nvmf/common.sh@477 -- # '[' -n 175133 ']' 00:14:04.451 23:06:30 -- nvmf/common.sh@478 -- # killprocess 175133 00:14:04.451 23:06:30 -- common/autotest_common.sh@936 -- # '[' -z 175133 ']' 00:14:04.451 23:06:30 -- common/autotest_common.sh@940 -- # kill -0 175133 00:14:04.451 23:06:30 -- common/autotest_common.sh@941 -- # uname 00:14:04.451 23:06:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:04.451 23:06:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 175133 00:14:04.451 23:06:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:04.451 23:06:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:04.451 23:06:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 175133' 00:14:04.451 killing process with pid 175133 00:14:04.451 23:06:30 -- common/autotest_common.sh@955 -- # kill 175133 00:14:04.451 23:06:30 -- common/autotest_common.sh@960 -- # wait 175133 00:14:04.708 23:06:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:04.708 23:06:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:04.708 23:06:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:04.708 23:06:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:04.708 23:06:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:04.708 23:06:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:04.708 23:06:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:04.708 23:06:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:07.250 23:06:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:07.250 00:14:07.250 real 0m13.230s 00:14:07.250 user 0m29.969s 00:14:07.250 sys 0m3.039s 00:14:07.250 23:06:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:07.250 23:06:33 -- common/autotest_common.sh@10 -- # set +x 00:14:07.250 ************************************ 00:14:07.250 END TEST nvmf_delete_subsystem 00:14:07.250 ************************************ 00:14:07.250 23:06:33 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:07.250 23:06:33 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:07.250 23:06:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:07.250 23:06:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:07.250 23:06:33 -- common/autotest_common.sh@10 -- # set +x 00:14:07.250 ************************************ 00:14:07.250 START TEST nvmf_nvme_cli 00:14:07.250 ************************************ 00:14:07.250 23:06:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:07.250 * Looking for test storage... 00:14:07.250 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:07.250 23:06:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:07.250 23:06:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:07.250 23:06:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:07.250 23:06:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:07.250 23:06:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:07.250 23:06:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:07.250 23:06:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:07.250 23:06:33 -- scripts/common.sh@335 -- # IFS=.-: 00:14:07.250 23:06:33 -- scripts/common.sh@335 -- # read -ra ver1 00:14:07.250 23:06:33 -- scripts/common.sh@336 -- # IFS=.-: 00:14:07.250 23:06:33 -- scripts/common.sh@336 -- # read -ra ver2 00:14:07.250 23:06:33 -- scripts/common.sh@337 -- # local 'op=<' 00:14:07.250 23:06:33 -- scripts/common.sh@339 -- # ver1_l=2 00:14:07.250 23:06:33 -- scripts/common.sh@340 -- # ver2_l=1 00:14:07.250 23:06:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:07.250 23:06:33 -- scripts/common.sh@343 -- # case "$op" in 00:14:07.250 23:06:33 -- scripts/common.sh@344 -- # : 1 00:14:07.250 23:06:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:07.250 23:06:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:07.250 23:06:33 -- scripts/common.sh@364 -- # decimal 1 00:14:07.250 23:06:33 -- scripts/common.sh@352 -- # local d=1 00:14:07.250 23:06:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:07.250 23:06:33 -- scripts/common.sh@354 -- # echo 1 00:14:07.250 23:06:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:07.250 23:06:33 -- scripts/common.sh@365 -- # decimal 2 00:14:07.250 23:06:33 -- scripts/common.sh@352 -- # local d=2 00:14:07.250 23:06:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:07.250 23:06:33 -- scripts/common.sh@354 -- # echo 2 00:14:07.250 23:06:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:07.250 23:06:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:07.250 23:06:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:07.250 23:06:33 -- scripts/common.sh@367 -- # return 0 00:14:07.250 23:06:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:07.250 23:06:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:07.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:07.250 --rc genhtml_branch_coverage=1 00:14:07.250 --rc genhtml_function_coverage=1 00:14:07.250 --rc genhtml_legend=1 00:14:07.250 --rc geninfo_all_blocks=1 00:14:07.250 --rc geninfo_unexecuted_blocks=1 00:14:07.250 00:14:07.250 ' 00:14:07.250 23:06:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:07.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:07.250 --rc genhtml_branch_coverage=1 00:14:07.250 --rc genhtml_function_coverage=1 00:14:07.250 --rc genhtml_legend=1 00:14:07.250 --rc geninfo_all_blocks=1 00:14:07.250 --rc geninfo_unexecuted_blocks=1 00:14:07.250 00:14:07.250 ' 00:14:07.250 23:06:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:07.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:07.250 --rc genhtml_branch_coverage=1 00:14:07.250 --rc genhtml_function_coverage=1 00:14:07.251 --rc genhtml_legend=1 00:14:07.251 --rc geninfo_all_blocks=1 00:14:07.251 --rc geninfo_unexecuted_blocks=1 00:14:07.251 00:14:07.251 ' 00:14:07.251 23:06:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:07.251 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:07.251 --rc genhtml_branch_coverage=1 00:14:07.251 --rc genhtml_function_coverage=1 00:14:07.251 --rc genhtml_legend=1 00:14:07.251 --rc geninfo_all_blocks=1 00:14:07.251 --rc geninfo_unexecuted_blocks=1 00:14:07.251 00:14:07.251 ' 00:14:07.251 23:06:33 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:07.251 23:06:33 -- nvmf/common.sh@7 -- # uname -s 00:14:07.251 23:06:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:07.251 23:06:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:07.251 23:06:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:07.251 23:06:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:07.251 23:06:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:07.251 23:06:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:07.251 23:06:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:07.251 23:06:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:07.251 23:06:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:07.251 23:06:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:07.251 23:06:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:07.251 23:06:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:07.251 23:06:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:07.251 23:06:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:07.251 23:06:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:07.251 23:06:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:07.251 23:06:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:07.251 23:06:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:07.251 23:06:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:07.251 23:06:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.251 23:06:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.251 23:06:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.251 23:06:33 -- paths/export.sh@5 -- # export PATH 00:14:07.251 23:06:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.251 23:06:33 -- nvmf/common.sh@46 -- # : 0 00:14:07.251 23:06:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:07.251 23:06:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:07.251 23:06:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:07.251 23:06:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:07.251 23:06:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:07.251 23:06:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:07.251 23:06:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:07.251 23:06:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:07.251 23:06:33 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:07.251 23:06:33 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:07.251 23:06:33 -- target/nvme_cli.sh@14 -- # devs=() 00:14:07.251 23:06:33 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:07.251 23:06:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:07.251 23:06:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:07.251 23:06:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:07.251 23:06:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:07.251 23:06:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:07.251 23:06:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:07.251 23:06:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:07.251 23:06:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:07.251 23:06:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:07.251 23:06:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:07.251 23:06:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:07.251 23:06:33 -- common/autotest_common.sh@10 -- # set +x 00:14:09.160 23:06:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:09.160 23:06:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:09.160 23:06:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:09.160 23:06:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:09.160 23:06:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:09.160 23:06:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:09.160 23:06:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:09.160 23:06:35 -- nvmf/common.sh@294 -- # net_devs=() 00:14:09.160 23:06:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:09.160 23:06:35 -- nvmf/common.sh@295 -- # e810=() 00:14:09.160 23:06:35 -- nvmf/common.sh@295 -- # local -ga e810 00:14:09.160 23:06:35 -- nvmf/common.sh@296 -- # x722=() 00:14:09.160 23:06:35 -- nvmf/common.sh@296 -- # local -ga x722 00:14:09.160 23:06:35 -- nvmf/common.sh@297 -- # mlx=() 00:14:09.160 23:06:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:09.160 23:06:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:09.160 23:06:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:09.160 23:06:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:09.160 23:06:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:09.160 23:06:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:09.160 23:06:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:09.160 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:09.160 23:06:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:09.160 23:06:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:09.160 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:09.160 23:06:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:09.160 23:06:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:09.160 23:06:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:09.160 23:06:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:09.160 23:06:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:09.160 23:06:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:09.160 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:09.160 23:06:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:09.160 23:06:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:09.160 23:06:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:09.160 23:06:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:09.160 23:06:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:09.160 23:06:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:09.160 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:09.160 23:06:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:09.160 23:06:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:09.160 23:06:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:09.160 23:06:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:09.160 23:06:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:09.160 23:06:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:09.160 23:06:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:09.160 23:06:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:09.161 23:06:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:09.161 23:06:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:09.161 23:06:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:09.161 23:06:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:09.161 23:06:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:09.161 23:06:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:09.161 23:06:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:09.161 23:06:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:09.161 23:06:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:09.161 23:06:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:09.161 23:06:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:09.161 23:06:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:09.161 23:06:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:09.161 23:06:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:09.161 23:06:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:09.161 23:06:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:09.161 23:06:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:09.161 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:09.161 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.329 ms 00:14:09.161 00:14:09.161 --- 10.0.0.2 ping statistics --- 00:14:09.161 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:09.161 rtt min/avg/max/mdev = 0.329/0.329/0.329/0.000 ms 00:14:09.161 23:06:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:09.161 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:09.161 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:14:09.161 00:14:09.161 --- 10.0.0.1 ping statistics --- 00:14:09.161 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:09.161 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:14:09.161 23:06:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:09.161 23:06:35 -- nvmf/common.sh@410 -- # return 0 00:14:09.161 23:06:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:09.161 23:06:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:09.161 23:06:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:09.161 23:06:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:09.161 23:06:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:09.161 23:06:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:09.161 23:06:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:09.161 23:06:35 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:09.161 23:06:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:09.161 23:06:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:09.161 23:06:35 -- common/autotest_common.sh@10 -- # set +x 00:14:09.161 23:06:35 -- nvmf/common.sh@469 -- # nvmfpid=178197 00:14:09.161 23:06:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:09.161 23:06:35 -- nvmf/common.sh@470 -- # waitforlisten 178197 00:14:09.161 23:06:35 -- common/autotest_common.sh@829 -- # '[' -z 178197 ']' 00:14:09.161 23:06:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:09.161 23:06:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:09.161 23:06:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:09.161 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:09.161 23:06:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:09.161 23:06:35 -- common/autotest_common.sh@10 -- # set +x 00:14:09.161 [2024-11-26 23:06:35.443174] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:09.161 [2024-11-26 23:06:35.443260] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:09.161 EAL: No free 2048 kB hugepages reported on node 1 00:14:09.161 [2024-11-26 23:06:35.507205] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:09.420 [2024-11-26 23:06:35.616510] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:09.420 [2024-11-26 23:06:35.616678] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:09.420 [2024-11-26 23:06:35.616695] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:09.420 [2024-11-26 23:06:35.616707] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:09.420 [2024-11-26 23:06:35.616779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:09.420 [2024-11-26 23:06:35.616843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:09.420 [2024-11-26 23:06:35.616906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:09.420 [2024-11-26 23:06:35.616909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:10.357 23:06:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:10.357 23:06:36 -- common/autotest_common.sh@862 -- # return 0 00:14:10.357 23:06:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:10.357 23:06:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 23:06:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:10.357 23:06:36 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:10.357 23:06:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 [2024-11-26 23:06:36.494349] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:10.357 23:06:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.357 23:06:36 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:10.357 23:06:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 Malloc0 00:14:10.357 23:06:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.357 23:06:36 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:10.357 23:06:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 Malloc1 00:14:10.357 23:06:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.357 23:06:36 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:10.357 23:06:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 23:06:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.357 23:06:36 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:10.357 23:06:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 23:06:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.357 23:06:36 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:10.357 23:06:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 23:06:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.357 23:06:36 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:10.357 23:06:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 [2024-11-26 23:06:36.580449] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:10.357 23:06:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.357 23:06:36 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:10.357 23:06:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.357 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:14:10.357 23:06:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.357 23:06:36 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:10.617 00:14:10.617 Discovery Log Number of Records 2, Generation counter 2 00:14:10.617 =====Discovery Log Entry 0====== 00:14:10.617 trtype: tcp 00:14:10.617 adrfam: ipv4 00:14:10.617 subtype: current discovery subsystem 00:14:10.617 treq: not required 00:14:10.617 portid: 0 00:14:10.617 trsvcid: 4420 00:14:10.617 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:10.617 traddr: 10.0.0.2 00:14:10.617 eflags: explicit discovery connections, duplicate discovery information 00:14:10.617 sectype: none 00:14:10.617 =====Discovery Log Entry 1====== 00:14:10.617 trtype: tcp 00:14:10.617 adrfam: ipv4 00:14:10.617 subtype: nvme subsystem 00:14:10.617 treq: not required 00:14:10.617 portid: 0 00:14:10.617 trsvcid: 4420 00:14:10.617 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:10.617 traddr: 10.0.0.2 00:14:10.617 eflags: none 00:14:10.617 sectype: none 00:14:10.617 23:06:36 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:10.617 23:06:36 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:10.617 23:06:36 -- nvmf/common.sh@510 -- # local dev _ 00:14:10.617 23:06:36 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.617 23:06:36 -- nvmf/common.sh@509 -- # nvme list 00:14:10.617 23:06:36 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:10.617 23:06:36 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.617 23:06:36 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:10.617 23:06:36 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.617 23:06:36 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:10.617 23:06:36 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:11.189 23:06:37 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:11.189 23:06:37 -- common/autotest_common.sh@1187 -- # local i=0 00:14:11.189 23:06:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:11.189 23:06:37 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:11.189 23:06:37 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:11.189 23:06:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:13.092 23:06:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:13.092 23:06:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:13.092 23:06:39 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:13.092 23:06:39 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:13.092 23:06:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:13.092 23:06:39 -- common/autotest_common.sh@1197 -- # return 0 00:14:13.092 23:06:39 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:13.092 23:06:39 -- nvmf/common.sh@510 -- # local dev _ 00:14:13.092 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.092 23:06:39 -- nvmf/common.sh@509 -- # nvme list 00:14:13.349 23:06:39 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:13.349 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.349 23:06:39 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:13.350 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.350 23:06:39 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:13.350 23:06:39 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:13.350 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.350 23:06:39 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:13.350 23:06:39 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:13.350 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.350 23:06:39 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:13.350 /dev/nvme0n2 ]] 00:14:13.350 23:06:39 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:13.350 23:06:39 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:13.350 23:06:39 -- nvmf/common.sh@510 -- # local dev _ 00:14:13.350 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.350 23:06:39 -- nvmf/common.sh@509 -- # nvme list 00:14:13.608 23:06:39 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:13.608 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.608 23:06:39 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:13.608 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.608 23:06:39 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:13.608 23:06:39 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:13.608 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.608 23:06:39 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:13.608 23:06:39 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:13.608 23:06:39 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.608 23:06:39 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:13.608 23:06:39 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:13.608 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:13.608 23:06:39 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:13.608 23:06:39 -- common/autotest_common.sh@1208 -- # local i=0 00:14:13.608 23:06:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:13.608 23:06:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:13.608 23:06:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:13.608 23:06:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:13.868 23:06:40 -- common/autotest_common.sh@1220 -- # return 0 00:14:13.868 23:06:40 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:13.868 23:06:40 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:13.868 23:06:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.868 23:06:40 -- common/autotest_common.sh@10 -- # set +x 00:14:13.868 23:06:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.868 23:06:40 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:13.868 23:06:40 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:13.868 23:06:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:13.868 23:06:40 -- nvmf/common.sh@116 -- # sync 00:14:13.868 23:06:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:13.868 23:06:40 -- nvmf/common.sh@119 -- # set +e 00:14:13.868 23:06:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:13.868 23:06:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:13.868 rmmod nvme_tcp 00:14:13.868 rmmod nvme_fabrics 00:14:13.868 rmmod nvme_keyring 00:14:13.868 23:06:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:13.868 23:06:40 -- nvmf/common.sh@123 -- # set -e 00:14:13.868 23:06:40 -- nvmf/common.sh@124 -- # return 0 00:14:13.868 23:06:40 -- nvmf/common.sh@477 -- # '[' -n 178197 ']' 00:14:13.868 23:06:40 -- nvmf/common.sh@478 -- # killprocess 178197 00:14:13.868 23:06:40 -- common/autotest_common.sh@936 -- # '[' -z 178197 ']' 00:14:13.868 23:06:40 -- common/autotest_common.sh@940 -- # kill -0 178197 00:14:13.868 23:06:40 -- common/autotest_common.sh@941 -- # uname 00:14:13.868 23:06:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:13.868 23:06:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 178197 00:14:13.868 23:06:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:13.868 23:06:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:13.868 23:06:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 178197' 00:14:13.868 killing process with pid 178197 00:14:13.868 23:06:40 -- common/autotest_common.sh@955 -- # kill 178197 00:14:13.868 23:06:40 -- common/autotest_common.sh@960 -- # wait 178197 00:14:14.127 23:06:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:14.127 23:06:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:14.127 23:06:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:14.127 23:06:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:14.127 23:06:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:14.127 23:06:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:14.127 23:06:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:14.127 23:06:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:16.664 23:06:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:16.664 00:14:16.664 real 0m9.375s 00:14:16.664 user 0m19.832s 00:14:16.664 sys 0m2.314s 00:14:16.664 23:06:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:16.664 23:06:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.664 ************************************ 00:14:16.664 END TEST nvmf_nvme_cli 00:14:16.664 ************************************ 00:14:16.664 23:06:42 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:16.664 23:06:42 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:16.664 23:06:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:16.664 23:06:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:16.664 23:06:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.664 ************************************ 00:14:16.664 START TEST nvmf_host_management 00:14:16.664 ************************************ 00:14:16.664 23:06:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:16.664 * Looking for test storage... 00:14:16.664 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:16.664 23:06:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:16.664 23:06:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:16.664 23:06:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:16.664 23:06:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:16.664 23:06:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:16.664 23:06:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:16.664 23:06:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:16.664 23:06:42 -- scripts/common.sh@335 -- # IFS=.-: 00:14:16.664 23:06:42 -- scripts/common.sh@335 -- # read -ra ver1 00:14:16.664 23:06:42 -- scripts/common.sh@336 -- # IFS=.-: 00:14:16.664 23:06:42 -- scripts/common.sh@336 -- # read -ra ver2 00:14:16.664 23:06:42 -- scripts/common.sh@337 -- # local 'op=<' 00:14:16.664 23:06:42 -- scripts/common.sh@339 -- # ver1_l=2 00:14:16.664 23:06:42 -- scripts/common.sh@340 -- # ver2_l=1 00:14:16.664 23:06:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:16.664 23:06:42 -- scripts/common.sh@343 -- # case "$op" in 00:14:16.664 23:06:42 -- scripts/common.sh@344 -- # : 1 00:14:16.665 23:06:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:16.665 23:06:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:16.665 23:06:42 -- scripts/common.sh@364 -- # decimal 1 00:14:16.665 23:06:42 -- scripts/common.sh@352 -- # local d=1 00:14:16.665 23:06:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:16.665 23:06:42 -- scripts/common.sh@354 -- # echo 1 00:14:16.665 23:06:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:16.665 23:06:42 -- scripts/common.sh@365 -- # decimal 2 00:14:16.665 23:06:42 -- scripts/common.sh@352 -- # local d=2 00:14:16.665 23:06:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:16.665 23:06:42 -- scripts/common.sh@354 -- # echo 2 00:14:16.665 23:06:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:16.665 23:06:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:16.665 23:06:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:16.665 23:06:42 -- scripts/common.sh@367 -- # return 0 00:14:16.665 23:06:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:16.665 23:06:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:16.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:16.665 --rc genhtml_branch_coverage=1 00:14:16.665 --rc genhtml_function_coverage=1 00:14:16.665 --rc genhtml_legend=1 00:14:16.665 --rc geninfo_all_blocks=1 00:14:16.665 --rc geninfo_unexecuted_blocks=1 00:14:16.665 00:14:16.665 ' 00:14:16.665 23:06:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:16.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:16.665 --rc genhtml_branch_coverage=1 00:14:16.665 --rc genhtml_function_coverage=1 00:14:16.665 --rc genhtml_legend=1 00:14:16.665 --rc geninfo_all_blocks=1 00:14:16.665 --rc geninfo_unexecuted_blocks=1 00:14:16.665 00:14:16.665 ' 00:14:16.665 23:06:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:16.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:16.665 --rc genhtml_branch_coverage=1 00:14:16.665 --rc genhtml_function_coverage=1 00:14:16.665 --rc genhtml_legend=1 00:14:16.665 --rc geninfo_all_blocks=1 00:14:16.665 --rc geninfo_unexecuted_blocks=1 00:14:16.665 00:14:16.665 ' 00:14:16.665 23:06:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:16.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:16.665 --rc genhtml_branch_coverage=1 00:14:16.665 --rc genhtml_function_coverage=1 00:14:16.665 --rc genhtml_legend=1 00:14:16.665 --rc geninfo_all_blocks=1 00:14:16.665 --rc geninfo_unexecuted_blocks=1 00:14:16.665 00:14:16.665 ' 00:14:16.665 23:06:42 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:16.665 23:06:42 -- nvmf/common.sh@7 -- # uname -s 00:14:16.665 23:06:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:16.665 23:06:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:16.665 23:06:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:16.665 23:06:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:16.665 23:06:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:16.665 23:06:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:16.665 23:06:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:16.665 23:06:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:16.665 23:06:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:16.665 23:06:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:16.665 23:06:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:16.665 23:06:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:16.665 23:06:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:16.665 23:06:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:16.665 23:06:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:16.665 23:06:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:16.665 23:06:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:16.665 23:06:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:16.665 23:06:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:16.665 23:06:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:16.665 23:06:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:16.665 23:06:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:16.665 23:06:42 -- paths/export.sh@5 -- # export PATH 00:14:16.665 23:06:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:16.665 23:06:42 -- nvmf/common.sh@46 -- # : 0 00:14:16.665 23:06:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:16.665 23:06:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:16.665 23:06:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:16.665 23:06:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:16.665 23:06:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:16.665 23:06:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:16.665 23:06:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:16.665 23:06:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:16.665 23:06:42 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:16.665 23:06:42 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:16.665 23:06:42 -- target/host_management.sh@104 -- # nvmftestinit 00:14:16.665 23:06:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:16.665 23:06:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:16.665 23:06:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:16.665 23:06:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:16.665 23:06:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:16.665 23:06:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:16.665 23:06:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:16.665 23:06:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:16.665 23:06:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:16.665 23:06:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:16.665 23:06:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:16.665 23:06:42 -- common/autotest_common.sh@10 -- # set +x 00:14:18.569 23:06:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:18.569 23:06:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:18.569 23:06:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:18.569 23:06:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:18.569 23:06:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:18.569 23:06:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:18.569 23:06:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:18.569 23:06:44 -- nvmf/common.sh@294 -- # net_devs=() 00:14:18.569 23:06:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:18.569 23:06:44 -- nvmf/common.sh@295 -- # e810=() 00:14:18.569 23:06:44 -- nvmf/common.sh@295 -- # local -ga e810 00:14:18.569 23:06:44 -- nvmf/common.sh@296 -- # x722=() 00:14:18.569 23:06:44 -- nvmf/common.sh@296 -- # local -ga x722 00:14:18.569 23:06:44 -- nvmf/common.sh@297 -- # mlx=() 00:14:18.569 23:06:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:18.569 23:06:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:18.569 23:06:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:18.569 23:06:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:18.569 23:06:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:18.569 23:06:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:18.569 23:06:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:18.569 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:18.569 23:06:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:18.569 23:06:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:18.569 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:18.569 23:06:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:18.569 23:06:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:18.569 23:06:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:18.569 23:06:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:18.569 23:06:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:18.569 23:06:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:18.569 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:18.569 23:06:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:18.569 23:06:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:18.569 23:06:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:18.569 23:06:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:18.569 23:06:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:18.569 23:06:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:18.569 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:18.569 23:06:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:18.569 23:06:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:18.569 23:06:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:18.569 23:06:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:18.569 23:06:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:18.569 23:06:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:18.569 23:06:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:18.569 23:06:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:18.569 23:06:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:18.569 23:06:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:18.569 23:06:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:18.569 23:06:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:18.569 23:06:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:18.569 23:06:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:18.569 23:06:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:18.569 23:06:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:18.569 23:06:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:18.569 23:06:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:18.569 23:06:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:18.569 23:06:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:18.569 23:06:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:18.569 23:06:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:18.569 23:06:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:18.569 23:06:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:18.569 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:18.569 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.371 ms 00:14:18.569 00:14:18.569 --- 10.0.0.2 ping statistics --- 00:14:18.569 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:18.569 rtt min/avg/max/mdev = 0.371/0.371/0.371/0.000 ms 00:14:18.569 23:06:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:18.569 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:18.569 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:14:18.569 00:14:18.569 --- 10.0.0.1 ping statistics --- 00:14:18.569 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:18.569 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:14:18.569 23:06:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:18.569 23:06:44 -- nvmf/common.sh@410 -- # return 0 00:14:18.569 23:06:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:18.569 23:06:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:18.569 23:06:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:18.569 23:06:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:18.569 23:06:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:18.569 23:06:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:18.569 23:06:44 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:18.569 23:06:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:18.569 23:06:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:18.569 23:06:44 -- common/autotest_common.sh@10 -- # set +x 00:14:18.569 ************************************ 00:14:18.569 START TEST nvmf_host_management 00:14:18.569 ************************************ 00:14:18.569 23:06:44 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:18.569 23:06:44 -- target/host_management.sh@69 -- # starttarget 00:14:18.569 23:06:44 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:18.569 23:06:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:18.569 23:06:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:18.569 23:06:44 -- common/autotest_common.sh@10 -- # set +x 00:14:18.569 23:06:44 -- nvmf/common.sh@469 -- # nvmfpid=180748 00:14:18.569 23:06:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:18.569 23:06:44 -- nvmf/common.sh@470 -- # waitforlisten 180748 00:14:18.569 23:06:44 -- common/autotest_common.sh@829 -- # '[' -z 180748 ']' 00:14:18.569 23:06:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:18.569 23:06:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:18.569 23:06:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:18.569 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:18.569 23:06:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:18.569 23:06:44 -- common/autotest_common.sh@10 -- # set +x 00:14:18.828 [2024-11-26 23:06:44.971260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:18.828 [2024-11-26 23:06:44.971349] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:18.828 EAL: No free 2048 kB hugepages reported on node 1 00:14:18.828 [2024-11-26 23:06:45.037807] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:18.828 [2024-11-26 23:06:45.150726] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:18.828 [2024-11-26 23:06:45.150895] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:18.828 [2024-11-26 23:06:45.150914] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:18.828 [2024-11-26 23:06:45.150927] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:18.828 [2024-11-26 23:06:45.150992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:18.828 [2024-11-26 23:06:45.151014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:18.828 [2024-11-26 23:06:45.151138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:18.828 [2024-11-26 23:06:45.151141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:19.762 23:06:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:19.762 23:06:45 -- common/autotest_common.sh@862 -- # return 0 00:14:19.762 23:06:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:19.762 23:06:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:19.762 23:06:45 -- common/autotest_common.sh@10 -- # set +x 00:14:19.762 23:06:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:19.762 23:06:45 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:19.762 23:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.762 23:06:45 -- common/autotest_common.sh@10 -- # set +x 00:14:19.762 [2024-11-26 23:06:45.978136] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:19.762 23:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.762 23:06:45 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:19.762 23:06:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:19.762 23:06:45 -- common/autotest_common.sh@10 -- # set +x 00:14:19.762 23:06:45 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:19.762 23:06:45 -- target/host_management.sh@23 -- # cat 00:14:19.762 23:06:45 -- target/host_management.sh@30 -- # rpc_cmd 00:14:19.762 23:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.762 23:06:45 -- common/autotest_common.sh@10 -- # set +x 00:14:19.763 Malloc0 00:14:19.763 [2024-11-26 23:06:46.038709] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:19.763 23:06:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.763 23:06:46 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:19.763 23:06:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:19.763 23:06:46 -- common/autotest_common.sh@10 -- # set +x 00:14:19.763 23:06:46 -- target/host_management.sh@73 -- # perfpid=180935 00:14:19.763 23:06:46 -- target/host_management.sh@74 -- # waitforlisten 180935 /var/tmp/bdevperf.sock 00:14:19.763 23:06:46 -- common/autotest_common.sh@829 -- # '[' -z 180935 ']' 00:14:19.763 23:06:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:19.763 23:06:46 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:19.763 23:06:46 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:19.763 23:06:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:19.763 23:06:46 -- nvmf/common.sh@520 -- # config=() 00:14:19.763 23:06:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:19.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:19.763 23:06:46 -- nvmf/common.sh@520 -- # local subsystem config 00:14:19.763 23:06:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:19.763 23:06:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:19.763 23:06:46 -- common/autotest_common.sh@10 -- # set +x 00:14:19.763 23:06:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:19.763 { 00:14:19.763 "params": { 00:14:19.763 "name": "Nvme$subsystem", 00:14:19.763 "trtype": "$TEST_TRANSPORT", 00:14:19.763 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:19.763 "adrfam": "ipv4", 00:14:19.763 "trsvcid": "$NVMF_PORT", 00:14:19.763 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:19.763 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:19.763 "hdgst": ${hdgst:-false}, 00:14:19.763 "ddgst": ${ddgst:-false} 00:14:19.763 }, 00:14:19.763 "method": "bdev_nvme_attach_controller" 00:14:19.763 } 00:14:19.763 EOF 00:14:19.763 )") 00:14:19.763 23:06:46 -- nvmf/common.sh@542 -- # cat 00:14:19.763 23:06:46 -- nvmf/common.sh@544 -- # jq . 00:14:19.763 23:06:46 -- nvmf/common.sh@545 -- # IFS=, 00:14:19.763 23:06:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:19.763 "params": { 00:14:19.763 "name": "Nvme0", 00:14:19.763 "trtype": "tcp", 00:14:19.763 "traddr": "10.0.0.2", 00:14:19.763 "adrfam": "ipv4", 00:14:19.763 "trsvcid": "4420", 00:14:19.763 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:19.763 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:19.763 "hdgst": false, 00:14:19.763 "ddgst": false 00:14:19.763 }, 00:14:19.763 "method": "bdev_nvme_attach_controller" 00:14:19.763 }' 00:14:19.763 [2024-11-26 23:06:46.112449] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:19.763 [2024-11-26 23:06:46.112541] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid180935 ] 00:14:19.763 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.022 [2024-11-26 23:06:46.174106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:20.022 [2024-11-26 23:06:46.282217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:20.280 Running I/O for 10 seconds... 00:14:20.849 23:06:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:20.849 23:06:47 -- common/autotest_common.sh@862 -- # return 0 00:14:20.849 23:06:47 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:20.849 23:06:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.849 23:06:47 -- common/autotest_common.sh@10 -- # set +x 00:14:20.849 23:06:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.849 23:06:47 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:20.849 23:06:47 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:20.849 23:06:47 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:20.849 23:06:47 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:20.849 23:06:47 -- target/host_management.sh@52 -- # local ret=1 00:14:20.849 23:06:47 -- target/host_management.sh@53 -- # local i 00:14:20.849 23:06:47 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:20.849 23:06:47 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:20.849 23:06:47 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:20.849 23:06:47 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:20.849 23:06:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.849 23:06:47 -- common/autotest_common.sh@10 -- # set +x 00:14:20.849 23:06:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.849 23:06:47 -- target/host_management.sh@55 -- # read_io_count=1969 00:14:20.849 23:06:47 -- target/host_management.sh@58 -- # '[' 1969 -ge 100 ']' 00:14:20.849 23:06:47 -- target/host_management.sh@59 -- # ret=0 00:14:20.849 23:06:47 -- target/host_management.sh@60 -- # break 00:14:20.849 23:06:47 -- target/host_management.sh@64 -- # return 0 00:14:20.849 23:06:47 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:20.849 23:06:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.849 23:06:47 -- common/autotest_common.sh@10 -- # set +x 00:14:20.849 [2024-11-26 23:06:47.126439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x226ce60 is same with the state(5) to be set 00:14:20.849 [2024-11-26 23:06:47.129484] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:14:20.849 [2024-11-26 23:06:47.129537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:20.849 [2024-11-26 23:06:47.129572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:20.849 [2024-11-26 23:06:47.129616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:20.849 [2024-11-26 23:06:47.129644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa65160 is same with the state(5) to be set 00:14:20.849 [2024-11-26 23:06:47.129737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:9472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.129758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:9600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.129798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:9728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.129833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:9856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.129861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:10112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.129894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:10240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.129923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:4864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.129951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:10624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.129979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.129994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:10752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.130007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.130021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:10880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.849 [2024-11-26 23:06:47.130035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.849 [2024-11-26 23:06:47.130049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:11008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:11136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:11264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:11392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:11520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:11648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:11776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:11904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:12032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:12288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:12416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:12544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:12672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:12928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:13056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:13184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:13312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:13696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 23:06:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.850 [2024-11-26 23:06:47.130833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:14336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:14464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.130970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.130983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 23:06:47 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:20.850 [2024-11-26 23:06:47.130998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:14720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.131011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.131026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.131040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.131055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.131068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.131082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.131097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.131113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:6528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 23:06:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.850 [2024-11-26 23:06:47.131126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.131141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.131157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.850 [2024-11-26 23:06:47.131173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.850 [2024-11-26 23:06:47.131186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:6784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 23:06:47 -- common/autotest_common.sh@10 -- # set +x 00:14:20.851 [2024-11-26 23:06:47.131229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:15616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:6912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:15872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:7296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:7552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:7680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:7936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:8192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:8704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:9216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:20.851 [2024-11-26 23:06:47.131632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:20.851 [2024-11-26 23:06:47.131717] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xa63030 was disconnected and freed. reset controller. 00:14:20.851 [2024-11-26 23:06:47.132886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:20.851 task offset: 9472 on job bdev=Nvme0n1 fails 00:14:20.851 00:14:20.851 Latency(us) 00:14:20.851 [2024-11-26T22:06:47.245Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:20.851 [2024-11-26T22:06:47.245Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:20.851 [2024-11-26T22:06:47.245Z] Job: Nvme0n1 ended in about 0.55 seconds with error 00:14:20.851 Verification LBA range: start 0x0 length 0x400 00:14:20.851 Nvme0n1 : 0.55 3858.10 241.13 117.02 0.00 15839.64 2621.44 22816.24 00:14:20.851 [2024-11-26T22:06:47.245Z] =================================================================================================================== 00:14:20.851 [2024-11-26T22:06:47.245Z] Total : 3858.10 241.13 117.02 0.00 15839.64 2621.44 22816.24 00:14:20.851 [2024-11-26 23:06:47.134795] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:20.851 [2024-11-26 23:06:47.134824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa65160 (9): Bad file descriptor 00:14:20.851 23:06:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.851 23:06:47 -- target/host_management.sh@87 -- # sleep 1 00:14:20.851 [2024-11-26 23:06:47.145559] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:21.788 23:06:48 -- target/host_management.sh@91 -- # kill -9 180935 00:14:21.788 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (180935) - No such process 00:14:21.788 23:06:48 -- target/host_management.sh@91 -- # true 00:14:21.788 23:06:48 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:21.788 23:06:48 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:21.788 23:06:48 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:21.788 23:06:48 -- nvmf/common.sh@520 -- # config=() 00:14:21.788 23:06:48 -- nvmf/common.sh@520 -- # local subsystem config 00:14:21.788 23:06:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:21.788 23:06:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:21.788 { 00:14:21.788 "params": { 00:14:21.788 "name": "Nvme$subsystem", 00:14:21.788 "trtype": "$TEST_TRANSPORT", 00:14:21.788 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:21.788 "adrfam": "ipv4", 00:14:21.788 "trsvcid": "$NVMF_PORT", 00:14:21.788 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:21.788 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:21.788 "hdgst": ${hdgst:-false}, 00:14:21.788 "ddgst": ${ddgst:-false} 00:14:21.788 }, 00:14:21.788 "method": "bdev_nvme_attach_controller" 00:14:21.788 } 00:14:21.788 EOF 00:14:21.788 )") 00:14:21.788 23:06:48 -- nvmf/common.sh@542 -- # cat 00:14:21.788 23:06:48 -- nvmf/common.sh@544 -- # jq . 00:14:21.788 23:06:48 -- nvmf/common.sh@545 -- # IFS=, 00:14:21.788 23:06:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:21.788 "params": { 00:14:21.788 "name": "Nvme0", 00:14:21.788 "trtype": "tcp", 00:14:21.788 "traddr": "10.0.0.2", 00:14:21.788 "adrfam": "ipv4", 00:14:21.788 "trsvcid": "4420", 00:14:21.788 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:21.788 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:21.788 "hdgst": false, 00:14:21.788 "ddgst": false 00:14:21.788 }, 00:14:21.788 "method": "bdev_nvme_attach_controller" 00:14:21.788 }' 00:14:22.046 [2024-11-26 23:06:48.182538] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:22.046 [2024-11-26 23:06:48.182618] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid181223 ] 00:14:22.046 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.046 [2024-11-26 23:06:48.241969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:22.046 [2024-11-26 23:06:48.348447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:22.305 Running I/O for 1 seconds... 00:14:23.241 00:14:23.241 Latency(us) 00:14:23.241 [2024-11-26T22:06:49.635Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:23.241 [2024-11-26T22:06:49.635Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:23.241 Verification LBA range: start 0x0 length 0x400 00:14:23.241 Nvme0n1 : 1.01 3927.25 245.45 0.00 0.00 16035.70 1025.52 22622.06 00:14:23.241 [2024-11-26T22:06:49.635Z] =================================================================================================================== 00:14:23.241 [2024-11-26T22:06:49.635Z] Total : 3927.25 245.45 0.00 0.00 16035.70 1025.52 22622.06 00:14:23.499 23:06:49 -- target/host_management.sh@101 -- # stoptarget 00:14:23.499 23:06:49 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:23.499 23:06:49 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:23.499 23:06:49 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:23.499 23:06:49 -- target/host_management.sh@40 -- # nvmftestfini 00:14:23.499 23:06:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:23.499 23:06:49 -- nvmf/common.sh@116 -- # sync 00:14:23.499 23:06:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:23.499 23:06:49 -- nvmf/common.sh@119 -- # set +e 00:14:23.499 23:06:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:23.499 23:06:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:23.499 rmmod nvme_tcp 00:14:23.499 rmmod nvme_fabrics 00:14:23.499 rmmod nvme_keyring 00:14:23.499 23:06:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:23.499 23:06:49 -- nvmf/common.sh@123 -- # set -e 00:14:23.499 23:06:49 -- nvmf/common.sh@124 -- # return 0 00:14:23.499 23:06:49 -- nvmf/common.sh@477 -- # '[' -n 180748 ']' 00:14:23.499 23:06:49 -- nvmf/common.sh@478 -- # killprocess 180748 00:14:23.499 23:06:49 -- common/autotest_common.sh@936 -- # '[' -z 180748 ']' 00:14:23.499 23:06:49 -- common/autotest_common.sh@940 -- # kill -0 180748 00:14:23.499 23:06:49 -- common/autotest_common.sh@941 -- # uname 00:14:23.499 23:06:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:23.499 23:06:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 180748 00:14:23.499 23:06:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:23.499 23:06:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:23.499 23:06:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 180748' 00:14:23.499 killing process with pid 180748 00:14:23.499 23:06:49 -- common/autotest_common.sh@955 -- # kill 180748 00:14:23.499 23:06:49 -- common/autotest_common.sh@960 -- # wait 180748 00:14:23.758 [2024-11-26 23:06:50.137182] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:24.019 23:06:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:24.019 23:06:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:24.019 23:06:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:24.019 23:06:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:24.019 23:06:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:24.019 23:06:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.019 23:06:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.019 23:06:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:25.923 23:06:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:25.923 00:14:25.923 real 0m7.284s 00:14:25.923 user 0m22.580s 00:14:25.923 sys 0m1.298s 00:14:25.923 23:06:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:25.923 23:06:52 -- common/autotest_common.sh@10 -- # set +x 00:14:25.923 ************************************ 00:14:25.923 END TEST nvmf_host_management 00:14:25.923 ************************************ 00:14:25.923 23:06:52 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:25.923 00:14:25.923 real 0m9.719s 00:14:25.923 user 0m23.481s 00:14:25.923 sys 0m2.860s 00:14:25.923 23:06:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:25.923 23:06:52 -- common/autotest_common.sh@10 -- # set +x 00:14:25.923 ************************************ 00:14:25.923 END TEST nvmf_host_management 00:14:25.923 ************************************ 00:14:25.923 23:06:52 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:25.923 23:06:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:25.923 23:06:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:25.923 23:06:52 -- common/autotest_common.sh@10 -- # set +x 00:14:25.923 ************************************ 00:14:25.923 START TEST nvmf_lvol 00:14:25.923 ************************************ 00:14:25.923 23:06:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:25.923 * Looking for test storage... 00:14:26.182 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:26.182 23:06:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:26.182 23:06:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:26.182 23:06:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:26.182 23:06:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:26.182 23:06:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:26.182 23:06:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:26.182 23:06:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:26.182 23:06:52 -- scripts/common.sh@335 -- # IFS=.-: 00:14:26.182 23:06:52 -- scripts/common.sh@335 -- # read -ra ver1 00:14:26.182 23:06:52 -- scripts/common.sh@336 -- # IFS=.-: 00:14:26.182 23:06:52 -- scripts/common.sh@336 -- # read -ra ver2 00:14:26.182 23:06:52 -- scripts/common.sh@337 -- # local 'op=<' 00:14:26.182 23:06:52 -- scripts/common.sh@339 -- # ver1_l=2 00:14:26.182 23:06:52 -- scripts/common.sh@340 -- # ver2_l=1 00:14:26.182 23:06:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:26.182 23:06:52 -- scripts/common.sh@343 -- # case "$op" in 00:14:26.182 23:06:52 -- scripts/common.sh@344 -- # : 1 00:14:26.182 23:06:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:26.182 23:06:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:26.182 23:06:52 -- scripts/common.sh@364 -- # decimal 1 00:14:26.182 23:06:52 -- scripts/common.sh@352 -- # local d=1 00:14:26.182 23:06:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:26.182 23:06:52 -- scripts/common.sh@354 -- # echo 1 00:14:26.182 23:06:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:26.182 23:06:52 -- scripts/common.sh@365 -- # decimal 2 00:14:26.182 23:06:52 -- scripts/common.sh@352 -- # local d=2 00:14:26.182 23:06:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:26.182 23:06:52 -- scripts/common.sh@354 -- # echo 2 00:14:26.182 23:06:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:26.182 23:06:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:26.182 23:06:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:26.182 23:06:52 -- scripts/common.sh@367 -- # return 0 00:14:26.182 23:06:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:26.182 23:06:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:26.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.182 --rc genhtml_branch_coverage=1 00:14:26.182 --rc genhtml_function_coverage=1 00:14:26.182 --rc genhtml_legend=1 00:14:26.182 --rc geninfo_all_blocks=1 00:14:26.182 --rc geninfo_unexecuted_blocks=1 00:14:26.182 00:14:26.182 ' 00:14:26.182 23:06:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:26.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.182 --rc genhtml_branch_coverage=1 00:14:26.182 --rc genhtml_function_coverage=1 00:14:26.182 --rc genhtml_legend=1 00:14:26.182 --rc geninfo_all_blocks=1 00:14:26.182 --rc geninfo_unexecuted_blocks=1 00:14:26.182 00:14:26.182 ' 00:14:26.182 23:06:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:26.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.182 --rc genhtml_branch_coverage=1 00:14:26.182 --rc genhtml_function_coverage=1 00:14:26.182 --rc genhtml_legend=1 00:14:26.182 --rc geninfo_all_blocks=1 00:14:26.182 --rc geninfo_unexecuted_blocks=1 00:14:26.182 00:14:26.182 ' 00:14:26.182 23:06:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:26.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.182 --rc genhtml_branch_coverage=1 00:14:26.182 --rc genhtml_function_coverage=1 00:14:26.182 --rc genhtml_legend=1 00:14:26.182 --rc geninfo_all_blocks=1 00:14:26.182 --rc geninfo_unexecuted_blocks=1 00:14:26.182 00:14:26.182 ' 00:14:26.182 23:06:52 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:26.182 23:06:52 -- nvmf/common.sh@7 -- # uname -s 00:14:26.182 23:06:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:26.182 23:06:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:26.182 23:06:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:26.182 23:06:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:26.182 23:06:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:26.182 23:06:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:26.182 23:06:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:26.182 23:06:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:26.182 23:06:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:26.182 23:06:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:26.182 23:06:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:26.182 23:06:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:26.182 23:06:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:26.182 23:06:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:26.182 23:06:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:26.182 23:06:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:26.182 23:06:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:26.182 23:06:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:26.182 23:06:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:26.182 23:06:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.182 23:06:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.182 23:06:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.182 23:06:52 -- paths/export.sh@5 -- # export PATH 00:14:26.182 23:06:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.182 23:06:52 -- nvmf/common.sh@46 -- # : 0 00:14:26.182 23:06:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:26.182 23:06:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:26.182 23:06:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:26.182 23:06:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:26.182 23:06:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:26.182 23:06:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:26.182 23:06:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:26.182 23:06:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:26.182 23:06:52 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:26.182 23:06:52 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:26.182 23:06:52 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:26.182 23:06:52 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:26.182 23:06:52 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:26.182 23:06:52 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:26.182 23:06:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:26.182 23:06:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:26.182 23:06:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:26.182 23:06:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:26.182 23:06:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:26.182 23:06:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:26.182 23:06:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:26.182 23:06:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:26.182 23:06:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:26.182 23:06:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:26.182 23:06:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:26.182 23:06:52 -- common/autotest_common.sh@10 -- # set +x 00:14:28.086 23:06:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:28.086 23:06:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:28.086 23:06:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:28.086 23:06:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:28.086 23:06:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:28.086 23:06:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:28.086 23:06:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:28.086 23:06:54 -- nvmf/common.sh@294 -- # net_devs=() 00:14:28.086 23:06:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:28.086 23:06:54 -- nvmf/common.sh@295 -- # e810=() 00:14:28.086 23:06:54 -- nvmf/common.sh@295 -- # local -ga e810 00:14:28.086 23:06:54 -- nvmf/common.sh@296 -- # x722=() 00:14:28.086 23:06:54 -- nvmf/common.sh@296 -- # local -ga x722 00:14:28.086 23:06:54 -- nvmf/common.sh@297 -- # mlx=() 00:14:28.086 23:06:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:28.086 23:06:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:28.086 23:06:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:28.086 23:06:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:28.086 23:06:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:28.086 23:06:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:28.086 23:06:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:28.086 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:28.086 23:06:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:28.086 23:06:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:28.086 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:28.086 23:06:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:28.086 23:06:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:28.086 23:06:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:28.086 23:06:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:28.086 23:06:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:28.086 23:06:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:28.086 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:28.086 23:06:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:28.086 23:06:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:28.086 23:06:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:28.086 23:06:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:28.086 23:06:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:28.086 23:06:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:28.086 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:28.086 23:06:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:28.086 23:06:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:28.086 23:06:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:28.086 23:06:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:28.086 23:06:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:28.086 23:06:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:28.086 23:06:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:28.086 23:06:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:28.086 23:06:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:28.086 23:06:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:28.086 23:06:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:28.086 23:06:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:28.086 23:06:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:28.086 23:06:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:28.086 23:06:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:28.086 23:06:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:28.086 23:06:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:28.086 23:06:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:28.346 23:06:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:28.346 23:06:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:28.346 23:06:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:28.346 23:06:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:28.346 23:06:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:28.346 23:06:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:28.346 23:06:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:28.346 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:28.346 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.281 ms 00:14:28.346 00:14:28.346 --- 10.0.0.2 ping statistics --- 00:14:28.346 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:28.346 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:14:28.346 23:06:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:28.346 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:28.346 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:14:28.346 00:14:28.346 --- 10.0.0.1 ping statistics --- 00:14:28.346 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:28.346 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:14:28.346 23:06:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:28.346 23:06:54 -- nvmf/common.sh@410 -- # return 0 00:14:28.346 23:06:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:28.346 23:06:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:28.346 23:06:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:28.346 23:06:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:28.346 23:06:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:28.346 23:06:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:28.346 23:06:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:28.346 23:06:54 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:28.346 23:06:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:28.346 23:06:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:28.346 23:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:28.346 23:06:54 -- nvmf/common.sh@469 -- # nvmfpid=183451 00:14:28.346 23:06:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:28.346 23:06:54 -- nvmf/common.sh@470 -- # waitforlisten 183451 00:14:28.346 23:06:54 -- common/autotest_common.sh@829 -- # '[' -z 183451 ']' 00:14:28.346 23:06:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:28.346 23:06:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:28.346 23:06:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:28.346 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:28.346 23:06:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:28.346 23:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:28.346 [2024-11-26 23:06:54.676627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:28.346 [2024-11-26 23:06:54.676719] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:28.346 EAL: No free 2048 kB hugepages reported on node 1 00:14:28.606 [2024-11-26 23:06:54.742405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:28.606 [2024-11-26 23:06:54.852063] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:28.606 [2024-11-26 23:06:54.852239] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:28.606 [2024-11-26 23:06:54.852256] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:28.606 [2024-11-26 23:06:54.852269] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:28.606 [2024-11-26 23:06:54.852334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:28.606 [2024-11-26 23:06:54.852425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:28.606 [2024-11-26 23:06:54.852444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:29.542 23:06:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:29.542 23:06:55 -- common/autotest_common.sh@862 -- # return 0 00:14:29.542 23:06:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:29.542 23:06:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:29.542 23:06:55 -- common/autotest_common.sh@10 -- # set +x 00:14:29.542 23:06:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:29.542 23:06:55 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:29.542 [2024-11-26 23:06:55.903861] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:29.543 23:06:55 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:30.110 23:06:56 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:30.110 23:06:56 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:30.110 23:06:56 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:30.110 23:06:56 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:30.369 23:06:56 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:30.627 23:06:57 -- target/nvmf_lvol.sh@29 -- # lvs=91099548-c02e-4dbc-a6ee-9a69aadaa436 00:14:30.627 23:06:57 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 91099548-c02e-4dbc-a6ee-9a69aadaa436 lvol 20 00:14:30.885 23:06:57 -- target/nvmf_lvol.sh@32 -- # lvol=178a26d4-495f-4a5d-a1b0-d6a7bd050a30 00:14:30.885 23:06:57 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:31.143 23:06:57 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 178a26d4-495f-4a5d-a1b0-d6a7bd050a30 00:14:31.401 23:06:57 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:31.660 [2024-11-26 23:06:57.988354] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:31.660 23:06:58 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:31.918 23:06:58 -- target/nvmf_lvol.sh@42 -- # perf_pid=183903 00:14:31.918 23:06:58 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:31.918 23:06:58 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:31.918 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.295 23:06:59 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 178a26d4-495f-4a5d-a1b0-d6a7bd050a30 MY_SNAPSHOT 00:14:33.295 23:06:59 -- target/nvmf_lvol.sh@47 -- # snapshot=1d29c967-8e8e-4a80-8035-18c3141c7580 00:14:33.295 23:06:59 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 178a26d4-495f-4a5d-a1b0-d6a7bd050a30 30 00:14:33.553 23:06:59 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 1d29c967-8e8e-4a80-8035-18c3141c7580 MY_CLONE 00:14:33.811 23:07:00 -- target/nvmf_lvol.sh@49 -- # clone=11d028ab-431a-4e1b-b8d1-593408436e57 00:14:33.811 23:07:00 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 11d028ab-431a-4e1b-b8d1-593408436e57 00:14:34.380 23:07:00 -- target/nvmf_lvol.sh@53 -- # wait 183903 00:14:42.507 Initializing NVMe Controllers 00:14:42.507 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:42.507 Controller IO queue size 128, less than required. 00:14:42.507 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:42.507 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:42.507 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:42.507 Initialization complete. Launching workers. 00:14:42.507 ======================================================== 00:14:42.507 Latency(us) 00:14:42.507 Device Information : IOPS MiB/s Average min max 00:14:42.507 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10944.60 42.75 11700.37 817.12 117724.13 00:14:42.507 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10843.20 42.36 11811.20 1838.04 68410.40 00:14:42.507 ======================================================== 00:14:42.507 Total : 21787.80 85.11 11755.52 817.12 117724.13 00:14:42.507 00:14:42.507 23:07:08 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:42.765 23:07:09 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 178a26d4-495f-4a5d-a1b0-d6a7bd050a30 00:14:43.023 23:07:09 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 91099548-c02e-4dbc-a6ee-9a69aadaa436 00:14:43.280 23:07:09 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:43.538 23:07:09 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:43.538 23:07:09 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:43.538 23:07:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:43.538 23:07:09 -- nvmf/common.sh@116 -- # sync 00:14:43.538 23:07:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:43.538 23:07:09 -- nvmf/common.sh@119 -- # set +e 00:14:43.538 23:07:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:43.538 23:07:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:43.538 rmmod nvme_tcp 00:14:43.538 rmmod nvme_fabrics 00:14:43.538 rmmod nvme_keyring 00:14:43.538 23:07:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:43.538 23:07:09 -- nvmf/common.sh@123 -- # set -e 00:14:43.538 23:07:09 -- nvmf/common.sh@124 -- # return 0 00:14:43.538 23:07:09 -- nvmf/common.sh@477 -- # '[' -n 183451 ']' 00:14:43.538 23:07:09 -- nvmf/common.sh@478 -- # killprocess 183451 00:14:43.538 23:07:09 -- common/autotest_common.sh@936 -- # '[' -z 183451 ']' 00:14:43.538 23:07:09 -- common/autotest_common.sh@940 -- # kill -0 183451 00:14:43.538 23:07:09 -- common/autotest_common.sh@941 -- # uname 00:14:43.538 23:07:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:43.538 23:07:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 183451 00:14:43.538 23:07:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:43.538 23:07:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:43.538 23:07:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 183451' 00:14:43.538 killing process with pid 183451 00:14:43.538 23:07:09 -- common/autotest_common.sh@955 -- # kill 183451 00:14:43.538 23:07:09 -- common/autotest_common.sh@960 -- # wait 183451 00:14:43.797 23:07:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:43.797 23:07:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:43.797 23:07:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:43.797 23:07:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:43.797 23:07:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:43.797 23:07:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:43.797 23:07:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:43.797 23:07:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:46.332 23:07:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:46.332 00:14:46.333 real 0m19.872s 00:14:46.333 user 1m7.252s 00:14:46.333 sys 0m5.622s 00:14:46.333 23:07:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:46.333 23:07:12 -- common/autotest_common.sh@10 -- # set +x 00:14:46.333 ************************************ 00:14:46.333 END TEST nvmf_lvol 00:14:46.333 ************************************ 00:14:46.333 23:07:12 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:46.333 23:07:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:46.333 23:07:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:46.333 23:07:12 -- common/autotest_common.sh@10 -- # set +x 00:14:46.333 ************************************ 00:14:46.333 START TEST nvmf_lvs_grow 00:14:46.333 ************************************ 00:14:46.333 23:07:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:46.333 * Looking for test storage... 00:14:46.333 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:46.333 23:07:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:46.333 23:07:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:46.333 23:07:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:46.333 23:07:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:46.333 23:07:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:46.333 23:07:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:46.333 23:07:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:46.333 23:07:12 -- scripts/common.sh@335 -- # IFS=.-: 00:14:46.333 23:07:12 -- scripts/common.sh@335 -- # read -ra ver1 00:14:46.333 23:07:12 -- scripts/common.sh@336 -- # IFS=.-: 00:14:46.333 23:07:12 -- scripts/common.sh@336 -- # read -ra ver2 00:14:46.333 23:07:12 -- scripts/common.sh@337 -- # local 'op=<' 00:14:46.333 23:07:12 -- scripts/common.sh@339 -- # ver1_l=2 00:14:46.333 23:07:12 -- scripts/common.sh@340 -- # ver2_l=1 00:14:46.333 23:07:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:46.333 23:07:12 -- scripts/common.sh@343 -- # case "$op" in 00:14:46.333 23:07:12 -- scripts/common.sh@344 -- # : 1 00:14:46.333 23:07:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:46.333 23:07:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:46.333 23:07:12 -- scripts/common.sh@364 -- # decimal 1 00:14:46.333 23:07:12 -- scripts/common.sh@352 -- # local d=1 00:14:46.333 23:07:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:46.333 23:07:12 -- scripts/common.sh@354 -- # echo 1 00:14:46.333 23:07:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:46.333 23:07:12 -- scripts/common.sh@365 -- # decimal 2 00:14:46.333 23:07:12 -- scripts/common.sh@352 -- # local d=2 00:14:46.333 23:07:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:46.333 23:07:12 -- scripts/common.sh@354 -- # echo 2 00:14:46.333 23:07:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:46.333 23:07:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:46.333 23:07:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:46.333 23:07:12 -- scripts/common.sh@367 -- # return 0 00:14:46.333 23:07:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:46.333 23:07:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:46.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:46.333 --rc genhtml_branch_coverage=1 00:14:46.333 --rc genhtml_function_coverage=1 00:14:46.333 --rc genhtml_legend=1 00:14:46.333 --rc geninfo_all_blocks=1 00:14:46.333 --rc geninfo_unexecuted_blocks=1 00:14:46.333 00:14:46.333 ' 00:14:46.333 23:07:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:46.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:46.333 --rc genhtml_branch_coverage=1 00:14:46.333 --rc genhtml_function_coverage=1 00:14:46.333 --rc genhtml_legend=1 00:14:46.333 --rc geninfo_all_blocks=1 00:14:46.333 --rc geninfo_unexecuted_blocks=1 00:14:46.333 00:14:46.333 ' 00:14:46.333 23:07:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:46.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:46.333 --rc genhtml_branch_coverage=1 00:14:46.333 --rc genhtml_function_coverage=1 00:14:46.333 --rc genhtml_legend=1 00:14:46.333 --rc geninfo_all_blocks=1 00:14:46.333 --rc geninfo_unexecuted_blocks=1 00:14:46.333 00:14:46.333 ' 00:14:46.333 23:07:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:46.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:46.333 --rc genhtml_branch_coverage=1 00:14:46.333 --rc genhtml_function_coverage=1 00:14:46.333 --rc genhtml_legend=1 00:14:46.333 --rc geninfo_all_blocks=1 00:14:46.333 --rc geninfo_unexecuted_blocks=1 00:14:46.333 00:14:46.333 ' 00:14:46.333 23:07:12 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:46.333 23:07:12 -- nvmf/common.sh@7 -- # uname -s 00:14:46.333 23:07:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:46.333 23:07:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:46.333 23:07:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:46.333 23:07:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:46.333 23:07:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:46.333 23:07:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:46.333 23:07:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:46.333 23:07:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:46.333 23:07:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:46.333 23:07:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:46.333 23:07:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:46.333 23:07:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:46.333 23:07:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:46.333 23:07:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:46.333 23:07:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:46.333 23:07:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:46.333 23:07:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:46.333 23:07:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:46.333 23:07:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:46.333 23:07:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:46.333 23:07:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:46.333 23:07:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:46.333 23:07:12 -- paths/export.sh@5 -- # export PATH 00:14:46.333 23:07:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:46.333 23:07:12 -- nvmf/common.sh@46 -- # : 0 00:14:46.333 23:07:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:46.333 23:07:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:46.333 23:07:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:46.333 23:07:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:46.333 23:07:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:46.333 23:07:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:46.333 23:07:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:46.333 23:07:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:46.333 23:07:12 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:46.333 23:07:12 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:46.333 23:07:12 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:46.333 23:07:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:46.333 23:07:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:46.333 23:07:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:46.333 23:07:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:46.333 23:07:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:46.333 23:07:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:46.333 23:07:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:46.333 23:07:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:46.333 23:07:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:46.333 23:07:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:46.333 23:07:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:46.333 23:07:12 -- common/autotest_common.sh@10 -- # set +x 00:14:48.235 23:07:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:48.235 23:07:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:48.235 23:07:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:48.235 23:07:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:48.235 23:07:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:48.235 23:07:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:48.235 23:07:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:48.235 23:07:14 -- nvmf/common.sh@294 -- # net_devs=() 00:14:48.235 23:07:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:48.235 23:07:14 -- nvmf/common.sh@295 -- # e810=() 00:14:48.235 23:07:14 -- nvmf/common.sh@295 -- # local -ga e810 00:14:48.235 23:07:14 -- nvmf/common.sh@296 -- # x722=() 00:14:48.235 23:07:14 -- nvmf/common.sh@296 -- # local -ga x722 00:14:48.235 23:07:14 -- nvmf/common.sh@297 -- # mlx=() 00:14:48.235 23:07:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:48.235 23:07:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:48.235 23:07:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:48.235 23:07:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:48.235 23:07:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:48.235 23:07:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:48.235 23:07:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:48.235 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:48.235 23:07:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:48.235 23:07:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:48.235 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:48.235 23:07:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:48.235 23:07:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:48.235 23:07:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.235 23:07:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:48.235 23:07:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.235 23:07:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:48.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:48.235 23:07:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.235 23:07:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:48.235 23:07:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.235 23:07:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:48.235 23:07:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.235 23:07:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:48.235 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:48.235 23:07:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.235 23:07:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:48.235 23:07:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:48.235 23:07:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:48.235 23:07:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:48.235 23:07:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:48.235 23:07:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:48.235 23:07:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:48.235 23:07:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:48.235 23:07:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:48.235 23:07:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:48.235 23:07:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:48.236 23:07:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:48.236 23:07:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:48.236 23:07:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:48.236 23:07:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:48.236 23:07:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:48.236 23:07:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:48.236 23:07:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:48.236 23:07:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:48.236 23:07:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:48.236 23:07:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:48.236 23:07:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:48.236 23:07:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:48.236 23:07:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:48.236 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:48.236 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.317 ms 00:14:48.236 00:14:48.236 --- 10.0.0.2 ping statistics --- 00:14:48.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:48.236 rtt min/avg/max/mdev = 0.317/0.317/0.317/0.000 ms 00:14:48.236 23:07:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:48.236 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:48.236 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:14:48.236 00:14:48.236 --- 10.0.0.1 ping statistics --- 00:14:48.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:48.236 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:14:48.236 23:07:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:48.236 23:07:14 -- nvmf/common.sh@410 -- # return 0 00:14:48.236 23:07:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:48.236 23:07:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:48.236 23:07:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:48.236 23:07:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:48.236 23:07:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:48.236 23:07:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:48.236 23:07:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:48.236 23:07:14 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:48.236 23:07:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:48.236 23:07:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:48.236 23:07:14 -- common/autotest_common.sh@10 -- # set +x 00:14:48.236 23:07:14 -- nvmf/common.sh@469 -- # nvmfpid=187226 00:14:48.236 23:07:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:48.236 23:07:14 -- nvmf/common.sh@470 -- # waitforlisten 187226 00:14:48.236 23:07:14 -- common/autotest_common.sh@829 -- # '[' -z 187226 ']' 00:14:48.236 23:07:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:48.236 23:07:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:48.236 23:07:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:48.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:48.236 23:07:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:48.236 23:07:14 -- common/autotest_common.sh@10 -- # set +x 00:14:48.236 [2024-11-26 23:07:14.608117] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:48.236 [2024-11-26 23:07:14.608208] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:48.494 EAL: No free 2048 kB hugepages reported on node 1 00:14:48.494 [2024-11-26 23:07:14.674210] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:48.494 [2024-11-26 23:07:14.785252] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:48.494 [2024-11-26 23:07:14.785412] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:48.494 [2024-11-26 23:07:14.785428] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:48.494 [2024-11-26 23:07:14.785440] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:48.494 [2024-11-26 23:07:14.785472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:49.428 23:07:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:49.428 23:07:15 -- common/autotest_common.sh@862 -- # return 0 00:14:49.428 23:07:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:49.428 23:07:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:49.428 23:07:15 -- common/autotest_common.sh@10 -- # set +x 00:14:49.428 23:07:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:49.428 23:07:15 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:49.687 [2024-11-26 23:07:15.877240] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:49.687 23:07:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:49.687 23:07:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:49.687 23:07:15 -- common/autotest_common.sh@10 -- # set +x 00:14:49.687 ************************************ 00:14:49.687 START TEST lvs_grow_clean 00:14:49.687 ************************************ 00:14:49.687 23:07:15 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:49.687 23:07:15 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:49.944 23:07:16 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:49.945 23:07:16 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:50.202 23:07:16 -- target/nvmf_lvs_grow.sh@28 -- # lvs=9f63465e-3589-4634-bd00-9fbd3f684f11 00:14:50.202 23:07:16 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:14:50.202 23:07:16 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:50.459 23:07:16 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:50.459 23:07:16 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:50.459 23:07:16 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 9f63465e-3589-4634-bd00-9fbd3f684f11 lvol 150 00:14:50.718 23:07:16 -- target/nvmf_lvs_grow.sh@33 -- # lvol=268ab298-41c1-4712-b93a-5b6e9a7c83a4 00:14:50.718 23:07:16 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:50.718 23:07:16 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:50.976 [2024-11-26 23:07:17.185784] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:50.976 [2024-11-26 23:07:17.185909] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:50.976 true 00:14:50.976 23:07:17 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:14:50.976 23:07:17 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:51.234 23:07:17 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:51.234 23:07:17 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:51.492 23:07:17 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 268ab298-41c1-4712-b93a-5b6e9a7c83a4 00:14:51.750 23:07:17 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:52.008 [2024-11-26 23:07:18.204959] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:52.008 23:07:18 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:52.266 23:07:18 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=187806 00:14:52.266 23:07:18 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:52.266 23:07:18 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:52.266 23:07:18 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 187806 /var/tmp/bdevperf.sock 00:14:52.266 23:07:18 -- common/autotest_common.sh@829 -- # '[' -z 187806 ']' 00:14:52.266 23:07:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:52.266 23:07:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:52.266 23:07:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:52.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:52.266 23:07:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:52.266 23:07:18 -- common/autotest_common.sh@10 -- # set +x 00:14:52.266 [2024-11-26 23:07:18.514154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:52.266 [2024-11-26 23:07:18.514221] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid187806 ] 00:14:52.266 EAL: No free 2048 kB hugepages reported on node 1 00:14:52.266 [2024-11-26 23:07:18.576293] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:52.524 [2024-11-26 23:07:18.691782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:53.457 23:07:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:53.457 23:07:19 -- common/autotest_common.sh@862 -- # return 0 00:14:53.457 23:07:19 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:53.457 Nvme0n1 00:14:53.457 23:07:19 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:53.716 [ 00:14:53.716 { 00:14:53.716 "name": "Nvme0n1", 00:14:53.716 "aliases": [ 00:14:53.716 "268ab298-41c1-4712-b93a-5b6e9a7c83a4" 00:14:53.716 ], 00:14:53.716 "product_name": "NVMe disk", 00:14:53.716 "block_size": 4096, 00:14:53.716 "num_blocks": 38912, 00:14:53.716 "uuid": "268ab298-41c1-4712-b93a-5b6e9a7c83a4", 00:14:53.716 "assigned_rate_limits": { 00:14:53.716 "rw_ios_per_sec": 0, 00:14:53.716 "rw_mbytes_per_sec": 0, 00:14:53.716 "r_mbytes_per_sec": 0, 00:14:53.716 "w_mbytes_per_sec": 0 00:14:53.716 }, 00:14:53.716 "claimed": false, 00:14:53.716 "zoned": false, 00:14:53.716 "supported_io_types": { 00:14:53.716 "read": true, 00:14:53.716 "write": true, 00:14:53.716 "unmap": true, 00:14:53.716 "write_zeroes": true, 00:14:53.716 "flush": true, 00:14:53.716 "reset": true, 00:14:53.716 "compare": true, 00:14:53.716 "compare_and_write": true, 00:14:53.716 "abort": true, 00:14:53.716 "nvme_admin": true, 00:14:53.716 "nvme_io": true 00:14:53.716 }, 00:14:53.716 "driver_specific": { 00:14:53.716 "nvme": [ 00:14:53.716 { 00:14:53.716 "trid": { 00:14:53.716 "trtype": "TCP", 00:14:53.716 "adrfam": "IPv4", 00:14:53.716 "traddr": "10.0.0.2", 00:14:53.716 "trsvcid": "4420", 00:14:53.716 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:53.716 }, 00:14:53.716 "ctrlr_data": { 00:14:53.716 "cntlid": 1, 00:14:53.716 "vendor_id": "0x8086", 00:14:53.716 "model_number": "SPDK bdev Controller", 00:14:53.716 "serial_number": "SPDK0", 00:14:53.716 "firmware_revision": "24.01.1", 00:14:53.716 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:53.716 "oacs": { 00:14:53.716 "security": 0, 00:14:53.716 "format": 0, 00:14:53.716 "firmware": 0, 00:14:53.716 "ns_manage": 0 00:14:53.716 }, 00:14:53.716 "multi_ctrlr": true, 00:14:53.716 "ana_reporting": false 00:14:53.716 }, 00:14:53.716 "vs": { 00:14:53.716 "nvme_version": "1.3" 00:14:53.716 }, 00:14:53.716 "ns_data": { 00:14:53.716 "id": 1, 00:14:53.716 "can_share": true 00:14:53.716 } 00:14:53.716 } 00:14:53.716 ], 00:14:53.716 "mp_policy": "active_passive" 00:14:53.716 } 00:14:53.716 } 00:14:53.716 ] 00:14:53.716 23:07:20 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=187952 00:14:53.716 23:07:20 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:53.716 23:07:20 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:53.974 Running I/O for 10 seconds... 00:14:54.908 Latency(us) 00:14:54.908 [2024-11-26T22:07:21.302Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:54.908 [2024-11-26T22:07:21.302Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:54.908 Nvme0n1 : 1.00 14695.00 57.40 0.00 0.00 0.00 0.00 0.00 00:14:54.908 [2024-11-26T22:07:21.302Z] =================================================================================================================== 00:14:54.908 [2024-11-26T22:07:21.302Z] Total : 14695.00 57.40 0.00 0.00 0.00 0.00 0.00 00:14:54.908 00:14:55.844 23:07:22 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:14:55.844 [2024-11-26T22:07:22.238Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.844 Nvme0n1 : 2.00 14893.50 58.18 0.00 0.00 0.00 0.00 0.00 00:14:55.844 [2024-11-26T22:07:22.238Z] =================================================================================================================== 00:14:55.844 [2024-11-26T22:07:22.238Z] Total : 14893.50 58.18 0.00 0.00 0.00 0.00 0.00 00:14:55.844 00:14:56.101 true 00:14:56.101 23:07:22 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:14:56.101 23:07:22 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:56.360 23:07:22 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:56.360 23:07:22 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:56.360 23:07:22 -- target/nvmf_lvs_grow.sh@65 -- # wait 187952 00:14:56.927 [2024-11-26T22:07:23.321Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.927 Nvme0n1 : 3.00 15015.00 58.65 0.00 0.00 0.00 0.00 0.00 00:14:56.927 [2024-11-26T22:07:23.321Z] =================================================================================================================== 00:14:56.927 [2024-11-26T22:07:23.321Z] Total : 15015.00 58.65 0.00 0.00 0.00 0.00 0.00 00:14:56.927 00:14:57.863 [2024-11-26T22:07:24.257Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.863 Nvme0n1 : 4.00 15106.25 59.01 0.00 0.00 0.00 0.00 0.00 00:14:57.863 [2024-11-26T22:07:24.257Z] =================================================================================================================== 00:14:57.863 [2024-11-26T22:07:24.257Z] Total : 15106.25 59.01 0.00 0.00 0.00 0.00 0.00 00:14:57.863 00:14:59.238 [2024-11-26T22:07:25.632Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.238 Nvme0n1 : 5.00 15178.00 59.29 0.00 0.00 0.00 0.00 0.00 00:14:59.238 [2024-11-26T22:07:25.632Z] =================================================================================================================== 00:14:59.238 [2024-11-26T22:07:25.632Z] Total : 15178.00 59.29 0.00 0.00 0.00 0.00 0.00 00:14:59.238 00:15:00.172 [2024-11-26T22:07:26.566Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.172 Nvme0n1 : 6.00 15233.67 59.51 0.00 0.00 0.00 0.00 0.00 00:15:00.172 [2024-11-26T22:07:26.566Z] =================================================================================================================== 00:15:00.172 [2024-11-26T22:07:26.566Z] Total : 15233.67 59.51 0.00 0.00 0.00 0.00 0.00 00:15:00.172 00:15:01.106 [2024-11-26T22:07:27.500Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.106 Nvme0n1 : 7.00 15278.00 59.68 0.00 0.00 0.00 0.00 0.00 00:15:01.106 [2024-11-26T22:07:27.500Z] =================================================================================================================== 00:15:01.106 [2024-11-26T22:07:27.500Z] Total : 15278.00 59.68 0.00 0.00 0.00 0.00 0.00 00:15:01.106 00:15:02.040 [2024-11-26T22:07:28.434Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.040 Nvme0n1 : 8.00 15314.75 59.82 0.00 0.00 0.00 0.00 0.00 00:15:02.040 [2024-11-26T22:07:28.434Z] =================================================================================================================== 00:15:02.040 [2024-11-26T22:07:28.434Z] Total : 15314.75 59.82 0.00 0.00 0.00 0.00 0.00 00:15:02.040 00:15:02.973 [2024-11-26T22:07:29.367Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.973 Nvme0n1 : 9.00 15349.11 59.96 0.00 0.00 0.00 0.00 0.00 00:15:02.973 [2024-11-26T22:07:29.367Z] =================================================================================================================== 00:15:02.973 [2024-11-26T22:07:29.367Z] Total : 15349.11 59.96 0.00 0.00 0.00 0.00 0.00 00:15:02.973 00:15:03.907 [2024-11-26T22:07:30.301Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.907 Nvme0n1 : 10.00 15384.00 60.09 0.00 0.00 0.00 0.00 0.00 00:15:03.907 [2024-11-26T22:07:30.301Z] =================================================================================================================== 00:15:03.907 [2024-11-26T22:07:30.301Z] Total : 15384.00 60.09 0.00 0.00 0.00 0.00 0.00 00:15:03.907 00:15:03.907 00:15:03.907 Latency(us) 00:15:03.907 [2024-11-26T22:07:30.301Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:03.907 [2024-11-26T22:07:30.301Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.907 Nvme0n1 : 10.01 15388.20 60.11 0.00 0.00 8313.14 2293.76 16699.54 00:15:03.907 [2024-11-26T22:07:30.301Z] =================================================================================================================== 00:15:03.907 [2024-11-26T22:07:30.301Z] Total : 15388.20 60.11 0.00 0.00 8313.14 2293.76 16699.54 00:15:03.907 0 00:15:03.907 23:07:30 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 187806 00:15:03.907 23:07:30 -- common/autotest_common.sh@936 -- # '[' -z 187806 ']' 00:15:03.907 23:07:30 -- common/autotest_common.sh@940 -- # kill -0 187806 00:15:03.907 23:07:30 -- common/autotest_common.sh@941 -- # uname 00:15:03.907 23:07:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:03.907 23:07:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 187806 00:15:03.907 23:07:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:03.907 23:07:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:03.907 23:07:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 187806' 00:15:03.907 killing process with pid 187806 00:15:03.907 23:07:30 -- common/autotest_common.sh@955 -- # kill 187806 00:15:03.907 Received shutdown signal, test time was about 10.000000 seconds 00:15:03.907 00:15:03.907 Latency(us) 00:15:03.907 [2024-11-26T22:07:30.301Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:03.907 [2024-11-26T22:07:30.301Z] =================================================================================================================== 00:15:03.907 [2024-11-26T22:07:30.301Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:03.907 23:07:30 -- common/autotest_common.sh@960 -- # wait 187806 00:15:04.165 23:07:30 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:04.730 23:07:30 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:15:04.730 23:07:30 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:04.988 23:07:31 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:04.988 23:07:31 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:04.988 23:07:31 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:05.246 [2024-11-26 23:07:31.414489] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:05.246 23:07:31 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:15:05.246 23:07:31 -- common/autotest_common.sh@650 -- # local es=0 00:15:05.246 23:07:31 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:15:05.246 23:07:31 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.246 23:07:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.246 23:07:31 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.246 23:07:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.246 23:07:31 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.246 23:07:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.246 23:07:31 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.246 23:07:31 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:05.246 23:07:31 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:15:05.505 request: 00:15:05.505 { 00:15:05.505 "uuid": "9f63465e-3589-4634-bd00-9fbd3f684f11", 00:15:05.505 "method": "bdev_lvol_get_lvstores", 00:15:05.505 "req_id": 1 00:15:05.505 } 00:15:05.505 Got JSON-RPC error response 00:15:05.505 response: 00:15:05.505 { 00:15:05.505 "code": -19, 00:15:05.505 "message": "No such device" 00:15:05.505 } 00:15:05.505 23:07:31 -- common/autotest_common.sh@653 -- # es=1 00:15:05.505 23:07:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:05.505 23:07:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:05.506 23:07:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:05.506 23:07:31 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:05.764 aio_bdev 00:15:05.764 23:07:31 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 268ab298-41c1-4712-b93a-5b6e9a7c83a4 00:15:05.764 23:07:31 -- common/autotest_common.sh@897 -- # local bdev_name=268ab298-41c1-4712-b93a-5b6e9a7c83a4 00:15:05.764 23:07:31 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:05.764 23:07:31 -- common/autotest_common.sh@899 -- # local i 00:15:05.764 23:07:31 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:05.764 23:07:31 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:05.764 23:07:31 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:06.022 23:07:32 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 268ab298-41c1-4712-b93a-5b6e9a7c83a4 -t 2000 00:15:06.280 [ 00:15:06.280 { 00:15:06.280 "name": "268ab298-41c1-4712-b93a-5b6e9a7c83a4", 00:15:06.280 "aliases": [ 00:15:06.280 "lvs/lvol" 00:15:06.280 ], 00:15:06.280 "product_name": "Logical Volume", 00:15:06.280 "block_size": 4096, 00:15:06.280 "num_blocks": 38912, 00:15:06.280 "uuid": "268ab298-41c1-4712-b93a-5b6e9a7c83a4", 00:15:06.280 "assigned_rate_limits": { 00:15:06.280 "rw_ios_per_sec": 0, 00:15:06.280 "rw_mbytes_per_sec": 0, 00:15:06.280 "r_mbytes_per_sec": 0, 00:15:06.280 "w_mbytes_per_sec": 0 00:15:06.280 }, 00:15:06.280 "claimed": false, 00:15:06.280 "zoned": false, 00:15:06.280 "supported_io_types": { 00:15:06.280 "read": true, 00:15:06.280 "write": true, 00:15:06.280 "unmap": true, 00:15:06.280 "write_zeroes": true, 00:15:06.280 "flush": false, 00:15:06.280 "reset": true, 00:15:06.280 "compare": false, 00:15:06.280 "compare_and_write": false, 00:15:06.280 "abort": false, 00:15:06.280 "nvme_admin": false, 00:15:06.280 "nvme_io": false 00:15:06.280 }, 00:15:06.280 "driver_specific": { 00:15:06.280 "lvol": { 00:15:06.280 "lvol_store_uuid": "9f63465e-3589-4634-bd00-9fbd3f684f11", 00:15:06.280 "base_bdev": "aio_bdev", 00:15:06.280 "thin_provision": false, 00:15:06.280 "snapshot": false, 00:15:06.280 "clone": false, 00:15:06.280 "esnap_clone": false 00:15:06.280 } 00:15:06.280 } 00:15:06.280 } 00:15:06.280 ] 00:15:06.280 23:07:32 -- common/autotest_common.sh@905 -- # return 0 00:15:06.280 23:07:32 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:15:06.280 23:07:32 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:06.538 23:07:32 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:06.538 23:07:32 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:15:06.538 23:07:32 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:06.796 23:07:33 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:06.796 23:07:33 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 268ab298-41c1-4712-b93a-5b6e9a7c83a4 00:15:07.054 23:07:33 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 9f63465e-3589-4634-bd00-9fbd3f684f11 00:15:07.313 23:07:33 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:07.570 00:15:07.570 real 0m17.963s 00:15:07.570 user 0m17.780s 00:15:07.570 sys 0m1.791s 00:15:07.570 23:07:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:07.570 23:07:33 -- common/autotest_common.sh@10 -- # set +x 00:15:07.570 ************************************ 00:15:07.570 END TEST lvs_grow_clean 00:15:07.570 ************************************ 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:07.570 23:07:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:07.570 23:07:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:07.570 23:07:33 -- common/autotest_common.sh@10 -- # set +x 00:15:07.570 ************************************ 00:15:07.570 START TEST lvs_grow_dirty 00:15:07.570 ************************************ 00:15:07.570 23:07:33 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:07.570 23:07:33 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:07.832 23:07:34 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:07.832 23:07:34 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:08.090 23:07:34 -- target/nvmf_lvs_grow.sh@28 -- # lvs=dadd66f8-0169-44ad-a606-02a745e93afa 00:15:08.090 23:07:34 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:08.090 23:07:34 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:08.349 23:07:34 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:08.349 23:07:34 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:08.349 23:07:34 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u dadd66f8-0169-44ad-a606-02a745e93afa lvol 150 00:15:08.607 23:07:34 -- target/nvmf_lvs_grow.sh@33 -- # lvol=795bc164-731e-4f47-acaf-cd83437b4b81 00:15:08.607 23:07:34 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:08.607 23:07:34 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:08.867 [2024-11-26 23:07:35.162793] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:08.867 [2024-11-26 23:07:35.162869] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:08.867 true 00:15:08.867 23:07:35 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:08.867 23:07:35 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:09.124 23:07:35 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:09.124 23:07:35 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:09.381 23:07:35 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 795bc164-731e-4f47-acaf-cd83437b4b81 00:15:09.640 23:07:35 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:09.899 23:07:36 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:10.157 23:07:36 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=189922 00:15:10.157 23:07:36 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:10.157 23:07:36 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:10.157 23:07:36 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 189922 /var/tmp/bdevperf.sock 00:15:10.157 23:07:36 -- common/autotest_common.sh@829 -- # '[' -z 189922 ']' 00:15:10.157 23:07:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:10.157 23:07:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:10.157 23:07:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:10.157 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:10.158 23:07:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:10.158 23:07:36 -- common/autotest_common.sh@10 -- # set +x 00:15:10.158 [2024-11-26 23:07:36.485695] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:10.158 [2024-11-26 23:07:36.485775] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid189922 ] 00:15:10.158 EAL: No free 2048 kB hugepages reported on node 1 00:15:10.158 [2024-11-26 23:07:36.548962] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:10.416 [2024-11-26 23:07:36.664970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:11.350 23:07:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:11.350 23:07:37 -- common/autotest_common.sh@862 -- # return 0 00:15:11.350 23:07:37 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:11.608 Nvme0n1 00:15:11.608 23:07:37 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:11.865 [ 00:15:11.865 { 00:15:11.865 "name": "Nvme0n1", 00:15:11.865 "aliases": [ 00:15:11.865 "795bc164-731e-4f47-acaf-cd83437b4b81" 00:15:11.865 ], 00:15:11.865 "product_name": "NVMe disk", 00:15:11.865 "block_size": 4096, 00:15:11.865 "num_blocks": 38912, 00:15:11.865 "uuid": "795bc164-731e-4f47-acaf-cd83437b4b81", 00:15:11.865 "assigned_rate_limits": { 00:15:11.865 "rw_ios_per_sec": 0, 00:15:11.865 "rw_mbytes_per_sec": 0, 00:15:11.865 "r_mbytes_per_sec": 0, 00:15:11.865 "w_mbytes_per_sec": 0 00:15:11.865 }, 00:15:11.865 "claimed": false, 00:15:11.865 "zoned": false, 00:15:11.865 "supported_io_types": { 00:15:11.865 "read": true, 00:15:11.865 "write": true, 00:15:11.865 "unmap": true, 00:15:11.865 "write_zeroes": true, 00:15:11.865 "flush": true, 00:15:11.865 "reset": true, 00:15:11.865 "compare": true, 00:15:11.865 "compare_and_write": true, 00:15:11.865 "abort": true, 00:15:11.865 "nvme_admin": true, 00:15:11.865 "nvme_io": true 00:15:11.865 }, 00:15:11.865 "driver_specific": { 00:15:11.865 "nvme": [ 00:15:11.865 { 00:15:11.865 "trid": { 00:15:11.865 "trtype": "TCP", 00:15:11.865 "adrfam": "IPv4", 00:15:11.865 "traddr": "10.0.0.2", 00:15:11.865 "trsvcid": "4420", 00:15:11.865 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:11.865 }, 00:15:11.865 "ctrlr_data": { 00:15:11.865 "cntlid": 1, 00:15:11.865 "vendor_id": "0x8086", 00:15:11.865 "model_number": "SPDK bdev Controller", 00:15:11.865 "serial_number": "SPDK0", 00:15:11.865 "firmware_revision": "24.01.1", 00:15:11.865 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:11.865 "oacs": { 00:15:11.865 "security": 0, 00:15:11.865 "format": 0, 00:15:11.865 "firmware": 0, 00:15:11.865 "ns_manage": 0 00:15:11.865 }, 00:15:11.865 "multi_ctrlr": true, 00:15:11.865 "ana_reporting": false 00:15:11.865 }, 00:15:11.865 "vs": { 00:15:11.865 "nvme_version": "1.3" 00:15:11.865 }, 00:15:11.865 "ns_data": { 00:15:11.865 "id": 1, 00:15:11.865 "can_share": true 00:15:11.865 } 00:15:11.865 } 00:15:11.865 ], 00:15:11.865 "mp_policy": "active_passive" 00:15:11.865 } 00:15:11.865 } 00:15:11.865 ] 00:15:11.865 23:07:38 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=190189 00:15:11.865 23:07:38 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:11.865 23:07:38 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:12.123 Running I/O for 10 seconds... 00:15:13.055 Latency(us) 00:15:13.055 [2024-11-26T22:07:39.449Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:13.055 [2024-11-26T22:07:39.449Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.055 Nvme0n1 : 1.00 14769.00 57.69 0.00 0.00 0.00 0.00 0.00 00:15:13.055 [2024-11-26T22:07:39.449Z] =================================================================================================================== 00:15:13.055 [2024-11-26T22:07:39.449Z] Total : 14769.00 57.69 0.00 0.00 0.00 0.00 0.00 00:15:13.055 00:15:13.989 23:07:40 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:13.989 [2024-11-26T22:07:40.383Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.989 Nvme0n1 : 2.00 14910.00 58.24 0.00 0.00 0.00 0.00 0.00 00:15:13.989 [2024-11-26T22:07:40.383Z] =================================================================================================================== 00:15:13.989 [2024-11-26T22:07:40.383Z] Total : 14910.00 58.24 0.00 0.00 0.00 0.00 0.00 00:15:13.989 00:15:14.246 true 00:15:14.246 23:07:40 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:14.246 23:07:40 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:14.504 23:07:40 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:14.504 23:07:40 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:14.504 23:07:40 -- target/nvmf_lvs_grow.sh@65 -- # wait 190189 00:15:15.069 [2024-11-26T22:07:41.463Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:15.069 Nvme0n1 : 3.00 15016.33 58.66 0.00 0.00 0.00 0.00 0.00 00:15:15.069 [2024-11-26T22:07:41.463Z] =================================================================================================================== 00:15:15.069 [2024-11-26T22:07:41.463Z] Total : 15016.33 58.66 0.00 0.00 0.00 0.00 0.00 00:15:15.069 00:15:16.002 [2024-11-26T22:07:42.396Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.002 Nvme0n1 : 4.00 15124.50 59.08 0.00 0.00 0.00 0.00 0.00 00:15:16.002 [2024-11-26T22:07:42.396Z] =================================================================================================================== 00:15:16.002 [2024-11-26T22:07:42.396Z] Total : 15124.50 59.08 0.00 0.00 0.00 0.00 0.00 00:15:16.002 00:15:16.934 [2024-11-26T22:07:43.328Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.934 Nvme0n1 : 5.00 15224.60 59.47 0.00 0.00 0.00 0.00 0.00 00:15:16.934 [2024-11-26T22:07:43.328Z] =================================================================================================================== 00:15:16.934 [2024-11-26T22:07:43.328Z] Total : 15224.60 59.47 0.00 0.00 0.00 0.00 0.00 00:15:16.934 00:15:18.304 [2024-11-26T22:07:44.698Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:18.304 Nvme0n1 : 6.00 15276.33 59.67 0.00 0.00 0.00 0.00 0.00 00:15:18.304 [2024-11-26T22:07:44.698Z] =================================================================================================================== 00:15:18.304 [2024-11-26T22:07:44.698Z] Total : 15276.33 59.67 0.00 0.00 0.00 0.00 0.00 00:15:18.304 00:15:19.237 [2024-11-26T22:07:45.631Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.237 Nvme0n1 : 7.00 15329.14 59.88 0.00 0.00 0.00 0.00 0.00 00:15:19.237 [2024-11-26T22:07:45.631Z] =================================================================================================================== 00:15:19.237 [2024-11-26T22:07:45.631Z] Total : 15329.14 59.88 0.00 0.00 0.00 0.00 0.00 00:15:19.237 00:15:20.171 [2024-11-26T22:07:46.565Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.171 Nvme0n1 : 8.00 15383.12 60.09 0.00 0.00 0.00 0.00 0.00 00:15:20.171 [2024-11-26T22:07:46.565Z] =================================================================================================================== 00:15:20.171 [2024-11-26T22:07:46.565Z] Total : 15383.12 60.09 0.00 0.00 0.00 0.00 0.00 00:15:20.171 00:15:21.104 [2024-11-26T22:07:47.498Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:21.104 Nvme0n1 : 9.00 15411.33 60.20 0.00 0.00 0.00 0.00 0.00 00:15:21.104 [2024-11-26T22:07:47.498Z] =================================================================================================================== 00:15:21.104 [2024-11-26T22:07:47.498Z] Total : 15411.33 60.20 0.00 0.00 0.00 0.00 0.00 00:15:21.104 00:15:22.063 [2024-11-26T22:07:48.457Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:22.063 Nvme0n1 : 10.00 15433.90 60.29 0.00 0.00 0.00 0.00 0.00 00:15:22.063 [2024-11-26T22:07:48.457Z] =================================================================================================================== 00:15:22.063 [2024-11-26T22:07:48.457Z] Total : 15433.90 60.29 0.00 0.00 0.00 0.00 0.00 00:15:22.063 00:15:22.063 00:15:22.063 Latency(us) 00:15:22.063 [2024-11-26T22:07:48.457Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.063 [2024-11-26T22:07:48.457Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:22.063 Nvme0n1 : 10.01 15432.05 60.28 0.00 0.00 8288.10 2973.39 16311.18 00:15:22.063 [2024-11-26T22:07:48.457Z] =================================================================================================================== 00:15:22.063 [2024-11-26T22:07:48.457Z] Total : 15432.05 60.28 0.00 0.00 8288.10 2973.39 16311.18 00:15:22.063 0 00:15:22.063 23:07:48 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 189922 00:15:22.063 23:07:48 -- common/autotest_common.sh@936 -- # '[' -z 189922 ']' 00:15:22.063 23:07:48 -- common/autotest_common.sh@940 -- # kill -0 189922 00:15:22.063 23:07:48 -- common/autotest_common.sh@941 -- # uname 00:15:22.063 23:07:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:22.063 23:07:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 189922 00:15:22.063 23:07:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:22.063 23:07:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:22.063 23:07:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 189922' 00:15:22.063 killing process with pid 189922 00:15:22.063 23:07:48 -- common/autotest_common.sh@955 -- # kill 189922 00:15:22.063 Received shutdown signal, test time was about 10.000000 seconds 00:15:22.063 00:15:22.063 Latency(us) 00:15:22.063 [2024-11-26T22:07:48.457Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.063 [2024-11-26T22:07:48.457Z] =================================================================================================================== 00:15:22.063 [2024-11-26T22:07:48.457Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:22.063 23:07:48 -- common/autotest_common.sh@960 -- # wait 189922 00:15:22.321 23:07:48 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:22.579 23:07:48 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:22.579 23:07:48 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:22.836 23:07:49 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:22.836 23:07:49 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:22.836 23:07:49 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 187226 00:15:22.836 23:07:49 -- target/nvmf_lvs_grow.sh@74 -- # wait 187226 00:15:23.094 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 187226 Killed "${NVMF_APP[@]}" "$@" 00:15:23.094 23:07:49 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:23.094 23:07:49 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:23.094 23:07:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:23.094 23:07:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:23.094 23:07:49 -- common/autotest_common.sh@10 -- # set +x 00:15:23.094 23:07:49 -- nvmf/common.sh@469 -- # nvmfpid=191554 00:15:23.094 23:07:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:23.094 23:07:49 -- nvmf/common.sh@470 -- # waitforlisten 191554 00:15:23.094 23:07:49 -- common/autotest_common.sh@829 -- # '[' -z 191554 ']' 00:15:23.094 23:07:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:23.094 23:07:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:23.094 23:07:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:23.094 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:23.094 23:07:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:23.094 23:07:49 -- common/autotest_common.sh@10 -- # set +x 00:15:23.094 [2024-11-26 23:07:49.281724] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:23.094 [2024-11-26 23:07:49.281812] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:23.094 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.094 [2024-11-26 23:07:49.345707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:23.094 [2024-11-26 23:07:49.448921] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:23.094 [2024-11-26 23:07:49.449076] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:23.094 [2024-11-26 23:07:49.449100] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:23.094 [2024-11-26 23:07:49.449112] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:23.094 [2024-11-26 23:07:49.449138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:24.029 23:07:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:24.029 23:07:50 -- common/autotest_common.sh@862 -- # return 0 00:15:24.029 23:07:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:24.029 23:07:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:24.029 23:07:50 -- common/autotest_common.sh@10 -- # set +x 00:15:24.029 23:07:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:24.029 23:07:50 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:24.287 [2024-11-26 23:07:50.565347] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:24.287 [2024-11-26 23:07:50.565498] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:24.287 [2024-11-26 23:07:50.565569] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:24.287 23:07:50 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:24.287 23:07:50 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 795bc164-731e-4f47-acaf-cd83437b4b81 00:15:24.287 23:07:50 -- common/autotest_common.sh@897 -- # local bdev_name=795bc164-731e-4f47-acaf-cd83437b4b81 00:15:24.287 23:07:50 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:24.287 23:07:50 -- common/autotest_common.sh@899 -- # local i 00:15:24.287 23:07:50 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:24.287 23:07:50 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:24.287 23:07:50 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:24.544 23:07:50 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 795bc164-731e-4f47-acaf-cd83437b4b81 -t 2000 00:15:24.802 [ 00:15:24.802 { 00:15:24.802 "name": "795bc164-731e-4f47-acaf-cd83437b4b81", 00:15:24.802 "aliases": [ 00:15:24.802 "lvs/lvol" 00:15:24.802 ], 00:15:24.802 "product_name": "Logical Volume", 00:15:24.802 "block_size": 4096, 00:15:24.802 "num_blocks": 38912, 00:15:24.802 "uuid": "795bc164-731e-4f47-acaf-cd83437b4b81", 00:15:24.802 "assigned_rate_limits": { 00:15:24.802 "rw_ios_per_sec": 0, 00:15:24.802 "rw_mbytes_per_sec": 0, 00:15:24.802 "r_mbytes_per_sec": 0, 00:15:24.802 "w_mbytes_per_sec": 0 00:15:24.802 }, 00:15:24.802 "claimed": false, 00:15:24.802 "zoned": false, 00:15:24.802 "supported_io_types": { 00:15:24.802 "read": true, 00:15:24.802 "write": true, 00:15:24.802 "unmap": true, 00:15:24.802 "write_zeroes": true, 00:15:24.802 "flush": false, 00:15:24.802 "reset": true, 00:15:24.802 "compare": false, 00:15:24.802 "compare_and_write": false, 00:15:24.802 "abort": false, 00:15:24.802 "nvme_admin": false, 00:15:24.802 "nvme_io": false 00:15:24.802 }, 00:15:24.802 "driver_specific": { 00:15:24.802 "lvol": { 00:15:24.802 "lvol_store_uuid": "dadd66f8-0169-44ad-a606-02a745e93afa", 00:15:24.802 "base_bdev": "aio_bdev", 00:15:24.802 "thin_provision": false, 00:15:24.802 "snapshot": false, 00:15:24.802 "clone": false, 00:15:24.802 "esnap_clone": false 00:15:24.802 } 00:15:24.802 } 00:15:24.802 } 00:15:24.802 ] 00:15:24.802 23:07:51 -- common/autotest_common.sh@905 -- # return 0 00:15:24.802 23:07:51 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:24.802 23:07:51 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:25.060 23:07:51 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:25.060 23:07:51 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:25.060 23:07:51 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:25.317 23:07:51 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:25.317 23:07:51 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:25.575 [2024-11-26 23:07:51.846522] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:25.575 23:07:51 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:25.575 23:07:51 -- common/autotest_common.sh@650 -- # local es=0 00:15:25.575 23:07:51 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:25.575 23:07:51 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.575 23:07:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:25.575 23:07:51 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.575 23:07:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:25.575 23:07:51 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.575 23:07:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:25.575 23:07:51 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.575 23:07:51 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:25.576 23:07:51 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:25.833 request: 00:15:25.833 { 00:15:25.833 "uuid": "dadd66f8-0169-44ad-a606-02a745e93afa", 00:15:25.833 "method": "bdev_lvol_get_lvstores", 00:15:25.833 "req_id": 1 00:15:25.833 } 00:15:25.833 Got JSON-RPC error response 00:15:25.833 response: 00:15:25.833 { 00:15:25.833 "code": -19, 00:15:25.833 "message": "No such device" 00:15:25.833 } 00:15:25.833 23:07:52 -- common/autotest_common.sh@653 -- # es=1 00:15:25.833 23:07:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:25.833 23:07:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:25.833 23:07:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:25.833 23:07:52 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:26.091 aio_bdev 00:15:26.091 23:07:52 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 795bc164-731e-4f47-acaf-cd83437b4b81 00:15:26.091 23:07:52 -- common/autotest_common.sh@897 -- # local bdev_name=795bc164-731e-4f47-acaf-cd83437b4b81 00:15:26.091 23:07:52 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:26.091 23:07:52 -- common/autotest_common.sh@899 -- # local i 00:15:26.091 23:07:52 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:26.091 23:07:52 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:26.091 23:07:52 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:26.349 23:07:52 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 795bc164-731e-4f47-acaf-cd83437b4b81 -t 2000 00:15:26.607 [ 00:15:26.607 { 00:15:26.607 "name": "795bc164-731e-4f47-acaf-cd83437b4b81", 00:15:26.607 "aliases": [ 00:15:26.607 "lvs/lvol" 00:15:26.607 ], 00:15:26.607 "product_name": "Logical Volume", 00:15:26.607 "block_size": 4096, 00:15:26.607 "num_blocks": 38912, 00:15:26.607 "uuid": "795bc164-731e-4f47-acaf-cd83437b4b81", 00:15:26.607 "assigned_rate_limits": { 00:15:26.607 "rw_ios_per_sec": 0, 00:15:26.607 "rw_mbytes_per_sec": 0, 00:15:26.607 "r_mbytes_per_sec": 0, 00:15:26.607 "w_mbytes_per_sec": 0 00:15:26.607 }, 00:15:26.607 "claimed": false, 00:15:26.607 "zoned": false, 00:15:26.607 "supported_io_types": { 00:15:26.607 "read": true, 00:15:26.607 "write": true, 00:15:26.607 "unmap": true, 00:15:26.607 "write_zeroes": true, 00:15:26.607 "flush": false, 00:15:26.607 "reset": true, 00:15:26.607 "compare": false, 00:15:26.607 "compare_and_write": false, 00:15:26.607 "abort": false, 00:15:26.607 "nvme_admin": false, 00:15:26.607 "nvme_io": false 00:15:26.607 }, 00:15:26.607 "driver_specific": { 00:15:26.607 "lvol": { 00:15:26.607 "lvol_store_uuid": "dadd66f8-0169-44ad-a606-02a745e93afa", 00:15:26.607 "base_bdev": "aio_bdev", 00:15:26.607 "thin_provision": false, 00:15:26.607 "snapshot": false, 00:15:26.607 "clone": false, 00:15:26.607 "esnap_clone": false 00:15:26.607 } 00:15:26.607 } 00:15:26.607 } 00:15:26.607 ] 00:15:26.607 23:07:52 -- common/autotest_common.sh@905 -- # return 0 00:15:26.607 23:07:52 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:26.608 23:07:52 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:26.865 23:07:53 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:26.865 23:07:53 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:26.865 23:07:53 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:27.123 23:07:53 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:27.123 23:07:53 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 795bc164-731e-4f47-acaf-cd83437b4b81 00:15:27.380 23:07:53 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u dadd66f8-0169-44ad-a606-02a745e93afa 00:15:27.637 23:07:53 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:27.895 23:07:54 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:27.895 00:15:27.895 real 0m20.364s 00:15:27.895 user 0m50.444s 00:15:27.895 sys 0m4.985s 00:15:27.895 23:07:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:27.895 23:07:54 -- common/autotest_common.sh@10 -- # set +x 00:15:27.895 ************************************ 00:15:27.895 END TEST lvs_grow_dirty 00:15:27.895 ************************************ 00:15:27.895 23:07:54 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:27.895 23:07:54 -- common/autotest_common.sh@806 -- # type=--id 00:15:27.895 23:07:54 -- common/autotest_common.sh@807 -- # id=0 00:15:27.895 23:07:54 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:27.895 23:07:54 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:27.895 23:07:54 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:27.895 23:07:54 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:27.895 23:07:54 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:27.895 23:07:54 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:27.895 nvmf_trace.0 00:15:28.153 23:07:54 -- common/autotest_common.sh@821 -- # return 0 00:15:28.153 23:07:54 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:28.153 23:07:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:28.153 23:07:54 -- nvmf/common.sh@116 -- # sync 00:15:28.153 23:07:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:28.153 23:07:54 -- nvmf/common.sh@119 -- # set +e 00:15:28.153 23:07:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:28.153 23:07:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:28.153 rmmod nvme_tcp 00:15:28.153 rmmod nvme_fabrics 00:15:28.153 rmmod nvme_keyring 00:15:28.153 23:07:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:28.153 23:07:54 -- nvmf/common.sh@123 -- # set -e 00:15:28.153 23:07:54 -- nvmf/common.sh@124 -- # return 0 00:15:28.153 23:07:54 -- nvmf/common.sh@477 -- # '[' -n 191554 ']' 00:15:28.153 23:07:54 -- nvmf/common.sh@478 -- # killprocess 191554 00:15:28.153 23:07:54 -- common/autotest_common.sh@936 -- # '[' -z 191554 ']' 00:15:28.153 23:07:54 -- common/autotest_common.sh@940 -- # kill -0 191554 00:15:28.153 23:07:54 -- common/autotest_common.sh@941 -- # uname 00:15:28.153 23:07:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:28.153 23:07:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 191554 00:15:28.153 23:07:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:28.153 23:07:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:28.153 23:07:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 191554' 00:15:28.153 killing process with pid 191554 00:15:28.153 23:07:54 -- common/autotest_common.sh@955 -- # kill 191554 00:15:28.153 23:07:54 -- common/autotest_common.sh@960 -- # wait 191554 00:15:28.413 23:07:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:28.413 23:07:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:28.413 23:07:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:28.413 23:07:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:28.413 23:07:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:28.413 23:07:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.413 23:07:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:28.413 23:07:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:30.316 23:07:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:30.316 00:15:30.316 real 0m44.545s 00:15:30.316 user 1m15.057s 00:15:30.316 sys 0m8.729s 00:15:30.575 23:07:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:30.575 23:07:56 -- common/autotest_common.sh@10 -- # set +x 00:15:30.575 ************************************ 00:15:30.575 END TEST nvmf_lvs_grow 00:15:30.575 ************************************ 00:15:30.575 23:07:56 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:30.575 23:07:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:30.575 23:07:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:30.575 23:07:56 -- common/autotest_common.sh@10 -- # set +x 00:15:30.575 ************************************ 00:15:30.575 START TEST nvmf_bdev_io_wait 00:15:30.575 ************************************ 00:15:30.575 23:07:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:30.575 * Looking for test storage... 00:15:30.575 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:30.575 23:07:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:30.575 23:07:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:30.575 23:07:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:30.575 23:07:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:30.575 23:07:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:30.575 23:07:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:30.575 23:07:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:30.575 23:07:56 -- scripts/common.sh@335 -- # IFS=.-: 00:15:30.575 23:07:56 -- scripts/common.sh@335 -- # read -ra ver1 00:15:30.575 23:07:56 -- scripts/common.sh@336 -- # IFS=.-: 00:15:30.575 23:07:56 -- scripts/common.sh@336 -- # read -ra ver2 00:15:30.575 23:07:56 -- scripts/common.sh@337 -- # local 'op=<' 00:15:30.575 23:07:56 -- scripts/common.sh@339 -- # ver1_l=2 00:15:30.575 23:07:56 -- scripts/common.sh@340 -- # ver2_l=1 00:15:30.575 23:07:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:30.575 23:07:56 -- scripts/common.sh@343 -- # case "$op" in 00:15:30.575 23:07:56 -- scripts/common.sh@344 -- # : 1 00:15:30.575 23:07:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:30.576 23:07:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:30.576 23:07:56 -- scripts/common.sh@364 -- # decimal 1 00:15:30.576 23:07:56 -- scripts/common.sh@352 -- # local d=1 00:15:30.576 23:07:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:30.576 23:07:56 -- scripts/common.sh@354 -- # echo 1 00:15:30.576 23:07:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:30.576 23:07:56 -- scripts/common.sh@365 -- # decimal 2 00:15:30.576 23:07:56 -- scripts/common.sh@352 -- # local d=2 00:15:30.576 23:07:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:30.576 23:07:56 -- scripts/common.sh@354 -- # echo 2 00:15:30.576 23:07:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:30.576 23:07:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:30.576 23:07:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:30.576 23:07:56 -- scripts/common.sh@367 -- # return 0 00:15:30.576 23:07:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:30.576 23:07:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:30.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.576 --rc genhtml_branch_coverage=1 00:15:30.576 --rc genhtml_function_coverage=1 00:15:30.576 --rc genhtml_legend=1 00:15:30.576 --rc geninfo_all_blocks=1 00:15:30.576 --rc geninfo_unexecuted_blocks=1 00:15:30.576 00:15:30.576 ' 00:15:30.576 23:07:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:30.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.576 --rc genhtml_branch_coverage=1 00:15:30.576 --rc genhtml_function_coverage=1 00:15:30.576 --rc genhtml_legend=1 00:15:30.576 --rc geninfo_all_blocks=1 00:15:30.576 --rc geninfo_unexecuted_blocks=1 00:15:30.576 00:15:30.576 ' 00:15:30.576 23:07:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:30.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.576 --rc genhtml_branch_coverage=1 00:15:30.576 --rc genhtml_function_coverage=1 00:15:30.576 --rc genhtml_legend=1 00:15:30.576 --rc geninfo_all_blocks=1 00:15:30.576 --rc geninfo_unexecuted_blocks=1 00:15:30.576 00:15:30.576 ' 00:15:30.576 23:07:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:30.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.576 --rc genhtml_branch_coverage=1 00:15:30.576 --rc genhtml_function_coverage=1 00:15:30.576 --rc genhtml_legend=1 00:15:30.576 --rc geninfo_all_blocks=1 00:15:30.576 --rc geninfo_unexecuted_blocks=1 00:15:30.576 00:15:30.576 ' 00:15:30.576 23:07:56 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:30.576 23:07:56 -- nvmf/common.sh@7 -- # uname -s 00:15:30.576 23:07:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:30.576 23:07:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:30.576 23:07:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:30.576 23:07:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:30.576 23:07:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:30.576 23:07:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:30.576 23:07:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:30.576 23:07:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:30.576 23:07:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:30.576 23:07:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:30.576 23:07:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:30.576 23:07:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:30.576 23:07:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:30.576 23:07:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:30.576 23:07:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:30.576 23:07:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:30.576 23:07:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:30.576 23:07:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:30.576 23:07:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:30.576 23:07:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.576 23:07:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.576 23:07:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.576 23:07:56 -- paths/export.sh@5 -- # export PATH 00:15:30.576 23:07:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.576 23:07:56 -- nvmf/common.sh@46 -- # : 0 00:15:30.576 23:07:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:30.576 23:07:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:30.576 23:07:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:30.576 23:07:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:30.576 23:07:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:30.576 23:07:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:30.576 23:07:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:30.576 23:07:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:30.576 23:07:56 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:30.576 23:07:56 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:30.576 23:07:56 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:30.576 23:07:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:30.576 23:07:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:30.576 23:07:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:30.576 23:07:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:30.576 23:07:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:30.576 23:07:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:30.576 23:07:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:30.576 23:07:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:30.576 23:07:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:30.576 23:07:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:30.576 23:07:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:30.576 23:07:56 -- common/autotest_common.sh@10 -- # set +x 00:15:33.107 23:07:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:33.107 23:07:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:33.107 23:07:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:33.107 23:07:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:33.107 23:07:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:33.107 23:07:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:33.107 23:07:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:33.107 23:07:58 -- nvmf/common.sh@294 -- # net_devs=() 00:15:33.107 23:07:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:33.107 23:07:58 -- nvmf/common.sh@295 -- # e810=() 00:15:33.107 23:07:58 -- nvmf/common.sh@295 -- # local -ga e810 00:15:33.107 23:07:58 -- nvmf/common.sh@296 -- # x722=() 00:15:33.107 23:07:58 -- nvmf/common.sh@296 -- # local -ga x722 00:15:33.107 23:07:58 -- nvmf/common.sh@297 -- # mlx=() 00:15:33.107 23:07:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:33.107 23:07:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:33.107 23:07:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:33.107 23:07:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:33.107 23:07:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:33.107 23:07:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.107 23:07:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:33.107 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:33.107 23:07:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.107 23:07:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:33.107 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:33.107 23:07:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:33.107 23:07:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.107 23:07:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.107 23:07:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.107 23:07:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.107 23:07:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:33.107 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:33.107 23:07:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.107 23:07:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.107 23:07:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.107 23:07:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.107 23:07:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.107 23:07:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:33.107 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:33.107 23:07:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.107 23:07:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:33.107 23:07:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:33.107 23:07:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:33.107 23:07:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:33.107 23:07:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:33.107 23:07:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:33.107 23:07:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:33.107 23:07:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:33.107 23:07:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:33.107 23:07:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:33.107 23:07:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:33.107 23:07:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:33.107 23:07:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:33.107 23:07:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:33.107 23:07:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:33.107 23:07:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:33.107 23:07:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:33.107 23:07:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:33.107 23:07:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:33.107 23:07:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:33.107 23:07:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:33.107 23:07:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:33.107 23:07:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:33.107 23:07:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:33.107 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:33.107 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:15:33.107 00:15:33.107 --- 10.0.0.2 ping statistics --- 00:15:33.107 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.107 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:15:33.107 23:07:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:33.107 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:33.107 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:15:33.107 00:15:33.107 --- 10.0.0.1 ping statistics --- 00:15:33.107 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.107 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:15:33.107 23:07:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:33.107 23:07:59 -- nvmf/common.sh@410 -- # return 0 00:15:33.107 23:07:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:33.107 23:07:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:33.107 23:07:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:33.107 23:07:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:33.107 23:07:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:33.107 23:07:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:33.107 23:07:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:33.107 23:07:59 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:33.107 23:07:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:33.107 23:07:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:33.107 23:07:59 -- common/autotest_common.sh@10 -- # set +x 00:15:33.107 23:07:59 -- nvmf/common.sh@469 -- # nvmfpid=194122 00:15:33.107 23:07:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:33.107 23:07:59 -- nvmf/common.sh@470 -- # waitforlisten 194122 00:15:33.107 23:07:59 -- common/autotest_common.sh@829 -- # '[' -z 194122 ']' 00:15:33.107 23:07:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:33.107 23:07:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:33.107 23:07:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:33.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:33.107 23:07:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:33.107 23:07:59 -- common/autotest_common.sh@10 -- # set +x 00:15:33.107 [2024-11-26 23:07:59.154810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.107 [2024-11-26 23:07:59.154900] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:33.107 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.107 [2024-11-26 23:07:59.224324] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:33.107 [2024-11-26 23:07:59.345340] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:33.107 [2024-11-26 23:07:59.345503] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:33.107 [2024-11-26 23:07:59.345522] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:33.107 [2024-11-26 23:07:59.345545] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:33.107 [2024-11-26 23:07:59.345603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:33.107 [2024-11-26 23:07:59.345780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:33.107 [2024-11-26 23:07:59.345843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:33.107 [2024-11-26 23:07:59.345847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:34.041 23:08:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:34.041 23:08:00 -- common/autotest_common.sh@862 -- # return 0 00:15:34.041 23:08:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:34.041 23:08:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:34.041 23:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:34.041 23:08:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:34.041 23:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.041 23:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:34.041 23:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:34.041 23:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.041 23:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:34.041 23:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:34.041 23:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.041 23:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:34.041 [2024-11-26 23:08:00.216812] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:34.041 23:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:34.041 23:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.041 23:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:34.041 Malloc0 00:15:34.041 23:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:34.041 23:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.041 23:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:34.041 23:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:34.041 23:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.041 23:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:34.041 23:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:34.041 23:08:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.041 23:08:00 -- common/autotest_common.sh@10 -- # set +x 00:15:34.041 [2024-11-26 23:08:00.281094] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:34.041 23:08:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=194302 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@30 -- # READ_PID=194304 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:34.041 23:08:00 -- nvmf/common.sh@520 -- # config=() 00:15:34.041 23:08:00 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.041 23:08:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.041 23:08:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.041 { 00:15:34.041 "params": { 00:15:34.041 "name": "Nvme$subsystem", 00:15:34.041 "trtype": "$TEST_TRANSPORT", 00:15:34.041 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.041 "adrfam": "ipv4", 00:15:34.041 "trsvcid": "$NVMF_PORT", 00:15:34.041 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.041 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.041 "hdgst": ${hdgst:-false}, 00:15:34.041 "ddgst": ${ddgst:-false} 00:15:34.041 }, 00:15:34.041 "method": "bdev_nvme_attach_controller" 00:15:34.041 } 00:15:34.041 EOF 00:15:34.041 )") 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:34.041 23:08:00 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:34.042 23:08:00 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=194307 00:15:34.042 23:08:00 -- nvmf/common.sh@520 -- # config=() 00:15:34.042 23:08:00 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.042 23:08:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.042 23:08:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.042 { 00:15:34.042 "params": { 00:15:34.042 "name": "Nvme$subsystem", 00:15:34.042 "trtype": "$TEST_TRANSPORT", 00:15:34.042 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.042 "adrfam": "ipv4", 00:15:34.042 "trsvcid": "$NVMF_PORT", 00:15:34.042 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.042 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.042 "hdgst": ${hdgst:-false}, 00:15:34.042 "ddgst": ${ddgst:-false} 00:15:34.042 }, 00:15:34.042 "method": "bdev_nvme_attach_controller" 00:15:34.042 } 00:15:34.042 EOF 00:15:34.042 )") 00:15:34.042 23:08:00 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:34.042 23:08:00 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:34.042 23:08:00 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=194310 00:15:34.042 23:08:00 -- nvmf/common.sh@520 -- # config=() 00:15:34.042 23:08:00 -- target/bdev_io_wait.sh@35 -- # sync 00:15:34.042 23:08:00 -- nvmf/common.sh@542 -- # cat 00:15:34.042 23:08:00 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.042 23:08:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.042 23:08:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.042 { 00:15:34.042 "params": { 00:15:34.042 "name": "Nvme$subsystem", 00:15:34.042 "trtype": "$TEST_TRANSPORT", 00:15:34.042 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.042 "adrfam": "ipv4", 00:15:34.042 "trsvcid": "$NVMF_PORT", 00:15:34.042 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.042 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.042 "hdgst": ${hdgst:-false}, 00:15:34.042 "ddgst": ${ddgst:-false} 00:15:34.042 }, 00:15:34.042 "method": "bdev_nvme_attach_controller" 00:15:34.042 } 00:15:34.042 EOF 00:15:34.042 )") 00:15:34.042 23:08:00 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:34.042 23:08:00 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:34.042 23:08:00 -- nvmf/common.sh@542 -- # cat 00:15:34.042 23:08:00 -- nvmf/common.sh@520 -- # config=() 00:15:34.042 23:08:00 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.042 23:08:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.042 23:08:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.042 { 00:15:34.042 "params": { 00:15:34.042 "name": "Nvme$subsystem", 00:15:34.042 "trtype": "$TEST_TRANSPORT", 00:15:34.042 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.042 "adrfam": "ipv4", 00:15:34.042 "trsvcid": "$NVMF_PORT", 00:15:34.042 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.042 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.042 "hdgst": ${hdgst:-false}, 00:15:34.042 "ddgst": ${ddgst:-false} 00:15:34.042 }, 00:15:34.042 "method": "bdev_nvme_attach_controller" 00:15:34.042 } 00:15:34.042 EOF 00:15:34.042 )") 00:15:34.042 23:08:00 -- nvmf/common.sh@542 -- # cat 00:15:34.042 23:08:00 -- target/bdev_io_wait.sh@37 -- # wait 194302 00:15:34.042 23:08:00 -- nvmf/common.sh@542 -- # cat 00:15:34.042 23:08:00 -- nvmf/common.sh@544 -- # jq . 00:15:34.042 23:08:00 -- nvmf/common.sh@544 -- # jq . 00:15:34.042 23:08:00 -- nvmf/common.sh@544 -- # jq . 00:15:34.042 23:08:00 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.042 23:08:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.042 "params": { 00:15:34.042 "name": "Nvme1", 00:15:34.042 "trtype": "tcp", 00:15:34.042 "traddr": "10.0.0.2", 00:15:34.042 "adrfam": "ipv4", 00:15:34.042 "trsvcid": "4420", 00:15:34.042 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.042 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.042 "hdgst": false, 00:15:34.042 "ddgst": false 00:15:34.042 }, 00:15:34.042 "method": "bdev_nvme_attach_controller" 00:15:34.042 }' 00:15:34.042 23:08:00 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.042 23:08:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.042 "params": { 00:15:34.042 "name": "Nvme1", 00:15:34.042 "trtype": "tcp", 00:15:34.042 "traddr": "10.0.0.2", 00:15:34.042 "adrfam": "ipv4", 00:15:34.042 "trsvcid": "4420", 00:15:34.042 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.042 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.042 "hdgst": false, 00:15:34.042 "ddgst": false 00:15:34.042 }, 00:15:34.042 "method": "bdev_nvme_attach_controller" 00:15:34.042 }' 00:15:34.042 23:08:00 -- nvmf/common.sh@544 -- # jq . 00:15:34.042 23:08:00 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.042 23:08:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.042 "params": { 00:15:34.042 "name": "Nvme1", 00:15:34.042 "trtype": "tcp", 00:15:34.042 "traddr": "10.0.0.2", 00:15:34.042 "adrfam": "ipv4", 00:15:34.042 "trsvcid": "4420", 00:15:34.042 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.042 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.042 "hdgst": false, 00:15:34.042 "ddgst": false 00:15:34.042 }, 00:15:34.042 "method": "bdev_nvme_attach_controller" 00:15:34.042 }' 00:15:34.042 23:08:00 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.042 23:08:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.042 "params": { 00:15:34.042 "name": "Nvme1", 00:15:34.042 "trtype": "tcp", 00:15:34.042 "traddr": "10.0.0.2", 00:15:34.042 "adrfam": "ipv4", 00:15:34.042 "trsvcid": "4420", 00:15:34.042 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.042 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.042 "hdgst": false, 00:15:34.042 "ddgst": false 00:15:34.042 }, 00:15:34.042 "method": "bdev_nvme_attach_controller" 00:15:34.042 }' 00:15:34.042 [2024-11-26 23:08:00.324106] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:34.042 [2024-11-26 23:08:00.324105] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:34.042 [2024-11-26 23:08:00.324105] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:34.042 [2024-11-26 23:08:00.324188] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 23:08:00.324188] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 23:08:00.324190] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:34.042 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:34.042 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:34.042 [2024-11-26 23:08:00.325835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:34.042 [2024-11-26 23:08:00.325894] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:34.042 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.300 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.300 [2024-11-26 23:08:00.506143] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.300 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.300 [2024-11-26 23:08:00.606169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:34.300 [2024-11-26 23:08:00.608854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.300 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.300 [2024-11-26 23:08:00.683521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.557 [2024-11-26 23:08:00.708975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:34.557 [2024-11-26 23:08:00.759532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.557 [2024-11-26 23:08:00.775818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:34.557 [2024-11-26 23:08:00.850970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:34.557 Running I/O for 1 seconds... 00:15:34.815 Running I/O for 1 seconds... 00:15:34.815 Running I/O for 1 seconds... 00:15:34.815 Running I/O for 1 seconds... 00:15:35.748 00:15:35.748 Latency(us) 00:15:35.748 [2024-11-26T22:08:02.142Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.748 [2024-11-26T22:08:02.142Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:35.748 Nvme1n1 : 1.01 9858.19 38.51 0.00 0.00 12929.25 7427.41 22233.69 00:15:35.748 [2024-11-26T22:08:02.142Z] =================================================================================================================== 00:15:35.748 [2024-11-26T22:08:02.142Z] Total : 9858.19 38.51 0.00 0.00 12929.25 7427.41 22233.69 00:15:35.748 00:15:35.748 Latency(us) 00:15:35.748 [2024-11-26T22:08:02.142Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.748 [2024-11-26T22:08:02.142Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:35.748 Nvme1n1 : 1.02 6260.98 24.46 0.00 0.00 20270.84 8398.32 28350.39 00:15:35.748 [2024-11-26T22:08:02.142Z] =================================================================================================================== 00:15:35.748 [2024-11-26T22:08:02.142Z] Total : 6260.98 24.46 0.00 0.00 20270.84 8398.32 28350.39 00:15:35.748 00:15:35.748 Latency(us) 00:15:35.748 [2024-11-26T22:08:02.142Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.748 [2024-11-26T22:08:02.142Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:35.748 Nvme1n1 : 1.00 188675.44 737.01 0.00 0.00 675.82 267.00 819.20 00:15:35.748 [2024-11-26T22:08:02.142Z] =================================================================================================================== 00:15:35.748 [2024-11-26T22:08:02.143Z] Total : 188675.44 737.01 0.00 0.00 675.82 267.00 819.20 00:15:35.749 00:15:35.749 Latency(us) 00:15:35.749 [2024-11-26T22:08:02.143Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.749 [2024-11-26T22:08:02.143Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:35.749 Nvme1n1 : 1.01 6223.69 24.31 0.00 0.00 20490.99 6699.24 46215.02 00:15:35.749 [2024-11-26T22:08:02.143Z] =================================================================================================================== 00:15:35.749 [2024-11-26T22:08:02.143Z] Total : 6223.69 24.31 0.00 0.00 20490.99 6699.24 46215.02 00:15:36.006 23:08:02 -- target/bdev_io_wait.sh@38 -- # wait 194304 00:15:36.263 23:08:02 -- target/bdev_io_wait.sh@39 -- # wait 194307 00:15:36.263 23:08:02 -- target/bdev_io_wait.sh@40 -- # wait 194310 00:15:36.263 23:08:02 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:36.263 23:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.263 23:08:02 -- common/autotest_common.sh@10 -- # set +x 00:15:36.263 23:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.263 23:08:02 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:36.263 23:08:02 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:36.263 23:08:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:36.263 23:08:02 -- nvmf/common.sh@116 -- # sync 00:15:36.263 23:08:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:36.263 23:08:02 -- nvmf/common.sh@119 -- # set +e 00:15:36.263 23:08:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:36.263 23:08:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:36.263 rmmod nvme_tcp 00:15:36.263 rmmod nvme_fabrics 00:15:36.263 rmmod nvme_keyring 00:15:36.263 23:08:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:36.263 23:08:02 -- nvmf/common.sh@123 -- # set -e 00:15:36.263 23:08:02 -- nvmf/common.sh@124 -- # return 0 00:15:36.263 23:08:02 -- nvmf/common.sh@477 -- # '[' -n 194122 ']' 00:15:36.263 23:08:02 -- nvmf/common.sh@478 -- # killprocess 194122 00:15:36.263 23:08:02 -- common/autotest_common.sh@936 -- # '[' -z 194122 ']' 00:15:36.263 23:08:02 -- common/autotest_common.sh@940 -- # kill -0 194122 00:15:36.263 23:08:02 -- common/autotest_common.sh@941 -- # uname 00:15:36.263 23:08:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:36.263 23:08:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 194122 00:15:36.263 23:08:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:36.263 23:08:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:36.263 23:08:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 194122' 00:15:36.263 killing process with pid 194122 00:15:36.263 23:08:02 -- common/autotest_common.sh@955 -- # kill 194122 00:15:36.264 23:08:02 -- common/autotest_common.sh@960 -- # wait 194122 00:15:36.522 23:08:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:36.522 23:08:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:36.522 23:08:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:36.522 23:08:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:36.522 23:08:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:36.522 23:08:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:36.522 23:08:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:36.522 23:08:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:38.425 23:08:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:38.425 00:15:38.425 real 0m8.081s 00:15:38.425 user 0m19.686s 00:15:38.425 sys 0m3.651s 00:15:38.425 23:08:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:38.425 23:08:04 -- common/autotest_common.sh@10 -- # set +x 00:15:38.425 ************************************ 00:15:38.425 END TEST nvmf_bdev_io_wait 00:15:38.425 ************************************ 00:15:38.684 23:08:04 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:38.684 23:08:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:38.684 23:08:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:38.684 23:08:04 -- common/autotest_common.sh@10 -- # set +x 00:15:38.684 ************************************ 00:15:38.684 START TEST nvmf_queue_depth 00:15:38.684 ************************************ 00:15:38.684 23:08:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:38.684 * Looking for test storage... 00:15:38.684 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:38.684 23:08:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:38.684 23:08:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:38.684 23:08:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:38.684 23:08:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:38.684 23:08:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:38.684 23:08:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:38.684 23:08:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:38.684 23:08:04 -- scripts/common.sh@335 -- # IFS=.-: 00:15:38.684 23:08:04 -- scripts/common.sh@335 -- # read -ra ver1 00:15:38.684 23:08:04 -- scripts/common.sh@336 -- # IFS=.-: 00:15:38.684 23:08:04 -- scripts/common.sh@336 -- # read -ra ver2 00:15:38.684 23:08:04 -- scripts/common.sh@337 -- # local 'op=<' 00:15:38.684 23:08:04 -- scripts/common.sh@339 -- # ver1_l=2 00:15:38.684 23:08:04 -- scripts/common.sh@340 -- # ver2_l=1 00:15:38.685 23:08:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:38.685 23:08:04 -- scripts/common.sh@343 -- # case "$op" in 00:15:38.685 23:08:04 -- scripts/common.sh@344 -- # : 1 00:15:38.685 23:08:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:38.685 23:08:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:38.685 23:08:04 -- scripts/common.sh@364 -- # decimal 1 00:15:38.685 23:08:04 -- scripts/common.sh@352 -- # local d=1 00:15:38.685 23:08:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:38.685 23:08:04 -- scripts/common.sh@354 -- # echo 1 00:15:38.685 23:08:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:38.685 23:08:04 -- scripts/common.sh@365 -- # decimal 2 00:15:38.685 23:08:04 -- scripts/common.sh@352 -- # local d=2 00:15:38.685 23:08:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:38.685 23:08:04 -- scripts/common.sh@354 -- # echo 2 00:15:38.685 23:08:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:38.685 23:08:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:38.685 23:08:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:38.685 23:08:04 -- scripts/common.sh@367 -- # return 0 00:15:38.685 23:08:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:38.685 23:08:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:38.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.685 --rc genhtml_branch_coverage=1 00:15:38.685 --rc genhtml_function_coverage=1 00:15:38.685 --rc genhtml_legend=1 00:15:38.685 --rc geninfo_all_blocks=1 00:15:38.685 --rc geninfo_unexecuted_blocks=1 00:15:38.685 00:15:38.685 ' 00:15:38.685 23:08:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:38.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.685 --rc genhtml_branch_coverage=1 00:15:38.685 --rc genhtml_function_coverage=1 00:15:38.685 --rc genhtml_legend=1 00:15:38.685 --rc geninfo_all_blocks=1 00:15:38.685 --rc geninfo_unexecuted_blocks=1 00:15:38.685 00:15:38.685 ' 00:15:38.685 23:08:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:38.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.685 --rc genhtml_branch_coverage=1 00:15:38.685 --rc genhtml_function_coverage=1 00:15:38.685 --rc genhtml_legend=1 00:15:38.685 --rc geninfo_all_blocks=1 00:15:38.685 --rc geninfo_unexecuted_blocks=1 00:15:38.685 00:15:38.685 ' 00:15:38.685 23:08:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:38.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.685 --rc genhtml_branch_coverage=1 00:15:38.685 --rc genhtml_function_coverage=1 00:15:38.685 --rc genhtml_legend=1 00:15:38.685 --rc geninfo_all_blocks=1 00:15:38.685 --rc geninfo_unexecuted_blocks=1 00:15:38.685 00:15:38.685 ' 00:15:38.685 23:08:04 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:38.685 23:08:04 -- nvmf/common.sh@7 -- # uname -s 00:15:38.685 23:08:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:38.685 23:08:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:38.685 23:08:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:38.685 23:08:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:38.685 23:08:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:38.685 23:08:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:38.685 23:08:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:38.685 23:08:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:38.685 23:08:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:38.685 23:08:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:38.685 23:08:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:38.685 23:08:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:38.685 23:08:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:38.685 23:08:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:38.685 23:08:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:38.685 23:08:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:38.685 23:08:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:38.685 23:08:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:38.685 23:08:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:38.685 23:08:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.685 23:08:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.685 23:08:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.685 23:08:04 -- paths/export.sh@5 -- # export PATH 00:15:38.685 23:08:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.685 23:08:04 -- nvmf/common.sh@46 -- # : 0 00:15:38.685 23:08:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:38.685 23:08:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:38.685 23:08:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:38.685 23:08:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:38.685 23:08:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:38.685 23:08:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:38.685 23:08:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:38.685 23:08:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:38.685 23:08:04 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:38.685 23:08:04 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:38.685 23:08:04 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:38.685 23:08:04 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:38.685 23:08:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:38.685 23:08:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:38.685 23:08:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:38.685 23:08:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:38.685 23:08:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:38.685 23:08:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:38.685 23:08:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:38.685 23:08:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:38.685 23:08:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:38.685 23:08:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:38.685 23:08:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:38.685 23:08:04 -- common/autotest_common.sh@10 -- # set +x 00:15:40.587 23:08:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:40.587 23:08:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:40.587 23:08:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:40.587 23:08:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:40.587 23:08:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:40.587 23:08:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:40.587 23:08:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:40.587 23:08:06 -- nvmf/common.sh@294 -- # net_devs=() 00:15:40.587 23:08:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:40.587 23:08:06 -- nvmf/common.sh@295 -- # e810=() 00:15:40.587 23:08:06 -- nvmf/common.sh@295 -- # local -ga e810 00:15:40.587 23:08:06 -- nvmf/common.sh@296 -- # x722=() 00:15:40.587 23:08:06 -- nvmf/common.sh@296 -- # local -ga x722 00:15:40.587 23:08:06 -- nvmf/common.sh@297 -- # mlx=() 00:15:40.587 23:08:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:40.587 23:08:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:40.587 23:08:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:40.587 23:08:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:40.587 23:08:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:40.587 23:08:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:40.587 23:08:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:40.587 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:40.587 23:08:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:40.587 23:08:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:40.587 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:40.587 23:08:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:40.587 23:08:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:40.587 23:08:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:40.587 23:08:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:40.587 23:08:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:40.587 23:08:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:40.587 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:40.587 23:08:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:40.587 23:08:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:40.587 23:08:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:40.587 23:08:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:40.587 23:08:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:40.587 23:08:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:40.587 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:40.587 23:08:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:40.587 23:08:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:40.587 23:08:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:40.587 23:08:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:40.587 23:08:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:40.587 23:08:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:40.587 23:08:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:40.587 23:08:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:40.587 23:08:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:40.587 23:08:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:40.587 23:08:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:40.587 23:08:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:40.587 23:08:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:40.587 23:08:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:40.587 23:08:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:40.587 23:08:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:40.587 23:08:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:40.587 23:08:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:40.846 23:08:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:40.846 23:08:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:40.846 23:08:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:40.846 23:08:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:40.846 23:08:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:40.846 23:08:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:40.846 23:08:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:40.846 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:40.846 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.165 ms 00:15:40.846 00:15:40.846 --- 10.0.0.2 ping statistics --- 00:15:40.846 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:40.846 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:15:40.846 23:08:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:40.846 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:40.846 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:15:40.846 00:15:40.846 --- 10.0.0.1 ping statistics --- 00:15:40.846 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:40.846 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:15:40.846 23:08:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:40.846 23:08:07 -- nvmf/common.sh@410 -- # return 0 00:15:40.846 23:08:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:40.846 23:08:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:40.846 23:08:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:40.846 23:08:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:40.846 23:08:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:40.846 23:08:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:40.846 23:08:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:40.846 23:08:07 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:40.846 23:08:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:40.846 23:08:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:40.846 23:08:07 -- common/autotest_common.sh@10 -- # set +x 00:15:40.846 23:08:07 -- nvmf/common.sh@469 -- # nvmfpid=196602 00:15:40.846 23:08:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:40.846 23:08:07 -- nvmf/common.sh@470 -- # waitforlisten 196602 00:15:40.846 23:08:07 -- common/autotest_common.sh@829 -- # '[' -z 196602 ']' 00:15:40.846 23:08:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:40.846 23:08:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:40.846 23:08:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:40.846 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:40.846 23:08:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:40.846 23:08:07 -- common/autotest_common.sh@10 -- # set +x 00:15:40.846 [2024-11-26 23:08:07.141373] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:40.846 [2024-11-26 23:08:07.141447] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:40.846 EAL: No free 2048 kB hugepages reported on node 1 00:15:40.846 [2024-11-26 23:08:07.211907] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:41.105 [2024-11-26 23:08:07.321448] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:41.105 [2024-11-26 23:08:07.321625] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:41.105 [2024-11-26 23:08:07.321645] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:41.105 [2024-11-26 23:08:07.321657] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:41.105 [2024-11-26 23:08:07.321697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:42.041 23:08:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:42.041 23:08:08 -- common/autotest_common.sh@862 -- # return 0 00:15:42.041 23:08:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:42.041 23:08:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:42.041 23:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:42.041 23:08:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:42.041 23:08:08 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:42.041 23:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.041 23:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:42.041 [2024-11-26 23:08:08.178099] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:42.041 23:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.041 23:08:08 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:42.041 23:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.041 23:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:42.041 Malloc0 00:15:42.041 23:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.041 23:08:08 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:42.041 23:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.041 23:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:42.041 23:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.041 23:08:08 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:42.041 23:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.041 23:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:42.041 23:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.041 23:08:08 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:42.041 23:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.041 23:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:42.041 [2024-11-26 23:08:08.244766] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:42.041 23:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.041 23:08:08 -- target/queue_depth.sh@30 -- # bdevperf_pid=196774 00:15:42.041 23:08:08 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:42.041 23:08:08 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:42.041 23:08:08 -- target/queue_depth.sh@33 -- # waitforlisten 196774 /var/tmp/bdevperf.sock 00:15:42.041 23:08:08 -- common/autotest_common.sh@829 -- # '[' -z 196774 ']' 00:15:42.041 23:08:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:42.041 23:08:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:42.041 23:08:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:42.041 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:42.041 23:08:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:42.041 23:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:42.041 [2024-11-26 23:08:08.287771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:42.041 [2024-11-26 23:08:08.287869] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid196774 ] 00:15:42.041 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.041 [2024-11-26 23:08:08.350627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:42.300 [2024-11-26 23:08:08.464590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:42.865 23:08:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:42.865 23:08:09 -- common/autotest_common.sh@862 -- # return 0 00:15:42.865 23:08:09 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:42.865 23:08:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.865 23:08:09 -- common/autotest_common.sh@10 -- # set +x 00:15:43.122 NVMe0n1 00:15:43.122 23:08:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:43.122 23:08:09 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:43.122 Running I/O for 10 seconds... 00:15:55.344 00:15:55.344 Latency(us) 00:15:55.344 [2024-11-26T22:08:21.738Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:55.344 [2024-11-26T22:08:21.738Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:55.344 Verification LBA range: start 0x0 length 0x4000 00:15:55.344 NVMe0n1 : 10.07 12375.31 48.34 0.00 0.00 82411.32 15631.55 60972.75 00:15:55.344 [2024-11-26T22:08:21.738Z] =================================================================================================================== 00:15:55.344 [2024-11-26T22:08:21.738Z] Total : 12375.31 48.34 0.00 0.00 82411.32 15631.55 60972.75 00:15:55.344 0 00:15:55.344 23:08:19 -- target/queue_depth.sh@39 -- # killprocess 196774 00:15:55.344 23:08:19 -- common/autotest_common.sh@936 -- # '[' -z 196774 ']' 00:15:55.344 23:08:19 -- common/autotest_common.sh@940 -- # kill -0 196774 00:15:55.344 23:08:19 -- common/autotest_common.sh@941 -- # uname 00:15:55.344 23:08:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:55.344 23:08:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 196774 00:15:55.344 23:08:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:55.344 23:08:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:55.344 23:08:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 196774' 00:15:55.344 killing process with pid 196774 00:15:55.344 23:08:19 -- common/autotest_common.sh@955 -- # kill 196774 00:15:55.344 Received shutdown signal, test time was about 10.000000 seconds 00:15:55.344 00:15:55.344 Latency(us) 00:15:55.344 [2024-11-26T22:08:21.738Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:55.344 [2024-11-26T22:08:21.738Z] =================================================================================================================== 00:15:55.344 [2024-11-26T22:08:21.738Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:55.344 23:08:19 -- common/autotest_common.sh@960 -- # wait 196774 00:15:55.344 23:08:19 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:55.344 23:08:19 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:55.344 23:08:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:55.344 23:08:19 -- nvmf/common.sh@116 -- # sync 00:15:55.344 23:08:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:55.344 23:08:19 -- nvmf/common.sh@119 -- # set +e 00:15:55.344 23:08:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:55.344 23:08:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:55.344 rmmod nvme_tcp 00:15:55.344 rmmod nvme_fabrics 00:15:55.344 rmmod nvme_keyring 00:15:55.344 23:08:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:55.344 23:08:19 -- nvmf/common.sh@123 -- # set -e 00:15:55.344 23:08:19 -- nvmf/common.sh@124 -- # return 0 00:15:55.344 23:08:19 -- nvmf/common.sh@477 -- # '[' -n 196602 ']' 00:15:55.344 23:08:19 -- nvmf/common.sh@478 -- # killprocess 196602 00:15:55.344 23:08:19 -- common/autotest_common.sh@936 -- # '[' -z 196602 ']' 00:15:55.344 23:08:19 -- common/autotest_common.sh@940 -- # kill -0 196602 00:15:55.344 23:08:19 -- common/autotest_common.sh@941 -- # uname 00:15:55.344 23:08:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:55.344 23:08:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 196602 00:15:55.344 23:08:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:55.344 23:08:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:55.344 23:08:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 196602' 00:15:55.344 killing process with pid 196602 00:15:55.344 23:08:19 -- common/autotest_common.sh@955 -- # kill 196602 00:15:55.344 23:08:19 -- common/autotest_common.sh@960 -- # wait 196602 00:15:55.344 23:08:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:55.344 23:08:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:55.344 23:08:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:55.344 23:08:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:55.344 23:08:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:55.344 23:08:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:55.344 23:08:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:55.344 23:08:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.281 23:08:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:56.281 00:15:56.281 real 0m17.469s 00:15:56.281 user 0m24.926s 00:15:56.281 sys 0m3.190s 00:15:56.281 23:08:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:56.281 23:08:22 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 ************************************ 00:15:56.281 END TEST nvmf_queue_depth 00:15:56.281 ************************************ 00:15:56.281 23:08:22 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:56.281 23:08:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:56.281 23:08:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:56.281 23:08:22 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 ************************************ 00:15:56.281 START TEST nvmf_multipath 00:15:56.281 ************************************ 00:15:56.281 23:08:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:56.281 * Looking for test storage... 00:15:56.281 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:56.281 23:08:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:56.281 23:08:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:56.281 23:08:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:56.281 23:08:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:56.281 23:08:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:56.281 23:08:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:56.281 23:08:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:56.281 23:08:22 -- scripts/common.sh@335 -- # IFS=.-: 00:15:56.281 23:08:22 -- scripts/common.sh@335 -- # read -ra ver1 00:15:56.281 23:08:22 -- scripts/common.sh@336 -- # IFS=.-: 00:15:56.281 23:08:22 -- scripts/common.sh@336 -- # read -ra ver2 00:15:56.281 23:08:22 -- scripts/common.sh@337 -- # local 'op=<' 00:15:56.281 23:08:22 -- scripts/common.sh@339 -- # ver1_l=2 00:15:56.281 23:08:22 -- scripts/common.sh@340 -- # ver2_l=1 00:15:56.281 23:08:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:56.281 23:08:22 -- scripts/common.sh@343 -- # case "$op" in 00:15:56.281 23:08:22 -- scripts/common.sh@344 -- # : 1 00:15:56.281 23:08:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:56.281 23:08:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:56.281 23:08:22 -- scripts/common.sh@364 -- # decimal 1 00:15:56.281 23:08:22 -- scripts/common.sh@352 -- # local d=1 00:15:56.281 23:08:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:56.281 23:08:22 -- scripts/common.sh@354 -- # echo 1 00:15:56.281 23:08:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:56.281 23:08:22 -- scripts/common.sh@365 -- # decimal 2 00:15:56.281 23:08:22 -- scripts/common.sh@352 -- # local d=2 00:15:56.281 23:08:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:56.281 23:08:22 -- scripts/common.sh@354 -- # echo 2 00:15:56.281 23:08:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:56.281 23:08:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:56.281 23:08:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:56.281 23:08:22 -- scripts/common.sh@367 -- # return 0 00:15:56.281 23:08:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:56.281 23:08:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:56.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.281 --rc genhtml_branch_coverage=1 00:15:56.281 --rc genhtml_function_coverage=1 00:15:56.281 --rc genhtml_legend=1 00:15:56.281 --rc geninfo_all_blocks=1 00:15:56.281 --rc geninfo_unexecuted_blocks=1 00:15:56.281 00:15:56.281 ' 00:15:56.281 23:08:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:56.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.281 --rc genhtml_branch_coverage=1 00:15:56.281 --rc genhtml_function_coverage=1 00:15:56.281 --rc genhtml_legend=1 00:15:56.281 --rc geninfo_all_blocks=1 00:15:56.281 --rc geninfo_unexecuted_blocks=1 00:15:56.281 00:15:56.281 ' 00:15:56.281 23:08:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:56.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.281 --rc genhtml_branch_coverage=1 00:15:56.281 --rc genhtml_function_coverage=1 00:15:56.281 --rc genhtml_legend=1 00:15:56.281 --rc geninfo_all_blocks=1 00:15:56.281 --rc geninfo_unexecuted_blocks=1 00:15:56.281 00:15:56.281 ' 00:15:56.281 23:08:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:56.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.282 --rc genhtml_branch_coverage=1 00:15:56.282 --rc genhtml_function_coverage=1 00:15:56.282 --rc genhtml_legend=1 00:15:56.282 --rc geninfo_all_blocks=1 00:15:56.282 --rc geninfo_unexecuted_blocks=1 00:15:56.282 00:15:56.282 ' 00:15:56.282 23:08:22 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:56.282 23:08:22 -- nvmf/common.sh@7 -- # uname -s 00:15:56.282 23:08:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:56.282 23:08:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:56.282 23:08:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:56.282 23:08:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:56.282 23:08:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:56.282 23:08:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:56.282 23:08:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:56.282 23:08:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:56.282 23:08:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:56.282 23:08:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:56.282 23:08:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.282 23:08:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.282 23:08:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:56.282 23:08:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:56.282 23:08:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:56.282 23:08:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:56.282 23:08:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:56.282 23:08:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:56.282 23:08:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:56.282 23:08:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.282 23:08:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.282 23:08:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.282 23:08:22 -- paths/export.sh@5 -- # export PATH 00:15:56.282 23:08:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.282 23:08:22 -- nvmf/common.sh@46 -- # : 0 00:15:56.282 23:08:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:56.282 23:08:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:56.282 23:08:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:56.282 23:08:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:56.282 23:08:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:56.282 23:08:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:56.282 23:08:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:56.282 23:08:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:56.282 23:08:22 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:56.282 23:08:22 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:56.282 23:08:22 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:56.282 23:08:22 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:56.282 23:08:22 -- target/multipath.sh@43 -- # nvmftestinit 00:15:56.282 23:08:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:56.282 23:08:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:56.282 23:08:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:56.282 23:08:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:56.282 23:08:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:56.282 23:08:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.282 23:08:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.282 23:08:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.282 23:08:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:56.282 23:08:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:56.282 23:08:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:56.282 23:08:22 -- common/autotest_common.sh@10 -- # set +x 00:15:58.183 23:08:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:58.183 23:08:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:58.183 23:08:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:58.183 23:08:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:58.183 23:08:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:58.183 23:08:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:58.183 23:08:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:58.183 23:08:24 -- nvmf/common.sh@294 -- # net_devs=() 00:15:58.183 23:08:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:58.183 23:08:24 -- nvmf/common.sh@295 -- # e810=() 00:15:58.183 23:08:24 -- nvmf/common.sh@295 -- # local -ga e810 00:15:58.183 23:08:24 -- nvmf/common.sh@296 -- # x722=() 00:15:58.183 23:08:24 -- nvmf/common.sh@296 -- # local -ga x722 00:15:58.183 23:08:24 -- nvmf/common.sh@297 -- # mlx=() 00:15:58.183 23:08:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:58.183 23:08:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:58.183 23:08:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:58.183 23:08:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:58.183 23:08:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:58.183 23:08:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.183 23:08:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:58.183 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:58.183 23:08:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.183 23:08:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:58.183 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:58.183 23:08:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.183 23:08:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.184 23:08:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.184 23:08:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.184 23:08:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.184 23:08:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:58.184 23:08:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:58.184 23:08:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:58.184 23:08:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.184 23:08:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.184 23:08:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.184 23:08:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.184 23:08:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:58.184 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:58.184 23:08:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.184 23:08:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.184 23:08:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.184 23:08:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.184 23:08:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.184 23:08:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:58.184 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:58.184 23:08:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.184 23:08:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:58.184 23:08:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:58.184 23:08:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:58.184 23:08:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:58.184 23:08:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:58.184 23:08:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:58.184 23:08:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:58.184 23:08:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:58.184 23:08:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:58.184 23:08:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:58.184 23:08:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:58.184 23:08:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:58.184 23:08:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:58.184 23:08:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:58.184 23:08:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:58.184 23:08:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:58.184 23:08:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:58.184 23:08:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:58.184 23:08:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:58.184 23:08:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:58.184 23:08:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:58.184 23:08:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:58.443 23:08:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:58.443 23:08:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:58.443 23:08:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:58.443 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:58.443 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:15:58.443 00:15:58.443 --- 10.0.0.2 ping statistics --- 00:15:58.443 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.443 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:15:58.443 23:08:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:58.443 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:58.443 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:15:58.443 00:15:58.443 --- 10.0.0.1 ping statistics --- 00:15:58.443 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.443 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:15:58.443 23:08:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:58.443 23:08:24 -- nvmf/common.sh@410 -- # return 0 00:15:58.443 23:08:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:58.443 23:08:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:58.443 23:08:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:58.443 23:08:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:58.443 23:08:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:58.443 23:08:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:58.443 23:08:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:58.443 23:08:24 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:58.443 23:08:24 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:58.443 only one NIC for nvmf test 00:15:58.443 23:08:24 -- target/multipath.sh@47 -- # nvmftestfini 00:15:58.443 23:08:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:58.443 23:08:24 -- nvmf/common.sh@116 -- # sync 00:15:58.443 23:08:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:58.443 23:08:24 -- nvmf/common.sh@119 -- # set +e 00:15:58.443 23:08:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:58.443 23:08:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:58.443 rmmod nvme_tcp 00:15:58.443 rmmod nvme_fabrics 00:15:58.443 rmmod nvme_keyring 00:15:58.443 23:08:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:58.443 23:08:24 -- nvmf/common.sh@123 -- # set -e 00:15:58.443 23:08:24 -- nvmf/common.sh@124 -- # return 0 00:15:58.443 23:08:24 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:58.443 23:08:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:58.443 23:08:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:58.443 23:08:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:58.443 23:08:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:58.443 23:08:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:58.443 23:08:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.443 23:08:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.443 23:08:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.982 23:08:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.982 23:08:26 -- target/multipath.sh@48 -- # exit 0 00:16:00.982 23:08:26 -- target/multipath.sh@1 -- # nvmftestfini 00:16:00.982 23:08:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:00.982 23:08:26 -- nvmf/common.sh@116 -- # sync 00:16:00.982 23:08:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:00.982 23:08:26 -- nvmf/common.sh@119 -- # set +e 00:16:00.982 23:08:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:00.982 23:08:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:00.982 23:08:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:00.982 23:08:26 -- nvmf/common.sh@123 -- # set -e 00:16:00.982 23:08:26 -- nvmf/common.sh@124 -- # return 0 00:16:00.982 23:08:26 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:00.982 23:08:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:00.982 23:08:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:00.982 23:08:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:00.982 23:08:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:00.982 23:08:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:00.982 23:08:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.982 23:08:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.982 23:08:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.982 23:08:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.982 00:16:00.982 real 0m4.475s 00:16:00.982 user 0m0.872s 00:16:00.982 sys 0m1.563s 00:16:00.982 23:08:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:00.982 23:08:26 -- common/autotest_common.sh@10 -- # set +x 00:16:00.982 ************************************ 00:16:00.982 END TEST nvmf_multipath 00:16:00.982 ************************************ 00:16:00.982 23:08:26 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:00.982 23:08:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:00.982 23:08:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:00.982 23:08:26 -- common/autotest_common.sh@10 -- # set +x 00:16:00.982 ************************************ 00:16:00.982 START TEST nvmf_zcopy 00:16:00.982 ************************************ 00:16:00.982 23:08:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:00.982 * Looking for test storage... 00:16:00.982 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:00.982 23:08:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:00.982 23:08:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:00.982 23:08:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:00.982 23:08:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:00.982 23:08:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:00.982 23:08:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:00.982 23:08:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:00.982 23:08:26 -- scripts/common.sh@335 -- # IFS=.-: 00:16:00.982 23:08:26 -- scripts/common.sh@335 -- # read -ra ver1 00:16:00.982 23:08:26 -- scripts/common.sh@336 -- # IFS=.-: 00:16:00.982 23:08:26 -- scripts/common.sh@336 -- # read -ra ver2 00:16:00.982 23:08:26 -- scripts/common.sh@337 -- # local 'op=<' 00:16:00.982 23:08:26 -- scripts/common.sh@339 -- # ver1_l=2 00:16:00.982 23:08:26 -- scripts/common.sh@340 -- # ver2_l=1 00:16:00.982 23:08:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:00.982 23:08:26 -- scripts/common.sh@343 -- # case "$op" in 00:16:00.982 23:08:26 -- scripts/common.sh@344 -- # : 1 00:16:00.982 23:08:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:00.982 23:08:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:00.982 23:08:26 -- scripts/common.sh@364 -- # decimal 1 00:16:00.982 23:08:26 -- scripts/common.sh@352 -- # local d=1 00:16:00.982 23:08:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:00.982 23:08:26 -- scripts/common.sh@354 -- # echo 1 00:16:00.982 23:08:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:00.982 23:08:26 -- scripts/common.sh@365 -- # decimal 2 00:16:00.982 23:08:26 -- scripts/common.sh@352 -- # local d=2 00:16:00.982 23:08:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:00.982 23:08:26 -- scripts/common.sh@354 -- # echo 2 00:16:00.982 23:08:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:00.982 23:08:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:00.982 23:08:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:00.982 23:08:26 -- scripts/common.sh@367 -- # return 0 00:16:00.982 23:08:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:00.982 23:08:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:00.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.982 --rc genhtml_branch_coverage=1 00:16:00.982 --rc genhtml_function_coverage=1 00:16:00.982 --rc genhtml_legend=1 00:16:00.982 --rc geninfo_all_blocks=1 00:16:00.982 --rc geninfo_unexecuted_blocks=1 00:16:00.982 00:16:00.982 ' 00:16:00.982 23:08:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:00.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.982 --rc genhtml_branch_coverage=1 00:16:00.982 --rc genhtml_function_coverage=1 00:16:00.982 --rc genhtml_legend=1 00:16:00.982 --rc geninfo_all_blocks=1 00:16:00.982 --rc geninfo_unexecuted_blocks=1 00:16:00.982 00:16:00.982 ' 00:16:00.982 23:08:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:00.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.982 --rc genhtml_branch_coverage=1 00:16:00.982 --rc genhtml_function_coverage=1 00:16:00.982 --rc genhtml_legend=1 00:16:00.982 --rc geninfo_all_blocks=1 00:16:00.982 --rc geninfo_unexecuted_blocks=1 00:16:00.982 00:16:00.982 ' 00:16:00.982 23:08:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:00.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.982 --rc genhtml_branch_coverage=1 00:16:00.982 --rc genhtml_function_coverage=1 00:16:00.982 --rc genhtml_legend=1 00:16:00.982 --rc geninfo_all_blocks=1 00:16:00.982 --rc geninfo_unexecuted_blocks=1 00:16:00.982 00:16:00.982 ' 00:16:00.982 23:08:26 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:00.983 23:08:26 -- nvmf/common.sh@7 -- # uname -s 00:16:00.983 23:08:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:00.983 23:08:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:00.983 23:08:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:00.983 23:08:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:00.983 23:08:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:00.983 23:08:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:00.983 23:08:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:00.983 23:08:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:00.983 23:08:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:00.983 23:08:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:00.983 23:08:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.983 23:08:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.983 23:08:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:00.983 23:08:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:00.983 23:08:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:00.983 23:08:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:00.983 23:08:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:00.983 23:08:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:00.983 23:08:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:00.983 23:08:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.983 23:08:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.983 23:08:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.983 23:08:26 -- paths/export.sh@5 -- # export PATH 00:16:00.983 23:08:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.983 23:08:26 -- nvmf/common.sh@46 -- # : 0 00:16:00.983 23:08:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:00.983 23:08:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:00.983 23:08:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:00.983 23:08:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:00.983 23:08:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:00.983 23:08:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:00.983 23:08:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:00.983 23:08:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:00.983 23:08:26 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:00.983 23:08:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:00.983 23:08:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:00.983 23:08:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:00.983 23:08:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:00.983 23:08:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:00.983 23:08:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.983 23:08:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.983 23:08:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.983 23:08:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:00.983 23:08:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:00.983 23:08:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:00.983 23:08:26 -- common/autotest_common.sh@10 -- # set +x 00:16:02.892 23:08:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:02.892 23:08:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:02.893 23:08:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:02.893 23:08:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:02.893 23:08:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:02.893 23:08:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:02.893 23:08:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:02.893 23:08:29 -- nvmf/common.sh@294 -- # net_devs=() 00:16:02.893 23:08:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:02.893 23:08:29 -- nvmf/common.sh@295 -- # e810=() 00:16:02.893 23:08:29 -- nvmf/common.sh@295 -- # local -ga e810 00:16:02.893 23:08:29 -- nvmf/common.sh@296 -- # x722=() 00:16:02.893 23:08:29 -- nvmf/common.sh@296 -- # local -ga x722 00:16:02.893 23:08:29 -- nvmf/common.sh@297 -- # mlx=() 00:16:02.893 23:08:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:02.893 23:08:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:02.893 23:08:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:02.893 23:08:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:02.893 23:08:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:02.893 23:08:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:02.893 23:08:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:02.893 23:08:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:02.893 23:08:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:02.893 23:08:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:02.893 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:02.893 23:08:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:02.893 23:08:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:02.893 23:08:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:02.893 23:08:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:02.893 23:08:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:02.893 23:08:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:02.893 23:08:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:02.894 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:02.894 23:08:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:02.894 23:08:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:02.894 23:08:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:02.894 23:08:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:02.894 23:08:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:02.894 23:08:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:02.894 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:02.894 23:08:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:02.894 23:08:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:02.894 23:08:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:02.894 23:08:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:02.894 23:08:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:02.894 23:08:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:02.894 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:02.894 23:08:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:02.894 23:08:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:02.894 23:08:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:02.894 23:08:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:02.894 23:08:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:02.894 23:08:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:02.894 23:08:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:02.894 23:08:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:02.894 23:08:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:02.894 23:08:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:02.894 23:08:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:02.894 23:08:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:02.894 23:08:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:02.895 23:08:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:02.895 23:08:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:02.895 23:08:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:02.895 23:08:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:02.895 23:08:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:02.895 23:08:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:02.895 23:08:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:02.895 23:08:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:02.895 23:08:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:02.895 23:08:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:02.895 23:08:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:02.895 23:08:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:02.895 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:02.895 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.318 ms 00:16:02.895 00:16:02.895 --- 10.0.0.2 ping statistics --- 00:16:02.895 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:02.895 rtt min/avg/max/mdev = 0.318/0.318/0.318/0.000 ms 00:16:02.895 23:08:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:02.895 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:02.895 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:16:02.895 00:16:02.895 --- 10.0.0.1 ping statistics --- 00:16:02.895 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:02.895 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:16:02.895 23:08:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:02.895 23:08:29 -- nvmf/common.sh@410 -- # return 0 00:16:02.895 23:08:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:02.895 23:08:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:02.895 23:08:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:02.895 23:08:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:02.895 23:08:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:02.895 23:08:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:02.895 23:08:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:02.895 23:08:29 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:02.895 23:08:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:02.895 23:08:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:02.895 23:08:29 -- common/autotest_common.sh@10 -- # set +x 00:16:02.895 23:08:29 -- nvmf/common.sh@469 -- # nvmfpid=202077 00:16:02.895 23:08:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:02.895 23:08:29 -- nvmf/common.sh@470 -- # waitforlisten 202077 00:16:02.895 23:08:29 -- common/autotest_common.sh@829 -- # '[' -z 202077 ']' 00:16:02.895 23:08:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:02.895 23:08:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:02.896 23:08:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:02.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:02.896 23:08:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:02.896 23:08:29 -- common/autotest_common.sh@10 -- # set +x 00:16:02.896 [2024-11-26 23:08:29.228264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:02.896 [2024-11-26 23:08:29.228338] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:02.896 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.157 [2024-11-26 23:08:29.294881] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:03.157 [2024-11-26 23:08:29.405431] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:03.157 [2024-11-26 23:08:29.405606] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:03.157 [2024-11-26 23:08:29.405626] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:03.157 [2024-11-26 23:08:29.405638] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:03.157 [2024-11-26 23:08:29.405670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:04.091 23:08:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:04.091 23:08:30 -- common/autotest_common.sh@862 -- # return 0 00:16:04.091 23:08:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:04.091 23:08:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:04.091 23:08:30 -- common/autotest_common.sh@10 -- # set +x 00:16:04.091 23:08:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:04.091 23:08:30 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:04.091 23:08:30 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:04.091 23:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.091 23:08:30 -- common/autotest_common.sh@10 -- # set +x 00:16:04.091 [2024-11-26 23:08:30.268359] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:04.091 23:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.091 23:08:30 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:04.091 23:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.091 23:08:30 -- common/autotest_common.sh@10 -- # set +x 00:16:04.091 23:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.091 23:08:30 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:04.091 23:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.091 23:08:30 -- common/autotest_common.sh@10 -- # set +x 00:16:04.091 [2024-11-26 23:08:30.284588] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:04.091 23:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.091 23:08:30 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:04.091 23:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.091 23:08:30 -- common/autotest_common.sh@10 -- # set +x 00:16:04.091 23:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.091 23:08:30 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:04.091 23:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.091 23:08:30 -- common/autotest_common.sh@10 -- # set +x 00:16:04.091 malloc0 00:16:04.091 23:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.091 23:08:30 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:04.091 23:08:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.091 23:08:30 -- common/autotest_common.sh@10 -- # set +x 00:16:04.091 23:08:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.091 23:08:30 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:04.091 23:08:30 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:04.091 23:08:30 -- nvmf/common.sh@520 -- # config=() 00:16:04.091 23:08:30 -- nvmf/common.sh@520 -- # local subsystem config 00:16:04.091 23:08:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:04.091 23:08:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:04.091 { 00:16:04.091 "params": { 00:16:04.091 "name": "Nvme$subsystem", 00:16:04.091 "trtype": "$TEST_TRANSPORT", 00:16:04.091 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:04.091 "adrfam": "ipv4", 00:16:04.091 "trsvcid": "$NVMF_PORT", 00:16:04.091 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:04.091 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:04.091 "hdgst": ${hdgst:-false}, 00:16:04.091 "ddgst": ${ddgst:-false} 00:16:04.091 }, 00:16:04.091 "method": "bdev_nvme_attach_controller" 00:16:04.091 } 00:16:04.091 EOF 00:16:04.091 )") 00:16:04.091 23:08:30 -- nvmf/common.sh@542 -- # cat 00:16:04.091 23:08:30 -- nvmf/common.sh@544 -- # jq . 00:16:04.091 23:08:30 -- nvmf/common.sh@545 -- # IFS=, 00:16:04.091 23:08:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:04.091 "params": { 00:16:04.091 "name": "Nvme1", 00:16:04.091 "trtype": "tcp", 00:16:04.091 "traddr": "10.0.0.2", 00:16:04.091 "adrfam": "ipv4", 00:16:04.091 "trsvcid": "4420", 00:16:04.091 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:04.091 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:04.091 "hdgst": false, 00:16:04.091 "ddgst": false 00:16:04.091 }, 00:16:04.091 "method": "bdev_nvme_attach_controller" 00:16:04.091 }' 00:16:04.092 [2024-11-26 23:08:30.364100] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:04.092 [2024-11-26 23:08:30.364173] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid202236 ] 00:16:04.092 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.092 [2024-11-26 23:08:30.434491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:04.350 [2024-11-26 23:08:30.553854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:04.609 Running I/O for 10 seconds... 00:16:14.570 00:16:14.570 Latency(us) 00:16:14.570 [2024-11-26T22:08:40.964Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:14.570 [2024-11-26T22:08:40.964Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:14.570 Verification LBA range: start 0x0 length 0x1000 00:16:14.570 Nvme1n1 : 10.01 8684.10 67.84 0.00 0.00 14703.85 1808.31 22136.60 00:16:14.570 [2024-11-26T22:08:40.964Z] =================================================================================================================== 00:16:14.570 [2024-11-26T22:08:40.964Z] Total : 8684.10 67.84 0.00 0.00 14703.85 1808.31 22136.60 00:16:14.828 23:08:41 -- target/zcopy.sh@39 -- # perfpid=203503 00:16:14.828 23:08:41 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:14.828 23:08:41 -- common/autotest_common.sh@10 -- # set +x 00:16:14.828 23:08:41 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:14.828 23:08:41 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:14.828 23:08:41 -- nvmf/common.sh@520 -- # config=() 00:16:14.828 23:08:41 -- nvmf/common.sh@520 -- # local subsystem config 00:16:14.828 23:08:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:14.828 23:08:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:14.828 { 00:16:14.829 "params": { 00:16:14.829 "name": "Nvme$subsystem", 00:16:14.829 "trtype": "$TEST_TRANSPORT", 00:16:14.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:14.829 "adrfam": "ipv4", 00:16:14.829 "trsvcid": "$NVMF_PORT", 00:16:14.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:14.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:14.829 "hdgst": ${hdgst:-false}, 00:16:14.829 "ddgst": ${ddgst:-false} 00:16:14.829 }, 00:16:14.829 "method": "bdev_nvme_attach_controller" 00:16:14.829 } 00:16:14.829 EOF 00:16:14.829 )") 00:16:14.829 23:08:41 -- nvmf/common.sh@542 -- # cat 00:16:14.829 [2024-11-26 23:08:41.111786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.111834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 23:08:41 -- nvmf/common.sh@544 -- # jq . 00:16:14.829 23:08:41 -- nvmf/common.sh@545 -- # IFS=, 00:16:14.829 23:08:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:14.829 "params": { 00:16:14.829 "name": "Nvme1", 00:16:14.829 "trtype": "tcp", 00:16:14.829 "traddr": "10.0.0.2", 00:16:14.829 "adrfam": "ipv4", 00:16:14.829 "trsvcid": "4420", 00:16:14.829 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:14.829 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:14.829 "hdgst": false, 00:16:14.829 "ddgst": false 00:16:14.829 }, 00:16:14.829 "method": "bdev_nvme_attach_controller" 00:16:14.829 }' 00:16:14.829 [2024-11-26 23:08:41.119751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.119778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.127762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.127785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.135783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.135814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.143804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.143841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.147742] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:14.829 [2024-11-26 23:08:41.147837] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid203503 ] 00:16:14.829 [2024-11-26 23:08:41.151842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.151868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.159868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.159893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.167891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.167916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.175900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.175924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.829 [2024-11-26 23:08:41.183927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.183952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.191959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.191983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.199975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.199999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.207998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.208024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.216020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.829 [2024-11-26 23:08:41.216044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.829 [2024-11-26 23:08:41.217138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.088 [2024-11-26 23:08:41.224081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.224118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.232095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.232133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.240089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.240113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.248111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.248135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.256136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.256161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.264155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.264179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.272177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.272201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.280201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.280226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.288252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.288287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.296256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.296282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.304272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.304297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.312292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.312317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.320314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.320338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.328338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.328362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.336360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.336384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.337262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:15.088 [2024-11-26 23:08:41.344381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.344405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.352416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.352445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.360452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.360490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.368469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.368504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.376498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.376542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.384522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.384580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.392550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.392598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.400585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.400618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.408583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.408605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.416623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.416661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.424640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.424672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.432658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.432689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.440649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.440669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.448670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.448690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.456712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.456734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.464724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.464749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-26 23:08:41.472746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-26 23:08:41.472770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.480773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.480797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.488795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.488832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.496832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.496855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.504856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.504899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.512889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.512914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.520920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.520949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.528913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.528951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 Running I/O for 5 seconds... 00:16:15.347 [2024-11-26 23:08:41.536965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.536990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.551407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.551435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.562552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.562591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.575185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.575212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.585094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.585120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.596251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.596278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.609032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.609060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.619117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.619144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.629749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.629777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.640427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.640457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.651705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.651733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.665003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.665031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.675473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.675500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.685980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.686006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.696423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.696450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.706924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.706950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.717797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.717839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.727906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.727933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.347 [2024-11-26 23:08:41.738469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.347 [2024-11-26 23:08:41.738499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.751107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.751135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.759970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.759997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.771762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.771790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.782298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.782325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.792686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.792713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.802820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.802846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.813777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.813804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.826333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.826360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.836432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.836477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.847348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.847374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.860260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.860286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.870466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.870492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.880781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.880808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.893786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.893813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.904045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.904072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.914694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.914735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.927677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.927718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.937635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.937662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.948067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.948093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.960947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.960977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.971832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.971863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.982736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.982766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.606 [2024-11-26 23:08:41.993711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.606 [2024-11-26 23:08:41.993741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.005098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.005128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.015890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.015921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.026638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.026668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.037707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.037737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.048458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.048488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.059300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.059330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.069812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.069842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.080996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.081026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.092143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.092173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.105477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.105506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.115994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.116024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.127261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.127291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.139802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.139832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.149148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.149179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.160659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.160689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.171643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.171679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.182734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.182764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.194019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.194049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.207514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.207574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.218368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.218398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.229723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.229754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.240129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.240170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.865 [2024-11-26 23:08:42.250805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.865 [2024-11-26 23:08:42.250837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.261799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.261830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.272658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.272689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.283239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.283268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.294370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.294400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.305579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.305609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.316664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.316694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.327662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.327693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.338656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.338686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.349495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.349534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.362298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.362327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.371861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.371890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.382820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.382850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.395601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.395631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.405576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.405606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.416605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.416643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.427661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.427690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.438884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.438914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.449966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.449995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.461001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.461031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.473760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.473790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.484198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.484228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.495056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.495086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.124 [2024-11-26 23:08:42.507655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.124 [2024-11-26 23:08:42.507684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.517770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.517800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.528706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.528736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.539471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.539501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.550209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.550240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.562728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.562759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.572112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.572141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.585551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.585583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.596480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.596510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.607443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.607473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.618684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.618714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.630028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.630066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.640980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.641010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.653759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.653789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.663354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.663385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.675502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.675542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.686331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.686361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.697223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.697253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.708086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.708116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.718778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.718809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.729691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.729721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.742639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.742670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.752968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.752997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.383 [2024-11-26 23:08:42.763509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.383 [2024-11-26 23:08:42.763548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.776862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.776892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.786942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.786972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.797709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.797738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.808491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.808522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.819355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.819384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.831651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.831680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.840754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.840792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.852558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.852587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.863077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.863107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.873873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.873902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.885042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.885072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.895967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.895996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.906964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.906994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.917973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.918003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.929166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.929196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.939820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.939850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.951051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.951081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.962316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.962346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.973144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.973174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.984493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.984523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:42.997474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:42.997504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:43.007598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:43.007628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:43.018854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:43.018885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.642 [2024-11-26 23:08:43.029682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.642 [2024-11-26 23:08:43.029712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.040659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.040689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.053782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.053811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.063943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.063973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.074805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.074835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.088005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.088035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.098860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.098891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.109979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.110009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.122697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.122727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.133126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.133156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.900 [2024-11-26 23:08:43.143595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.900 [2024-11-26 23:08:43.143624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.154385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.154415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.166713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.166743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.176059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.176088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.189660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.189690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.200329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.200359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.211254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.211284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.224098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.224128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.234669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.234699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.245596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.245626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.256565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.256596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.267147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.267176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.279842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.279872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.901 [2024-11-26 23:08:43.289676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.901 [2024-11-26 23:08:43.289706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.301623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.301652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.312625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.312654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.323880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.323910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.336577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.336606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.345818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.345848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.357707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.357738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.370282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.370312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.380789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.380819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.391305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.391336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.402225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.402255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.413103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.413133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.424176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.424205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.435514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.435556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.446726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.446756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.457632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.457663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.471373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.471403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.482551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.482580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.493622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.493651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.507072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.507102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.517216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.517246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.527992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.528021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.538824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.538855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.159 [2024-11-26 23:08:43.549692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.159 [2024-11-26 23:08:43.549722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.560830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.560862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.572087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.572117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.583311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.583342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.594304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.594334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.605105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.605135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.616438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.616468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.627824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.627854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.640801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.640831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.651120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.651149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.662129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.662159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.675161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.675191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.685959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.685989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.696739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.696769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.709319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.709350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.718287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.718316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.731620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.731650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.742256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.742286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.753061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.418 [2024-11-26 23:08:43.753090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.418 [2024-11-26 23:08:43.765665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.419 [2024-11-26 23:08:43.765694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.419 [2024-11-26 23:08:43.774800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.419 [2024-11-26 23:08:43.774829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.419 [2024-11-26 23:08:43.786645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.419 [2024-11-26 23:08:43.786676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.419 [2024-11-26 23:08:43.797749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.419 [2024-11-26 23:08:43.797778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.419 [2024-11-26 23:08:43.808807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.419 [2024-11-26 23:08:43.808838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.819476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.819506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.830820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.830851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.841624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.841653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.854600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.854638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.864899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.864930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.876457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.876487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.887653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.887684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.900368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.900407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.909819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.909849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.923327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.923357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.933894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.933924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.945129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.945159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.957708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.957738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.968101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.677 [2024-11-26 23:08:43.968131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.677 [2024-11-26 23:08:43.978654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.678 [2024-11-26 23:08:43.978684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.678 [2024-11-26 23:08:43.992121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.678 [2024-11-26 23:08:43.992150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.678 [2024-11-26 23:08:44.002743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.678 [2024-11-26 23:08:44.002774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.678 [2024-11-26 23:08:44.013434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.678 [2024-11-26 23:08:44.013464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.678 [2024-11-26 23:08:44.025921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.678 [2024-11-26 23:08:44.025951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.678 [2024-11-26 23:08:44.035315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.678 [2024-11-26 23:08:44.035345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.678 [2024-11-26 23:08:44.047259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.678 [2024-11-26 23:08:44.047289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.678 [2024-11-26 23:08:44.060708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.678 [2024-11-26 23:08:44.060738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.070972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.071002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.081868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.081898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.094188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.094218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.103274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.103303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.116823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.116862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.127291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.127321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.138109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.138138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.151316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.151346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.161864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.161894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.172827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.172857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.184242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.184271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.195194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.195224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.207697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.207728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.217552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.217582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.228106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.228136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.238911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.238941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.251702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.936 [2024-11-26 23:08:44.251732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.936 [2024-11-26 23:08:44.261875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.937 [2024-11-26 23:08:44.261905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.937 [2024-11-26 23:08:44.272510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.937 [2024-11-26 23:08:44.272551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.937 [2024-11-26 23:08:44.285911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.937 [2024-11-26 23:08:44.285940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.937 [2024-11-26 23:08:44.295760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.937 [2024-11-26 23:08:44.295790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.937 [2024-11-26 23:08:44.306405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.937 [2024-11-26 23:08:44.306435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.937 [2024-11-26 23:08:44.316967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.937 [2024-11-26 23:08:44.316996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.937 [2024-11-26 23:08:44.328142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.937 [2024-11-26 23:08:44.328181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.339484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.339514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.350615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.350644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.361919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.361948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.374987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.375017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.385385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.385415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.396550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.396580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.409055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.409085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.419055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.419085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.429813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.429842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.440855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.440885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.451982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.452011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.462893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.462923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.474274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.474304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.485463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.485493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.496183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.496214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.506894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.506924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.517756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.517792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.530437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.530467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.540654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.540692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.551639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.551668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.564935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.564966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.576397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.576427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.195 [2024-11-26 23:08:44.586251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.195 [2024-11-26 23:08:44.586282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.597850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.597879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.608304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.608334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.619103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.619133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.629609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.629639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.640796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.640826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.651691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.651720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.662788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.662818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.673737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.673767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.684711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.684741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.695380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.695409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.706451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.706480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.717827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.717856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.730751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.730781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.740850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.740880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.751440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.751470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.764427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.764457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.774273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.774304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.785593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.785622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.797097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.797127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.807856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.807886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.820244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.820274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.829858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.829889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.454 [2024-11-26 23:08:44.841108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.454 [2024-11-26 23:08:44.841137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.853653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.853683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.863155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.863185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.874780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.874810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.886086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.886116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.897388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.897418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.908226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.908260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.918552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.918582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.929536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.929565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.942130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.942161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.951912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.951942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.962694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.962725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.973665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.973696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.984615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.984645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:44.995942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:44.995972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.007194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.007224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.018030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.018060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.028746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.028776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.041549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.041580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.052026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.052056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.062872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.062902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.073907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.073937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.084757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.084787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.713 [2024-11-26 23:08:45.095924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.713 [2024-11-26 23:08:45.095954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.106921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.106950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.118319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.118349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.129237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.129267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.140590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.140619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.153253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.153284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.163258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.163288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.174374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.174404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.185551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.185581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.196649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.196678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.208225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.208254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.218936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.218966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.229652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.229682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.240252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.240282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.251391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.251421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.264224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.264254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.274018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.274047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.284621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.284650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.295366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.295395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.306764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.306793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.317802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.317831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.328681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.328710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.339587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.339619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.350898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.350928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.972 [2024-11-26 23:08:45.361854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.972 [2024-11-26 23:08:45.361883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.372761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.372791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.384063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.384093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.395169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.395199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.406673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.406702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.418026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.418056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.428568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.428597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.439389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.439419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.452628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.452657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.462718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.462747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.473753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.473782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.486490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.486519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.496563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.496593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.507859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.507889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.520744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.520774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.530923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.530953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.542093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.542123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.553184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.553214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.563943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.563973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.574722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.574751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.230 [2024-11-26 23:08:45.585804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.230 [2024-11-26 23:08:45.585843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.231 [2024-11-26 23:08:45.596967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.231 [2024-11-26 23:08:45.596998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.231 [2024-11-26 23:08:45.607939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.231 [2024-11-26 23:08:45.607969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.231 [2024-11-26 23:08:45.620769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.231 [2024-11-26 23:08:45.620799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.489 [2024-11-26 23:08:45.630339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.489 [2024-11-26 23:08:45.630371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.489 [2024-11-26 23:08:45.642253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.489 [2024-11-26 23:08:45.642285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.489 [2024-11-26 23:08:45.653330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.489 [2024-11-26 23:08:45.653368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.489 [2024-11-26 23:08:45.664467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.489 [2024-11-26 23:08:45.664498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.489 [2024-11-26 23:08:45.675510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.489 [2024-11-26 23:08:45.675549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.489 [2024-11-26 23:08:45.688358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.489 [2024-11-26 23:08:45.688389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.489 [2024-11-26 23:08:45.698571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.698607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.709945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.709975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.720940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.720970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.732011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.732041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.743013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.743043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.754173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.754203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.766938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.766967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.777388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.777417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.788782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.788813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.801567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.801607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.812018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.812048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.823397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.823427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.834780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.834809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.846154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.846184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.857015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.857046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.867857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.867887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.490 [2024-11-26 23:08:45.878746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.490 [2024-11-26 23:08:45.878775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.890068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.890098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.901379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.901409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.914271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.914300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.924746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.924776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.935665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.935694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.947011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.947041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.957792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.957821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.970600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.970630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.980931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.980960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:45.991541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:45.991570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:46.004104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:46.004134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:46.014548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:46.014587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:46.025300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:46.025330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:46.035845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.748 [2024-11-26 23:08:46.035874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.748 [2024-11-26 23:08:46.047206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.047236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.749 [2024-11-26 23:08:46.060201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.060232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.749 [2024-11-26 23:08:46.070361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.070391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.749 [2024-11-26 23:08:46.081572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.081602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.749 [2024-11-26 23:08:46.092458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.092488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.749 [2024-11-26 23:08:46.103887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.103917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.749 [2024-11-26 23:08:46.114963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.114995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.749 [2024-11-26 23:08:46.126291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.126321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.749 [2024-11-26 23:08:46.137021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.749 [2024-11-26 23:08:46.137051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.148049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.148079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.159398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.159429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.172509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.172549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.182892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.182922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.193651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.193681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.204739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.204768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.215869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.215899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.226810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.226849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.238312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.238342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.251021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.251052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.260032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.260061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.273091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.273120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.283447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.283476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.294024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.294054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.304778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.304808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.315294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.315324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.326264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.326295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.337102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.337132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.350405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.350436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.360721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.360751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.371684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.371714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.382927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.382957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.007 [2024-11-26 23:08:46.393654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.007 [2024-11-26 23:08:46.393684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.404975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.405004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.416161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.416191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.426828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.426857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.437709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.437739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.450949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.450979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.461218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.461247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.472059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.472089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.482846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.482876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.494148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.494177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.507382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.507411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.517735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.517765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.532595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.532626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.543083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.543113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.553211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.553240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 00:16:20.266 Latency(us) 00:16:20.266 [2024-11-26T22:08:46.660Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:20.266 [2024-11-26T22:08:46.660Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:20.266 Nvme1n1 : 5.01 11626.94 90.84 0.00 0.00 10993.71 4757.43 26991.12 00:16:20.266 [2024-11-26T22:08:46.660Z] =================================================================================================================== 00:16:20.266 [2024-11-26T22:08:46.660Z] Total : 11626.94 90.84 0.00 0.00 10993.71 4757.43 26991.12 00:16:20.266 [2024-11-26 23:08:46.557458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.557484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.565484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.565512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.573499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.573536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.581559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.581599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.589602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.589653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.597611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.597658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.605648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.605695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.613652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.613711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.621687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.621736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.629702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.629749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.637723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.637771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.645750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.645797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.266 [2024-11-26 23:08:46.653767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.266 [2024-11-26 23:08:46.653816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.661802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.661851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.669816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.669867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.677832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.677879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.685851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.685898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.693876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.693925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.701893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.701938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.709877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.709900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.717900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.717926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.725921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.725944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.733943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.733966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.741967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.741992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.750035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.750082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.758046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.758089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.766046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.766076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.774055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.774080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.782078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.782102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.790099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.790124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.798119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.798143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.806190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.806238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.814236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.814287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.822195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.822224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.830207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.830231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 [2024-11-26 23:08:46.838229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.525 [2024-11-26 23:08:46.838253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.525 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (203503) - No such process 00:16:20.525 23:08:46 -- target/zcopy.sh@49 -- # wait 203503 00:16:20.525 23:08:46 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:20.525 23:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.525 23:08:46 -- common/autotest_common.sh@10 -- # set +x 00:16:20.525 23:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.525 23:08:46 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:20.525 23:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.525 23:08:46 -- common/autotest_common.sh@10 -- # set +x 00:16:20.525 delay0 00:16:20.525 23:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.525 23:08:46 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:20.525 23:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.525 23:08:46 -- common/autotest_common.sh@10 -- # set +x 00:16:20.525 23:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.525 23:08:46 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:20.525 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.783 [2024-11-26 23:08:47.001637] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:27.340 Initializing NVMe Controllers 00:16:27.340 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:27.340 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:27.340 Initialization complete. Launching workers. 00:16:27.340 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 102 00:16:27.340 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 389, failed to submit 33 00:16:27.340 success 225, unsuccess 164, failed 0 00:16:27.340 23:08:53 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:27.340 23:08:53 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:27.340 23:08:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:27.340 23:08:53 -- nvmf/common.sh@116 -- # sync 00:16:27.340 23:08:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:27.340 23:08:53 -- nvmf/common.sh@119 -- # set +e 00:16:27.340 23:08:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:27.340 23:08:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:27.340 rmmod nvme_tcp 00:16:27.340 rmmod nvme_fabrics 00:16:27.340 rmmod nvme_keyring 00:16:27.340 23:08:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:27.340 23:08:53 -- nvmf/common.sh@123 -- # set -e 00:16:27.341 23:08:53 -- nvmf/common.sh@124 -- # return 0 00:16:27.341 23:08:53 -- nvmf/common.sh@477 -- # '[' -n 202077 ']' 00:16:27.341 23:08:53 -- nvmf/common.sh@478 -- # killprocess 202077 00:16:27.341 23:08:53 -- common/autotest_common.sh@936 -- # '[' -z 202077 ']' 00:16:27.341 23:08:53 -- common/autotest_common.sh@940 -- # kill -0 202077 00:16:27.341 23:08:53 -- common/autotest_common.sh@941 -- # uname 00:16:27.341 23:08:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:27.341 23:08:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 202077 00:16:27.341 23:08:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:27.341 23:08:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:27.341 23:08:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 202077' 00:16:27.341 killing process with pid 202077 00:16:27.341 23:08:53 -- common/autotest_common.sh@955 -- # kill 202077 00:16:27.341 23:08:53 -- common/autotest_common.sh@960 -- # wait 202077 00:16:27.341 23:08:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:27.341 23:08:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:27.341 23:08:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:27.341 23:08:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:27.341 23:08:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:27.341 23:08:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:27.341 23:08:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:27.341 23:08:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:29.878 23:08:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:29.878 00:16:29.878 real 0m28.852s 00:16:29.878 user 0m42.735s 00:16:29.878 sys 0m7.619s 00:16:29.878 23:08:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:29.878 23:08:55 -- common/autotest_common.sh@10 -- # set +x 00:16:29.878 ************************************ 00:16:29.878 END TEST nvmf_zcopy 00:16:29.878 ************************************ 00:16:29.878 23:08:55 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:29.878 23:08:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:29.878 23:08:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:29.878 23:08:55 -- common/autotest_common.sh@10 -- # set +x 00:16:29.878 ************************************ 00:16:29.878 START TEST nvmf_nmic 00:16:29.878 ************************************ 00:16:29.878 23:08:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:29.878 * Looking for test storage... 00:16:29.878 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:29.878 23:08:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:29.878 23:08:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:29.878 23:08:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:29.878 23:08:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:29.878 23:08:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:29.878 23:08:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:29.878 23:08:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:29.878 23:08:55 -- scripts/common.sh@335 -- # IFS=.-: 00:16:29.878 23:08:55 -- scripts/common.sh@335 -- # read -ra ver1 00:16:29.878 23:08:55 -- scripts/common.sh@336 -- # IFS=.-: 00:16:29.878 23:08:55 -- scripts/common.sh@336 -- # read -ra ver2 00:16:29.878 23:08:55 -- scripts/common.sh@337 -- # local 'op=<' 00:16:29.878 23:08:55 -- scripts/common.sh@339 -- # ver1_l=2 00:16:29.878 23:08:55 -- scripts/common.sh@340 -- # ver2_l=1 00:16:29.878 23:08:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:29.878 23:08:55 -- scripts/common.sh@343 -- # case "$op" in 00:16:29.878 23:08:55 -- scripts/common.sh@344 -- # : 1 00:16:29.878 23:08:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:29.878 23:08:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:29.878 23:08:55 -- scripts/common.sh@364 -- # decimal 1 00:16:29.878 23:08:55 -- scripts/common.sh@352 -- # local d=1 00:16:29.878 23:08:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:29.878 23:08:55 -- scripts/common.sh@354 -- # echo 1 00:16:29.878 23:08:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:29.878 23:08:55 -- scripts/common.sh@365 -- # decimal 2 00:16:29.878 23:08:55 -- scripts/common.sh@352 -- # local d=2 00:16:29.878 23:08:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:29.878 23:08:55 -- scripts/common.sh@354 -- # echo 2 00:16:29.878 23:08:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:29.878 23:08:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:29.878 23:08:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:29.878 23:08:55 -- scripts/common.sh@367 -- # return 0 00:16:29.878 23:08:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:29.878 23:08:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:29.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.878 --rc genhtml_branch_coverage=1 00:16:29.878 --rc genhtml_function_coverage=1 00:16:29.878 --rc genhtml_legend=1 00:16:29.878 --rc geninfo_all_blocks=1 00:16:29.878 --rc geninfo_unexecuted_blocks=1 00:16:29.878 00:16:29.878 ' 00:16:29.878 23:08:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:29.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.878 --rc genhtml_branch_coverage=1 00:16:29.878 --rc genhtml_function_coverage=1 00:16:29.878 --rc genhtml_legend=1 00:16:29.878 --rc geninfo_all_blocks=1 00:16:29.878 --rc geninfo_unexecuted_blocks=1 00:16:29.878 00:16:29.878 ' 00:16:29.878 23:08:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:29.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.878 --rc genhtml_branch_coverage=1 00:16:29.878 --rc genhtml_function_coverage=1 00:16:29.878 --rc genhtml_legend=1 00:16:29.878 --rc geninfo_all_blocks=1 00:16:29.878 --rc geninfo_unexecuted_blocks=1 00:16:29.878 00:16:29.878 ' 00:16:29.878 23:08:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:29.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.878 --rc genhtml_branch_coverage=1 00:16:29.878 --rc genhtml_function_coverage=1 00:16:29.878 --rc genhtml_legend=1 00:16:29.878 --rc geninfo_all_blocks=1 00:16:29.878 --rc geninfo_unexecuted_blocks=1 00:16:29.878 00:16:29.878 ' 00:16:29.878 23:08:55 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:29.878 23:08:55 -- nvmf/common.sh@7 -- # uname -s 00:16:29.878 23:08:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:29.878 23:08:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:29.878 23:08:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:29.878 23:08:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:29.878 23:08:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:29.878 23:08:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:29.878 23:08:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:29.878 23:08:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:29.878 23:08:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:29.878 23:08:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:29.878 23:08:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.878 23:08:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.878 23:08:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:29.878 23:08:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:29.878 23:08:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:29.878 23:08:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:29.878 23:08:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:29.878 23:08:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:29.878 23:08:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:29.879 23:08:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.879 23:08:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.879 23:08:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.879 23:08:55 -- paths/export.sh@5 -- # export PATH 00:16:29.879 23:08:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.879 23:08:55 -- nvmf/common.sh@46 -- # : 0 00:16:29.879 23:08:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:29.879 23:08:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:29.879 23:08:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:29.879 23:08:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:29.879 23:08:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:29.879 23:08:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:29.879 23:08:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:29.879 23:08:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:29.879 23:08:55 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:29.879 23:08:55 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:29.879 23:08:55 -- target/nmic.sh@14 -- # nvmftestinit 00:16:29.879 23:08:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:29.879 23:08:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:29.879 23:08:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:29.879 23:08:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:29.879 23:08:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:29.879 23:08:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:29.879 23:08:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:29.879 23:08:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:29.879 23:08:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:29.879 23:08:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:29.879 23:08:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:29.879 23:08:55 -- common/autotest_common.sh@10 -- # set +x 00:16:31.832 23:08:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:31.832 23:08:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:31.832 23:08:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:31.832 23:08:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:31.832 23:08:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:31.832 23:08:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:31.832 23:08:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:31.832 23:08:57 -- nvmf/common.sh@294 -- # net_devs=() 00:16:31.832 23:08:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:31.832 23:08:57 -- nvmf/common.sh@295 -- # e810=() 00:16:31.832 23:08:57 -- nvmf/common.sh@295 -- # local -ga e810 00:16:31.832 23:08:57 -- nvmf/common.sh@296 -- # x722=() 00:16:31.832 23:08:57 -- nvmf/common.sh@296 -- # local -ga x722 00:16:31.832 23:08:57 -- nvmf/common.sh@297 -- # mlx=() 00:16:31.832 23:08:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:31.832 23:08:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:31.832 23:08:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:31.832 23:08:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:31.832 23:08:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:31.832 23:08:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:31.832 23:08:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:31.832 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:31.832 23:08:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:31.832 23:08:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:31.832 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:31.832 23:08:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:31.832 23:08:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:31.832 23:08:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:31.832 23:08:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:31.832 23:08:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:31.832 23:08:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:31.832 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:31.832 23:08:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:31.832 23:08:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:31.832 23:08:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:31.832 23:08:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:31.832 23:08:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:31.832 23:08:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:31.832 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:31.832 23:08:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:31.832 23:08:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:31.832 23:08:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:31.832 23:08:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:31.832 23:08:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:31.832 23:08:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:31.832 23:08:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:31.832 23:08:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:31.832 23:08:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:31.832 23:08:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:31.832 23:08:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:31.832 23:08:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:31.832 23:08:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:31.832 23:08:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:31.832 23:08:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:31.832 23:08:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:31.832 23:08:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:31.832 23:08:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:31.832 23:08:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:31.833 23:08:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:31.833 23:08:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:31.833 23:08:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:31.833 23:08:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:31.833 23:08:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:31.833 23:08:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:31.833 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:31.833 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:16:31.833 00:16:31.833 --- 10.0.0.2 ping statistics --- 00:16:31.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:31.833 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:16:31.833 23:08:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:31.833 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:31.833 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:16:31.833 00:16:31.833 --- 10.0.0.1 ping statistics --- 00:16:31.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:31.833 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:16:31.833 23:08:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:31.833 23:08:58 -- nvmf/common.sh@410 -- # return 0 00:16:31.833 23:08:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:31.833 23:08:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:31.833 23:08:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:31.833 23:08:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:31.833 23:08:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:31.833 23:08:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:31.833 23:08:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:31.833 23:08:58 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:31.833 23:08:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:31.833 23:08:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:31.833 23:08:58 -- common/autotest_common.sh@10 -- # set +x 00:16:31.833 23:08:58 -- nvmf/common.sh@469 -- # nvmfpid=206959 00:16:31.833 23:08:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:31.833 23:08:58 -- nvmf/common.sh@470 -- # waitforlisten 206959 00:16:31.833 23:08:58 -- common/autotest_common.sh@829 -- # '[' -z 206959 ']' 00:16:31.833 23:08:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:31.833 23:08:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:31.833 23:08:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:31.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:31.833 23:08:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:31.833 23:08:58 -- common/autotest_common.sh@10 -- # set +x 00:16:31.833 [2024-11-26 23:08:58.148329] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:31.833 [2024-11-26 23:08:58.148418] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:31.833 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.114 [2024-11-26 23:08:58.219470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:32.114 [2024-11-26 23:08:58.335940] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:32.114 [2024-11-26 23:08:58.336101] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:32.114 [2024-11-26 23:08:58.336119] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:32.114 [2024-11-26 23:08:58.336132] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:32.114 [2024-11-26 23:08:58.336188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:32.114 [2024-11-26 23:08:58.336338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:32.114 [2024-11-26 23:08:58.336361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:32.114 [2024-11-26 23:08:58.336364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:33.104 23:08:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:33.104 23:08:59 -- common/autotest_common.sh@862 -- # return 0 00:16:33.104 23:08:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:33.104 23:08:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 23:08:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:33.104 23:08:59 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:33.104 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 [2024-11-26 23:08:59.202317] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:33.104 23:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.104 23:08:59 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:33.104 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 Malloc0 00:16:33.104 23:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.104 23:08:59 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:33.104 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 23:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.104 23:08:59 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:33.104 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 23:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.104 23:08:59 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:33.104 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 [2024-11-26 23:08:59.255012] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:33.104 23:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.104 23:08:59 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:33.104 test case1: single bdev can't be used in multiple subsystems 00:16:33.104 23:08:59 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:33.104 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 23:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.104 23:08:59 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:33.104 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 23:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.104 23:08:59 -- target/nmic.sh@28 -- # nmic_status=0 00:16:33.104 23:08:59 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:33.104 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.104 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.104 [2024-11-26 23:08:59.278843] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:33.104 [2024-11-26 23:08:59.278872] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:33.104 [2024-11-26 23:08:59.278907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:33.104 request: 00:16:33.104 { 00:16:33.104 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:33.104 "namespace": { 00:16:33.104 "bdev_name": "Malloc0" 00:16:33.104 }, 00:16:33.104 "method": "nvmf_subsystem_add_ns", 00:16:33.104 "req_id": 1 00:16:33.104 } 00:16:33.104 Got JSON-RPC error response 00:16:33.104 response: 00:16:33.104 { 00:16:33.104 "code": -32602, 00:16:33.104 "message": "Invalid parameters" 00:16:33.104 } 00:16:33.104 23:08:59 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:33.104 23:08:59 -- target/nmic.sh@29 -- # nmic_status=1 00:16:33.104 23:08:59 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:33.104 23:08:59 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:33.104 Adding namespace failed - expected result. 00:16:33.105 23:08:59 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:33.105 test case2: host connect to nvmf target in multiple paths 00:16:33.105 23:08:59 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:33.105 23:08:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.105 23:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:33.105 [2024-11-26 23:08:59.286966] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:33.105 23:08:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.105 23:08:59 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:33.707 23:08:59 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:34.307 23:09:00 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:34.307 23:09:00 -- common/autotest_common.sh@1187 -- # local i=0 00:16:34.307 23:09:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:34.307 23:09:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:34.307 23:09:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:36.233 23:09:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:36.233 23:09:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:36.233 23:09:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:36.233 23:09:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:36.233 23:09:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:36.233 23:09:02 -- common/autotest_common.sh@1197 -- # return 0 00:16:36.233 23:09:02 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:36.233 [global] 00:16:36.233 thread=1 00:16:36.233 invalidate=1 00:16:36.233 rw=write 00:16:36.233 time_based=1 00:16:36.233 runtime=1 00:16:36.233 ioengine=libaio 00:16:36.233 direct=1 00:16:36.233 bs=4096 00:16:36.233 iodepth=1 00:16:36.233 norandommap=0 00:16:36.233 numjobs=1 00:16:36.233 00:16:36.233 verify_dump=1 00:16:36.233 verify_backlog=512 00:16:36.233 verify_state_save=0 00:16:36.233 do_verify=1 00:16:36.233 verify=crc32c-intel 00:16:36.233 [job0] 00:16:36.233 filename=/dev/nvme0n1 00:16:36.233 Could not set queue depth (nvme0n1) 00:16:36.798 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:36.798 fio-3.35 00:16:36.798 Starting 1 thread 00:16:38.172 00:16:38.172 job0: (groupid=0, jobs=1): err= 0: pid=207846: Tue Nov 26 23:09:04 2024 00:16:38.172 read: IOPS=22, BW=90.0KiB/s (92.2kB/s)(92.0KiB/1022msec) 00:16:38.172 slat (nsec): min=7311, max=32061, avg=17129.70, stdev=6721.55 00:16:38.172 clat (usec): min=40844, max=41340, avg=40989.10, stdev=92.99 00:16:38.172 lat (usec): min=40876, max=41348, avg=41006.23, stdev=89.25 00:16:38.172 clat percentiles (usec): 00:16:38.172 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:38.172 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:38.172 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:38.172 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:38.172 | 99.99th=[41157] 00:16:38.172 write: IOPS=500, BW=2004KiB/s (2052kB/s)(2048KiB/1022msec); 0 zone resets 00:16:38.172 slat (nsec): min=5391, max=45024, avg=7282.66, stdev=2422.42 00:16:38.172 clat (usec): min=121, max=284, avg=143.21, stdev=14.28 00:16:38.172 lat (usec): min=128, max=311, avg=150.49, stdev=15.00 00:16:38.172 clat percentiles (usec): 00:16:38.172 | 1.00th=[ 124], 5.00th=[ 127], 10.00th=[ 129], 20.00th=[ 135], 00:16:38.172 | 30.00th=[ 139], 40.00th=[ 141], 50.00th=[ 143], 60.00th=[ 145], 00:16:38.172 | 70.00th=[ 147], 80.00th=[ 149], 90.00th=[ 157], 95.00th=[ 161], 00:16:38.172 | 99.00th=[ 180], 99.50th=[ 243], 99.90th=[ 285], 99.95th=[ 285], 00:16:38.172 | 99.99th=[ 285] 00:16:38.172 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.172 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.172 lat (usec) : 250=95.33%, 500=0.37% 00:16:38.172 lat (msec) : 50=4.30% 00:16:38.172 cpu : usr=0.00%, sys=0.59%, ctx=535, majf=0, minf=1 00:16:38.172 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.172 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.172 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.172 00:16:38.172 Run status group 0 (all jobs): 00:16:38.172 READ: bw=90.0KiB/s (92.2kB/s), 90.0KiB/s-90.0KiB/s (92.2kB/s-92.2kB/s), io=92.0KiB (94.2kB), run=1022-1022msec 00:16:38.172 WRITE: bw=2004KiB/s (2052kB/s), 2004KiB/s-2004KiB/s (2052kB/s-2052kB/s), io=2048KiB (2097kB), run=1022-1022msec 00:16:38.172 00:16:38.172 Disk stats (read/write): 00:16:38.172 nvme0n1: ios=70/512, merge=0/0, ticks=838/71, in_queue=909, util=91.48% 00:16:38.172 23:09:04 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:38.172 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:38.172 23:09:04 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:38.172 23:09:04 -- common/autotest_common.sh@1208 -- # local i=0 00:16:38.172 23:09:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:38.172 23:09:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:38.172 23:09:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:38.172 23:09:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:38.172 23:09:04 -- common/autotest_common.sh@1220 -- # return 0 00:16:38.172 23:09:04 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:38.172 23:09:04 -- target/nmic.sh@53 -- # nvmftestfini 00:16:38.172 23:09:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:38.172 23:09:04 -- nvmf/common.sh@116 -- # sync 00:16:38.172 23:09:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:38.172 23:09:04 -- nvmf/common.sh@119 -- # set +e 00:16:38.172 23:09:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:38.172 23:09:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:38.172 rmmod nvme_tcp 00:16:38.172 rmmod nvme_fabrics 00:16:38.172 rmmod nvme_keyring 00:16:38.172 23:09:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:38.172 23:09:04 -- nvmf/common.sh@123 -- # set -e 00:16:38.172 23:09:04 -- nvmf/common.sh@124 -- # return 0 00:16:38.172 23:09:04 -- nvmf/common.sh@477 -- # '[' -n 206959 ']' 00:16:38.172 23:09:04 -- nvmf/common.sh@478 -- # killprocess 206959 00:16:38.172 23:09:04 -- common/autotest_common.sh@936 -- # '[' -z 206959 ']' 00:16:38.172 23:09:04 -- common/autotest_common.sh@940 -- # kill -0 206959 00:16:38.172 23:09:04 -- common/autotest_common.sh@941 -- # uname 00:16:38.172 23:09:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.172 23:09:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 206959 00:16:38.172 23:09:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:38.172 23:09:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:38.172 23:09:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 206959' 00:16:38.172 killing process with pid 206959 00:16:38.172 23:09:04 -- common/autotest_common.sh@955 -- # kill 206959 00:16:38.172 23:09:04 -- common/autotest_common.sh@960 -- # wait 206959 00:16:38.740 23:09:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:38.740 23:09:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:38.740 23:09:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:38.740 23:09:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:38.740 23:09:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:38.740 23:09:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:38.740 23:09:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:38.740 23:09:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:40.645 23:09:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:40.645 00:16:40.645 real 0m11.161s 00:16:40.645 user 0m26.974s 00:16:40.645 sys 0m2.722s 00:16:40.645 23:09:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:40.645 23:09:06 -- common/autotest_common.sh@10 -- # set +x 00:16:40.645 ************************************ 00:16:40.645 END TEST nvmf_nmic 00:16:40.645 ************************************ 00:16:40.645 23:09:06 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:40.645 23:09:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:40.645 23:09:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:40.645 23:09:06 -- common/autotest_common.sh@10 -- # set +x 00:16:40.645 ************************************ 00:16:40.645 START TEST nvmf_fio_target 00:16:40.645 ************************************ 00:16:40.645 23:09:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:40.645 * Looking for test storage... 00:16:40.645 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:40.645 23:09:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:40.645 23:09:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:40.645 23:09:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:40.903 23:09:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:40.903 23:09:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:40.903 23:09:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:40.903 23:09:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:40.903 23:09:07 -- scripts/common.sh@335 -- # IFS=.-: 00:16:40.903 23:09:07 -- scripts/common.sh@335 -- # read -ra ver1 00:16:40.903 23:09:07 -- scripts/common.sh@336 -- # IFS=.-: 00:16:40.903 23:09:07 -- scripts/common.sh@336 -- # read -ra ver2 00:16:40.903 23:09:07 -- scripts/common.sh@337 -- # local 'op=<' 00:16:40.903 23:09:07 -- scripts/common.sh@339 -- # ver1_l=2 00:16:40.903 23:09:07 -- scripts/common.sh@340 -- # ver2_l=1 00:16:40.903 23:09:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:40.903 23:09:07 -- scripts/common.sh@343 -- # case "$op" in 00:16:40.903 23:09:07 -- scripts/common.sh@344 -- # : 1 00:16:40.903 23:09:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:40.903 23:09:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:40.903 23:09:07 -- scripts/common.sh@364 -- # decimal 1 00:16:40.903 23:09:07 -- scripts/common.sh@352 -- # local d=1 00:16:40.903 23:09:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:40.903 23:09:07 -- scripts/common.sh@354 -- # echo 1 00:16:40.903 23:09:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:40.903 23:09:07 -- scripts/common.sh@365 -- # decimal 2 00:16:40.903 23:09:07 -- scripts/common.sh@352 -- # local d=2 00:16:40.903 23:09:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:40.903 23:09:07 -- scripts/common.sh@354 -- # echo 2 00:16:40.903 23:09:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:40.903 23:09:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:40.903 23:09:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:40.903 23:09:07 -- scripts/common.sh@367 -- # return 0 00:16:40.903 23:09:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:40.903 23:09:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:40.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:40.903 --rc genhtml_branch_coverage=1 00:16:40.903 --rc genhtml_function_coverage=1 00:16:40.903 --rc genhtml_legend=1 00:16:40.903 --rc geninfo_all_blocks=1 00:16:40.903 --rc geninfo_unexecuted_blocks=1 00:16:40.903 00:16:40.903 ' 00:16:40.903 23:09:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:40.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:40.904 --rc genhtml_branch_coverage=1 00:16:40.904 --rc genhtml_function_coverage=1 00:16:40.904 --rc genhtml_legend=1 00:16:40.904 --rc geninfo_all_blocks=1 00:16:40.904 --rc geninfo_unexecuted_blocks=1 00:16:40.904 00:16:40.904 ' 00:16:40.904 23:09:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:40.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:40.904 --rc genhtml_branch_coverage=1 00:16:40.904 --rc genhtml_function_coverage=1 00:16:40.904 --rc genhtml_legend=1 00:16:40.904 --rc geninfo_all_blocks=1 00:16:40.904 --rc geninfo_unexecuted_blocks=1 00:16:40.904 00:16:40.904 ' 00:16:40.904 23:09:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:40.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:40.904 --rc genhtml_branch_coverage=1 00:16:40.904 --rc genhtml_function_coverage=1 00:16:40.904 --rc genhtml_legend=1 00:16:40.904 --rc geninfo_all_blocks=1 00:16:40.904 --rc geninfo_unexecuted_blocks=1 00:16:40.904 00:16:40.904 ' 00:16:40.904 23:09:07 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:40.904 23:09:07 -- nvmf/common.sh@7 -- # uname -s 00:16:40.904 23:09:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:40.904 23:09:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:40.904 23:09:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:40.904 23:09:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:40.904 23:09:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:40.904 23:09:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:40.904 23:09:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:40.904 23:09:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:40.904 23:09:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:40.904 23:09:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:40.904 23:09:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:40.904 23:09:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:40.904 23:09:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:40.904 23:09:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:40.904 23:09:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:40.904 23:09:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:40.904 23:09:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:40.904 23:09:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:40.904 23:09:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:40.904 23:09:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.904 23:09:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.904 23:09:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.904 23:09:07 -- paths/export.sh@5 -- # export PATH 00:16:40.904 23:09:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.904 23:09:07 -- nvmf/common.sh@46 -- # : 0 00:16:40.904 23:09:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:40.904 23:09:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:40.904 23:09:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:40.904 23:09:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:40.904 23:09:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:40.904 23:09:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:40.904 23:09:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:40.904 23:09:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:40.904 23:09:07 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:40.904 23:09:07 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:40.904 23:09:07 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:40.904 23:09:07 -- target/fio.sh@16 -- # nvmftestinit 00:16:40.904 23:09:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:40.904 23:09:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:40.904 23:09:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:40.904 23:09:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:40.904 23:09:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:40.904 23:09:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:40.904 23:09:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:40.904 23:09:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:40.904 23:09:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:40.904 23:09:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:40.904 23:09:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:40.904 23:09:07 -- common/autotest_common.sh@10 -- # set +x 00:16:42.804 23:09:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:42.804 23:09:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:42.804 23:09:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:42.804 23:09:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:42.804 23:09:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:42.804 23:09:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:42.804 23:09:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:42.804 23:09:08 -- nvmf/common.sh@294 -- # net_devs=() 00:16:42.804 23:09:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:42.804 23:09:08 -- nvmf/common.sh@295 -- # e810=() 00:16:42.804 23:09:08 -- nvmf/common.sh@295 -- # local -ga e810 00:16:42.804 23:09:08 -- nvmf/common.sh@296 -- # x722=() 00:16:42.804 23:09:08 -- nvmf/common.sh@296 -- # local -ga x722 00:16:42.804 23:09:08 -- nvmf/common.sh@297 -- # mlx=() 00:16:42.804 23:09:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:42.804 23:09:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:42.804 23:09:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:42.804 23:09:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:42.804 23:09:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:42.804 23:09:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.804 23:09:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:42.804 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:42.804 23:09:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.804 23:09:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:42.804 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:42.804 23:09:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.804 23:09:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.805 23:09:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:42.805 23:09:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:42.805 23:09:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:42.805 23:09:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.805 23:09:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.805 23:09:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.805 23:09:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.805 23:09:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:42.805 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:42.805 23:09:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.805 23:09:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.805 23:09:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.805 23:09:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.805 23:09:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.805 23:09:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:42.805 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:42.805 23:09:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.805 23:09:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:42.805 23:09:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:42.805 23:09:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:42.805 23:09:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:42.805 23:09:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:42.805 23:09:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:42.805 23:09:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:42.805 23:09:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:42.805 23:09:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:42.805 23:09:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:42.805 23:09:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:42.805 23:09:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:42.805 23:09:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:42.805 23:09:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:42.805 23:09:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:42.805 23:09:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:42.805 23:09:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:42.805 23:09:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:42.805 23:09:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:42.805 23:09:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:42.805 23:09:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:42.805 23:09:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:42.805 23:09:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:42.805 23:09:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:42.805 23:09:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:42.805 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:42.805 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:16:42.805 00:16:42.805 --- 10.0.0.2 ping statistics --- 00:16:42.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:42.805 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:16:42.805 23:09:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:42.805 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:42.805 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.044 ms 00:16:42.805 00:16:42.805 --- 10.0.0.1 ping statistics --- 00:16:42.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:42.805 rtt min/avg/max/mdev = 0.044/0.044/0.044/0.000 ms 00:16:42.805 23:09:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:42.805 23:09:09 -- nvmf/common.sh@410 -- # return 0 00:16:42.805 23:09:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:42.805 23:09:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:42.805 23:09:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:42.805 23:09:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:42.805 23:09:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:42.805 23:09:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:42.805 23:09:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:42.805 23:09:09 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:42.805 23:09:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:42.805 23:09:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:42.805 23:09:09 -- common/autotest_common.sh@10 -- # set +x 00:16:42.805 23:09:09 -- nvmf/common.sh@469 -- # nvmfpid=210445 00:16:42.805 23:09:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:42.805 23:09:09 -- nvmf/common.sh@470 -- # waitforlisten 210445 00:16:42.805 23:09:09 -- common/autotest_common.sh@829 -- # '[' -z 210445 ']' 00:16:42.805 23:09:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:42.805 23:09:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:42.805 23:09:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:42.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:42.805 23:09:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:42.805 23:09:09 -- common/autotest_common.sh@10 -- # set +x 00:16:42.805 [2024-11-26 23:09:09.131694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:42.805 [2024-11-26 23:09:09.131760] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:42.805 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.062 [2024-11-26 23:09:09.199859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:43.062 [2024-11-26 23:09:09.310353] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:43.062 [2024-11-26 23:09:09.310507] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:43.062 [2024-11-26 23:09:09.310532] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:43.062 [2024-11-26 23:09:09.310548] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:43.062 [2024-11-26 23:09:09.310629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:43.062 [2024-11-26 23:09:09.310689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:43.062 [2024-11-26 23:09:09.310739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:43.062 [2024-11-26 23:09:09.310741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:43.992 23:09:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:43.992 23:09:10 -- common/autotest_common.sh@862 -- # return 0 00:16:43.992 23:09:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:43.992 23:09:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:43.992 23:09:10 -- common/autotest_common.sh@10 -- # set +x 00:16:43.992 23:09:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:43.992 23:09:10 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:44.250 [2024-11-26 23:09:10.447210] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:44.250 23:09:10 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:44.508 23:09:10 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:44.508 23:09:10 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:44.765 23:09:11 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:44.765 23:09:11 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.024 23:09:11 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:45.024 23:09:11 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.282 23:09:11 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:45.282 23:09:11 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:45.539 23:09:11 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.800 23:09:12 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:45.801 23:09:12 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.058 23:09:12 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:46.058 23:09:12 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.316 23:09:12 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:46.316 23:09:12 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:46.574 23:09:12 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:46.831 23:09:13 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:46.831 23:09:13 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:47.089 23:09:13 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:47.089 23:09:13 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:47.346 23:09:13 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:47.603 [2024-11-26 23:09:13.855907] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:47.603 23:09:13 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:47.860 23:09:14 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:48.117 23:09:14 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:48.682 23:09:15 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:48.682 23:09:15 -- common/autotest_common.sh@1187 -- # local i=0 00:16:48.682 23:09:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:48.682 23:09:15 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:48.682 23:09:15 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:48.682 23:09:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:51.208 23:09:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:51.208 23:09:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:51.208 23:09:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:51.208 23:09:17 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:51.208 23:09:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:51.208 23:09:17 -- common/autotest_common.sh@1197 -- # return 0 00:16:51.208 23:09:17 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:51.208 [global] 00:16:51.208 thread=1 00:16:51.208 invalidate=1 00:16:51.208 rw=write 00:16:51.208 time_based=1 00:16:51.208 runtime=1 00:16:51.208 ioengine=libaio 00:16:51.208 direct=1 00:16:51.208 bs=4096 00:16:51.208 iodepth=1 00:16:51.208 norandommap=0 00:16:51.208 numjobs=1 00:16:51.208 00:16:51.208 verify_dump=1 00:16:51.208 verify_backlog=512 00:16:51.208 verify_state_save=0 00:16:51.208 do_verify=1 00:16:51.208 verify=crc32c-intel 00:16:51.208 [job0] 00:16:51.208 filename=/dev/nvme0n1 00:16:51.208 [job1] 00:16:51.208 filename=/dev/nvme0n2 00:16:51.208 [job2] 00:16:51.208 filename=/dev/nvme0n3 00:16:51.208 [job3] 00:16:51.208 filename=/dev/nvme0n4 00:16:51.208 Could not set queue depth (nvme0n1) 00:16:51.208 Could not set queue depth (nvme0n2) 00:16:51.208 Could not set queue depth (nvme0n3) 00:16:51.208 Could not set queue depth (nvme0n4) 00:16:51.208 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.208 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.208 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.208 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.208 fio-3.35 00:16:51.208 Starting 4 threads 00:16:52.581 00:16:52.581 job0: (groupid=0, jobs=1): err= 0: pid=211618: Tue Nov 26 23:09:18 2024 00:16:52.581 read: IOPS=23, BW=92.4KiB/s (94.6kB/s)(96.0KiB/1039msec) 00:16:52.581 slat (nsec): min=12706, max=35677, avg=20208.00, stdev=9250.82 00:16:52.581 clat (usec): min=254, max=45002, avg=37827.04, stdev=11603.84 00:16:52.581 lat (usec): min=273, max=45020, avg=37847.24, stdev=11601.54 00:16:52.581 clat percentiles (usec): 00:16:52.581 | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[40633], 20.00th=[41157], 00:16:52.581 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:52.581 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:16:52.581 | 99.00th=[44827], 99.50th=[44827], 99.90th=[44827], 99.95th=[44827], 00:16:52.581 | 99.99th=[44827] 00:16:52.581 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:16:52.581 slat (nsec): min=7830, max=61614, avg=17085.05, stdev=8564.52 00:16:52.581 clat (usec): min=143, max=512, avg=232.21, stdev=79.65 00:16:52.581 lat (usec): min=153, max=523, avg=249.30, stdev=79.16 00:16:52.581 clat percentiles (usec): 00:16:52.581 | 1.00th=[ 149], 5.00th=[ 159], 10.00th=[ 165], 20.00th=[ 176], 00:16:52.581 | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 198], 60.00th=[ 219], 00:16:52.581 | 70.00th=[ 245], 80.00th=[ 285], 90.00th=[ 371], 95.00th=[ 420], 00:16:52.581 | 99.00th=[ 461], 99.50th=[ 490], 99.90th=[ 515], 99.95th=[ 515], 00:16:52.581 | 99.99th=[ 515] 00:16:52.581 bw ( KiB/s): min= 4096, max= 4096, per=27.09%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.581 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.581 lat (usec) : 250=69.22%, 500=26.31%, 750=0.37% 00:16:52.581 lat (msec) : 50=4.10% 00:16:52.581 cpu : usr=0.58%, sys=1.06%, ctx=537, majf=0, minf=1 00:16:52.581 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.581 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.581 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.581 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.581 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.581 job1: (groupid=0, jobs=1): err= 0: pid=211639: Tue Nov 26 23:09:18 2024 00:16:52.581 read: IOPS=21, BW=84.9KiB/s (86.9kB/s)(88.0KiB/1037msec) 00:16:52.581 slat (nsec): min=6812, max=33926, avg=18516.27, stdev=8740.80 00:16:52.581 clat (usec): min=40916, max=41091, avg=40978.73, stdev=33.67 00:16:52.581 lat (usec): min=40950, max=41098, avg=40997.25, stdev=29.46 00:16:52.581 clat percentiles (usec): 00:16:52.581 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:52.581 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:52.581 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:52.581 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:52.581 | 99.99th=[41157] 00:16:52.581 write: IOPS=493, BW=1975KiB/s (2022kB/s)(2048KiB/1037msec); 0 zone resets 00:16:52.581 slat (usec): min=6, max=837, avg=18.93, stdev=47.29 00:16:52.582 clat (usec): min=133, max=598, avg=240.74, stdev=59.31 00:16:52.582 lat (usec): min=143, max=991, avg=259.67, stdev=71.92 00:16:52.582 clat percentiles (usec): 00:16:52.582 | 1.00th=[ 143], 5.00th=[ 153], 10.00th=[ 165], 20.00th=[ 188], 00:16:52.582 | 30.00th=[ 208], 40.00th=[ 223], 50.00th=[ 237], 60.00th=[ 253], 00:16:52.582 | 70.00th=[ 273], 80.00th=[ 285], 90.00th=[ 310], 95.00th=[ 334], 00:16:52.582 | 99.00th=[ 416], 99.50th=[ 445], 99.90th=[ 603], 99.95th=[ 603], 00:16:52.582 | 99.99th=[ 603] 00:16:52.582 bw ( KiB/s): min= 4096, max= 4096, per=27.09%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.582 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.582 lat (usec) : 250=56.18%, 500=39.33%, 750=0.37% 00:16:52.582 lat (msec) : 50=4.12% 00:16:52.582 cpu : usr=0.29%, sys=0.87%, ctx=538, majf=0, minf=1 00:16:52.582 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.582 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.582 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.582 job2: (groupid=0, jobs=1): err= 0: pid=211682: Tue Nov 26 23:09:18 2024 00:16:52.582 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:52.582 slat (nsec): min=5755, max=52097, avg=10680.45, stdev=5792.11 00:16:52.582 clat (usec): min=170, max=42151, avg=236.59, stdev=927.11 00:16:52.582 lat (usec): min=176, max=42171, avg=247.27, stdev=927.43 00:16:52.582 clat percentiles (usec): 00:16:52.582 | 1.00th=[ 178], 5.00th=[ 184], 10.00th=[ 188], 20.00th=[ 194], 00:16:52.582 | 30.00th=[ 198], 40.00th=[ 202], 50.00th=[ 210], 60.00th=[ 221], 00:16:52.582 | 70.00th=[ 231], 80.00th=[ 237], 90.00th=[ 247], 95.00th=[ 258], 00:16:52.582 | 99.00th=[ 383], 99.50th=[ 396], 99.90th=[ 437], 99.95th=[ 437], 00:16:52.582 | 99.99th=[42206] 00:16:52.582 write: IOPS=2388, BW=9554KiB/s (9784kB/s)(9564KiB/1001msec); 0 zone resets 00:16:52.582 slat (usec): min=6, max=21136, avg=22.58, stdev=432.06 00:16:52.582 clat (usec): min=129, max=937, avg=177.48, stdev=59.95 00:16:52.582 lat (usec): min=137, max=21613, avg=200.07, stdev=442.50 00:16:52.582 clat percentiles (usec): 00:16:52.582 | 1.00th=[ 133], 5.00th=[ 137], 10.00th=[ 139], 20.00th=[ 143], 00:16:52.582 | 30.00th=[ 145], 40.00th=[ 151], 50.00th=[ 157], 60.00th=[ 169], 00:16:52.582 | 70.00th=[ 182], 80.00th=[ 196], 90.00th=[ 243], 95.00th=[ 293], 00:16:52.582 | 99.00th=[ 343], 99.50th=[ 578], 99.90th=[ 758], 99.95th=[ 807], 00:16:52.582 | 99.99th=[ 938] 00:16:52.582 bw ( KiB/s): min= 8424, max= 8424, per=55.72%, avg=8424.00, stdev= 0.00, samples=1 00:16:52.582 iops : min= 2106, max= 2106, avg=2106.00, stdev= 0.00, samples=1 00:16:52.582 lat (usec) : 250=91.37%, 500=8.31%, 750=0.20%, 1000=0.09% 00:16:52.582 lat (msec) : 50=0.02% 00:16:52.582 cpu : usr=5.10%, sys=6.00%, ctx=4442, majf=0, minf=1 00:16:52.582 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.582 issued rwts: total=2048,2391,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.582 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.582 job3: (groupid=0, jobs=1): err= 0: pid=211689: Tue Nov 26 23:09:18 2024 00:16:52.582 read: IOPS=22, BW=90.0KiB/s (92.2kB/s)(92.0KiB/1022msec) 00:16:52.582 slat (nsec): min=13556, max=35454, avg=20448.65, stdev=9052.30 00:16:52.582 clat (usec): min=555, max=41982, avg=39283.09, stdev=8447.84 00:16:52.582 lat (usec): min=570, max=41997, avg=39303.54, stdev=8448.92 00:16:52.582 clat percentiles (usec): 00:16:52.582 | 1.00th=[ 553], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:52.582 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:52.582 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:16:52.582 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:52.582 | 99.99th=[42206] 00:16:52.582 write: IOPS=500, BW=2004KiB/s (2052kB/s)(2048KiB/1022msec); 0 zone resets 00:16:52.582 slat (nsec): min=5948, max=61597, avg=13774.77, stdev=8788.41 00:16:52.582 clat (usec): min=148, max=672, avg=212.89, stdev=62.77 00:16:52.582 lat (usec): min=154, max=689, avg=226.66, stdev=64.95 00:16:52.582 clat percentiles (usec): 00:16:52.582 | 1.00th=[ 153], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 172], 00:16:52.582 | 30.00th=[ 178], 40.00th=[ 186], 50.00th=[ 192], 60.00th=[ 206], 00:16:52.582 | 70.00th=[ 227], 80.00th=[ 247], 90.00th=[ 273], 95.00th=[ 306], 00:16:52.582 | 99.00th=[ 441], 99.50th=[ 603], 99.90th=[ 676], 99.95th=[ 676], 00:16:52.582 | 99.99th=[ 676] 00:16:52.582 bw ( KiB/s): min= 4096, max= 4096, per=27.09%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.582 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.582 lat (usec) : 250=78.69%, 500=16.07%, 750=1.12% 00:16:52.582 lat (msec) : 50=4.11% 00:16:52.582 cpu : usr=0.49%, sys=0.49%, ctx=536, majf=0, minf=1 00:16:52.582 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.582 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.582 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.582 00:16:52.582 Run status group 0 (all jobs): 00:16:52.582 READ: bw=8150KiB/s (8346kB/s), 84.9KiB/s-8184KiB/s (86.9kB/s-8380kB/s), io=8468KiB (8671kB), run=1001-1039msec 00:16:52.582 WRITE: bw=14.8MiB/s (15.5MB/s), 1971KiB/s-9554KiB/s (2018kB/s-9784kB/s), io=15.3MiB (16.1MB), run=1001-1039msec 00:16:52.582 00:16:52.582 Disk stats (read/write): 00:16:52.582 nvme0n1: ios=68/512, merge=0/0, ticks=925/113, in_queue=1038, util=84.67% 00:16:52.582 nvme0n2: ios=70/512, merge=0/0, ticks=843/123, in_queue=966, util=88.67% 00:16:52.582 nvme0n3: ios=1725/2048, merge=0/0, ticks=736/336, in_queue=1072, util=93.68% 00:16:52.582 nvme0n4: ios=41/512, merge=0/0, ticks=1604/109, in_queue=1713, util=94.26% 00:16:52.582 23:09:18 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:52.582 [global] 00:16:52.582 thread=1 00:16:52.582 invalidate=1 00:16:52.582 rw=randwrite 00:16:52.582 time_based=1 00:16:52.582 runtime=1 00:16:52.582 ioengine=libaio 00:16:52.582 direct=1 00:16:52.582 bs=4096 00:16:52.582 iodepth=1 00:16:52.582 norandommap=0 00:16:52.582 numjobs=1 00:16:52.582 00:16:52.582 verify_dump=1 00:16:52.582 verify_backlog=512 00:16:52.582 verify_state_save=0 00:16:52.582 do_verify=1 00:16:52.582 verify=crc32c-intel 00:16:52.582 [job0] 00:16:52.582 filename=/dev/nvme0n1 00:16:52.582 [job1] 00:16:52.582 filename=/dev/nvme0n2 00:16:52.582 [job2] 00:16:52.582 filename=/dev/nvme0n3 00:16:52.582 [job3] 00:16:52.582 filename=/dev/nvme0n4 00:16:52.582 Could not set queue depth (nvme0n1) 00:16:52.582 Could not set queue depth (nvme0n2) 00:16:52.582 Could not set queue depth (nvme0n3) 00:16:52.582 Could not set queue depth (nvme0n4) 00:16:52.582 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.582 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.582 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.582 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.582 fio-3.35 00:16:52.582 Starting 4 threads 00:16:53.954 00:16:53.955 job0: (groupid=0, jobs=1): err= 0: pid=211920: Tue Nov 26 23:09:20 2024 00:16:53.955 read: IOPS=2180, BW=8723KiB/s (8933kB/s)(8732KiB/1001msec) 00:16:53.955 slat (nsec): min=5762, max=59609, avg=9266.99, stdev=4710.77 00:16:53.955 clat (usec): min=181, max=785, avg=221.15, stdev=22.89 00:16:53.955 lat (usec): min=187, max=793, avg=230.41, stdev=25.27 00:16:53.955 clat percentiles (usec): 00:16:53.955 | 1.00th=[ 188], 5.00th=[ 194], 10.00th=[ 198], 20.00th=[ 204], 00:16:53.955 | 30.00th=[ 208], 40.00th=[ 212], 50.00th=[ 219], 60.00th=[ 225], 00:16:53.955 | 70.00th=[ 231], 80.00th=[ 239], 90.00th=[ 249], 95.00th=[ 258], 00:16:53.955 | 99.00th=[ 269], 99.50th=[ 273], 99.90th=[ 293], 99.95th=[ 293], 00:16:53.955 | 99.99th=[ 783] 00:16:53.955 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:16:53.955 slat (nsec): min=7389, max=73909, avg=14187.71, stdev=7478.97 00:16:53.955 clat (usec): min=127, max=680, avg=173.63, stdev=33.24 00:16:53.955 lat (usec): min=136, max=691, avg=187.81, stdev=37.65 00:16:53.955 clat percentiles (usec): 00:16:53.955 | 1.00th=[ 135], 5.00th=[ 139], 10.00th=[ 143], 20.00th=[ 149], 00:16:53.955 | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 167], 60.00th=[ 174], 00:16:53.955 | 70.00th=[ 182], 80.00th=[ 194], 90.00th=[ 215], 95.00th=[ 231], 00:16:53.955 | 99.00th=[ 277], 99.50th=[ 326], 99.90th=[ 429], 99.95th=[ 482], 00:16:53.955 | 99.99th=[ 685] 00:16:53.955 bw ( KiB/s): min=11200, max=11200, per=47.44%, avg=11200.00, stdev= 0.00, samples=1 00:16:53.955 iops : min= 2800, max= 2800, avg=2800.00, stdev= 0.00, samples=1 00:16:53.955 lat (usec) : 250=94.90%, 500=5.06%, 750=0.02%, 1000=0.02% 00:16:53.955 cpu : usr=4.10%, sys=7.50%, ctx=4746, majf=0, minf=1 00:16:53.955 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.955 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.955 issued rwts: total=2183,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.955 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.955 job1: (groupid=0, jobs=1): err= 0: pid=211921: Tue Nov 26 23:09:20 2024 00:16:53.955 read: IOPS=1530, BW=6123KiB/s (6270kB/s)(6172KiB/1008msec) 00:16:53.955 slat (nsec): min=4238, max=50758, avg=8280.29, stdev=6457.95 00:16:53.955 clat (usec): min=171, max=41115, avg=428.32, stdev=2734.67 00:16:53.955 lat (usec): min=176, max=41130, avg=436.60, stdev=2735.87 00:16:53.955 clat percentiles (usec): 00:16:53.955 | 1.00th=[ 178], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 198], 00:16:53.955 | 30.00th=[ 204], 40.00th=[ 215], 50.00th=[ 239], 60.00th=[ 249], 00:16:53.955 | 70.00th=[ 258], 80.00th=[ 269], 90.00th=[ 289], 95.00th=[ 412], 00:16:53.955 | 99.00th=[ 482], 99.50th=[ 545], 99.90th=[41157], 99.95th=[41157], 00:16:53.955 | 99.99th=[41157] 00:16:53.955 write: IOPS=2031, BW=8127KiB/s (8322kB/s)(8192KiB/1008msec); 0 zone resets 00:16:53.955 slat (nsec): min=5344, max=66239, avg=9082.53, stdev=4867.13 00:16:53.955 clat (usec): min=120, max=633, avg=149.38, stdev=21.65 00:16:53.955 lat (usec): min=126, max=648, avg=158.46, stdev=23.59 00:16:53.955 clat percentiles (usec): 00:16:53.955 | 1.00th=[ 125], 5.00th=[ 130], 10.00th=[ 133], 20.00th=[ 137], 00:16:53.955 | 30.00th=[ 141], 40.00th=[ 143], 50.00th=[ 147], 60.00th=[ 151], 00:16:53.955 | 70.00th=[ 155], 80.00th=[ 161], 90.00th=[ 167], 95.00th=[ 176], 00:16:53.955 | 99.00th=[ 210], 99.50th=[ 241], 99.90th=[ 265], 99.95th=[ 586], 00:16:53.955 | 99.99th=[ 635] 00:16:53.955 bw ( KiB/s): min= 5856, max=10528, per=34.70%, avg=8192.00, stdev=3303.60, samples=2 00:16:53.955 iops : min= 1464, max= 2632, avg=2048.00, stdev=825.90, samples=2 00:16:53.955 lat (usec) : 250=83.90%, 500=15.79%, 750=0.11% 00:16:53.955 lat (msec) : 50=0.19% 00:16:53.955 cpu : usr=1.69%, sys=3.08%, ctx=3593, majf=0, minf=1 00:16:53.955 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.955 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.955 issued rwts: total=1543,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.955 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.955 job2: (groupid=0, jobs=1): err= 0: pid=211922: Tue Nov 26 23:09:20 2024 00:16:53.955 read: IOPS=626, BW=2505KiB/s (2566kB/s)(2508KiB/1001msec) 00:16:53.955 slat (nsec): min=4706, max=58911, avg=12821.12, stdev=5789.71 00:16:53.955 clat (usec): min=189, max=41998, avg=1217.30, stdev=6276.85 00:16:53.955 lat (usec): min=203, max=42012, avg=1230.12, stdev=6277.13 00:16:53.955 clat percentiles (usec): 00:16:53.955 | 1.00th=[ 198], 5.00th=[ 202], 10.00th=[ 204], 20.00th=[ 210], 00:16:53.955 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 221], 60.00th=[ 225], 00:16:53.955 | 70.00th=[ 233], 80.00th=[ 245], 90.00th=[ 269], 95.00th=[ 347], 00:16:53.955 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:53.955 | 99.99th=[42206] 00:16:53.955 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:16:53.955 slat (nsec): min=9274, max=70334, avg=18846.06, stdev=6578.94 00:16:53.955 clat (usec): min=145, max=487, avg=197.27, stdev=49.01 00:16:53.955 lat (usec): min=156, max=527, avg=216.12, stdev=51.39 00:16:53.955 clat percentiles (usec): 00:16:53.955 | 1.00th=[ 149], 5.00th=[ 153], 10.00th=[ 157], 20.00th=[ 161], 00:16:53.955 | 30.00th=[ 165], 40.00th=[ 172], 50.00th=[ 182], 60.00th=[ 196], 00:16:53.955 | 70.00th=[ 212], 80.00th=[ 229], 90.00th=[ 247], 95.00th=[ 285], 00:16:53.955 | 99.00th=[ 388], 99.50th=[ 437], 99.90th=[ 486], 99.95th=[ 490], 00:16:53.955 | 99.99th=[ 490] 00:16:53.955 bw ( KiB/s): min= 4096, max= 4096, per=17.35%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.955 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.955 lat (usec) : 250=87.89%, 500=11.08%, 750=0.06% 00:16:53.955 lat (msec) : 4=0.06%, 50=0.91% 00:16:53.955 cpu : usr=1.50%, sys=3.10%, ctx=1653, majf=0, minf=1 00:16:53.955 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.955 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.955 issued rwts: total=627,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.955 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.955 job3: (groupid=0, jobs=1): err= 0: pid=211923: Tue Nov 26 23:09:20 2024 00:16:53.955 read: IOPS=205, BW=822KiB/s (842kB/s)(856KiB/1041msec) 00:16:53.955 slat (nsec): min=4599, max=33035, avg=8012.67, stdev=5152.20 00:16:53.955 clat (usec): min=173, max=42053, avg=4264.40, stdev=12163.80 00:16:53.955 lat (usec): min=178, max=42060, avg=4272.41, stdev=12167.22 00:16:53.956 clat percentiles (usec): 00:16:53.956 | 1.00th=[ 176], 5.00th=[ 184], 10.00th=[ 190], 20.00th=[ 198], 00:16:53.956 | 30.00th=[ 208], 40.00th=[ 223], 50.00th=[ 245], 60.00th=[ 255], 00:16:53.956 | 70.00th=[ 285], 80.00th=[ 388], 90.00th=[ 578], 95.00th=[41157], 00:16:53.956 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:53.956 | 99.99th=[42206] 00:16:53.956 write: IOPS=491, BW=1967KiB/s (2015kB/s)(2048KiB/1041msec); 0 zone resets 00:16:53.956 slat (nsec): min=7346, max=62804, avg=16592.11, stdev=7361.81 00:16:53.956 clat (usec): min=148, max=451, avg=224.08, stdev=37.31 00:16:53.956 lat (usec): min=171, max=499, avg=240.67, stdev=37.70 00:16:53.956 clat percentiles (usec): 00:16:53.956 | 1.00th=[ 163], 5.00th=[ 178], 10.00th=[ 190], 20.00th=[ 198], 00:16:53.956 | 30.00th=[ 206], 40.00th=[ 212], 50.00th=[ 221], 60.00th=[ 227], 00:16:53.956 | 70.00th=[ 231], 80.00th=[ 243], 90.00th=[ 273], 95.00th=[ 293], 00:16:53.956 | 99.00th=[ 355], 99.50th=[ 404], 99.90th=[ 453], 99.95th=[ 453], 00:16:53.956 | 99.99th=[ 453] 00:16:53.956 bw ( KiB/s): min= 4096, max= 4096, per=17.35%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.956 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.956 lat (usec) : 250=75.90%, 500=20.39%, 750=0.83% 00:16:53.956 lat (msec) : 50=2.89% 00:16:53.956 cpu : usr=0.48%, sys=0.96%, ctx=727, majf=0, minf=2 00:16:53.956 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.956 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.956 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.956 issued rwts: total=214,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.956 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.956 00:16:53.956 Run status group 0 (all jobs): 00:16:53.956 READ: bw=17.1MiB/s (18.0MB/s), 822KiB/s-8723KiB/s (842kB/s-8933kB/s), io=17.8MiB (18.7MB), run=1001-1041msec 00:16:53.956 WRITE: bw=23.1MiB/s (24.2MB/s), 1967KiB/s-9.99MiB/s (2015kB/s-10.5MB/s), io=24.0MiB (25.2MB), run=1001-1041msec 00:16:53.956 00:16:53.956 Disk stats (read/write): 00:16:53.956 nvme0n1: ios=2071/2048, merge=0/0, ticks=605/325, in_queue=930, util=97.19% 00:16:53.956 nvme0n2: ios=1564/2048, merge=0/0, ticks=1465/293, in_queue=1758, util=98.07% 00:16:53.956 nvme0n3: ios=451/512, merge=0/0, ticks=1550/114, in_queue=1664, util=98.75% 00:16:53.956 nvme0n4: ios=209/512, merge=0/0, ticks=706/108, in_queue=814, util=89.71% 00:16:53.956 23:09:20 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:53.956 [global] 00:16:53.956 thread=1 00:16:53.956 invalidate=1 00:16:53.956 rw=write 00:16:53.956 time_based=1 00:16:53.956 runtime=1 00:16:53.956 ioengine=libaio 00:16:53.956 direct=1 00:16:53.956 bs=4096 00:16:53.956 iodepth=128 00:16:53.956 norandommap=0 00:16:53.956 numjobs=1 00:16:53.956 00:16:53.956 verify_dump=1 00:16:53.956 verify_backlog=512 00:16:53.956 verify_state_save=0 00:16:53.956 do_verify=1 00:16:53.956 verify=crc32c-intel 00:16:53.956 [job0] 00:16:53.956 filename=/dev/nvme0n1 00:16:53.956 [job1] 00:16:53.956 filename=/dev/nvme0n2 00:16:53.956 [job2] 00:16:53.956 filename=/dev/nvme0n3 00:16:53.956 [job3] 00:16:53.956 filename=/dev/nvme0n4 00:16:53.956 Could not set queue depth (nvme0n1) 00:16:53.956 Could not set queue depth (nvme0n2) 00:16:53.956 Could not set queue depth (nvme0n3) 00:16:53.956 Could not set queue depth (nvme0n4) 00:16:53.956 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.956 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.956 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.956 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.956 fio-3.35 00:16:53.956 Starting 4 threads 00:16:55.331 00:16:55.331 job0: (groupid=0, jobs=1): err= 0: pid=212157: Tue Nov 26 23:09:21 2024 00:16:55.331 read: IOPS=3339, BW=13.0MiB/s (13.7MB/s)(13.1MiB/1005msec) 00:16:55.331 slat (usec): min=3, max=14603, avg=165.44, stdev=994.48 00:16:55.331 clat (usec): min=2655, max=61925, avg=21135.88, stdev=13423.16 00:16:55.331 lat (usec): min=5862, max=61937, avg=21301.32, stdev=13506.04 00:16:55.331 clat percentiles (usec): 00:16:55.331 | 1.00th=[ 6259], 5.00th=[ 9765], 10.00th=[10683], 20.00th=[10945], 00:16:55.331 | 30.00th=[11731], 40.00th=[15795], 50.00th=[17957], 60.00th=[18482], 00:16:55.331 | 70.00th=[19006], 80.00th=[28705], 90.00th=[45351], 95.00th=[56886], 00:16:55.331 | 99.00th=[58459], 99.50th=[58459], 99.90th=[61080], 99.95th=[61604], 00:16:55.331 | 99.99th=[62129] 00:16:55.331 write: IOPS=3566, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1005msec); 0 zone resets 00:16:55.331 slat (usec): min=4, max=10080, avg=115.30, stdev=630.53 00:16:55.331 clat (usec): min=5896, max=61259, avg=15700.46, stdev=8677.67 00:16:55.331 lat (usec): min=5932, max=61280, avg=15815.76, stdev=8738.55 00:16:55.331 clat percentiles (usec): 00:16:55.331 | 1.00th=[ 9503], 5.00th=[10290], 10.00th=[10683], 20.00th=[11469], 00:16:55.331 | 30.00th=[11731], 40.00th=[12518], 50.00th=[13960], 60.00th=[14353], 00:16:55.331 | 70.00th=[14484], 80.00th=[16450], 90.00th=[21627], 95.00th=[31065], 00:16:55.331 | 99.00th=[61080], 99.50th=[61080], 99.90th=[61080], 99.95th=[61080], 00:16:55.331 | 99.99th=[61080] 00:16:55.331 bw ( KiB/s): min=12288, max=16384, per=19.90%, avg=14336.00, stdev=2896.31, samples=2 00:16:55.331 iops : min= 3072, max= 4096, avg=3584.00, stdev=724.08, samples=2 00:16:55.331 lat (msec) : 4=0.01%, 10=3.82%, 20=76.74%, 50=14.83%, 100=4.60% 00:16:55.331 cpu : usr=5.08%, sys=5.88%, ctx=262, majf=0, minf=1 00:16:55.331 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:55.331 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.331 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.331 issued rwts: total=3356,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.331 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.331 job1: (groupid=0, jobs=1): err= 0: pid=212158: Tue Nov 26 23:09:21 2024 00:16:55.331 read: IOPS=5609, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1004msec) 00:16:55.331 slat (usec): min=2, max=5141, avg=83.09, stdev=462.10 00:16:55.331 clat (usec): min=7544, max=17487, avg=10934.86, stdev=1224.68 00:16:55.331 lat (usec): min=7593, max=17495, avg=11017.96, stdev=1262.20 00:16:55.331 clat percentiles (usec): 00:16:55.331 | 1.00th=[ 8160], 5.00th=[ 8979], 10.00th=[10028], 20.00th=[10421], 00:16:55.331 | 30.00th=[10552], 40.00th=[10683], 50.00th=[10814], 60.00th=[10945], 00:16:55.331 | 70.00th=[11076], 80.00th=[11338], 90.00th=[11994], 95.00th=[13566], 00:16:55.331 | 99.00th=[15401], 99.50th=[15664], 99.90th=[17433], 99.95th=[17433], 00:16:55.331 | 99.99th=[17433] 00:16:55.331 write: IOPS=6012, BW=23.5MiB/s (24.6MB/s)(23.6MiB/1004msec); 0 zone resets 00:16:55.331 slat (usec): min=3, max=5321, avg=79.14, stdev=423.23 00:16:55.331 clat (usec): min=2791, max=16865, avg=10838.63, stdev=1383.60 00:16:55.331 lat (usec): min=3329, max=16884, avg=10917.77, stdev=1396.46 00:16:55.331 clat percentiles (usec): 00:16:55.331 | 1.00th=[ 6718], 5.00th=[ 8094], 10.00th=[ 8717], 20.00th=[10421], 00:16:55.331 | 30.00th=[10683], 40.00th=[10945], 50.00th=[11076], 60.00th=[11207], 00:16:55.331 | 70.00th=[11338], 80.00th=[11600], 90.00th=[11863], 95.00th=[12387], 00:16:55.331 | 99.00th=[14877], 99.50th=[15139], 99.90th=[15664], 99.95th=[15926], 00:16:55.331 | 99.99th=[16909] 00:16:55.331 bw ( KiB/s): min=22720, max=24510, per=32.78%, avg=23615.00, stdev=1265.72, samples=2 00:16:55.331 iops : min= 5680, max= 6127, avg=5903.50, stdev=316.08, samples=2 00:16:55.331 lat (msec) : 4=0.08%, 10=12.84%, 20=87.09% 00:16:55.331 cpu : usr=6.98%, sys=10.57%, ctx=499, majf=0, minf=1 00:16:55.331 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:55.331 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.331 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.331 issued rwts: total=5632,6037,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.331 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.331 job2: (groupid=0, jobs=1): err= 0: pid=212159: Tue Nov 26 23:09:21 2024 00:16:55.331 read: IOPS=3038, BW=11.9MiB/s (12.4MB/s)(12.0MiB/1011msec) 00:16:55.331 slat (usec): min=3, max=12480, avg=121.23, stdev=791.85 00:16:55.331 clat (usec): min=2744, max=36862, avg=15005.88, stdev=5601.33 00:16:55.331 lat (usec): min=2752, max=36883, avg=15127.11, stdev=5653.93 00:16:55.331 clat percentiles (usec): 00:16:55.331 | 1.00th=[ 5997], 5.00th=[ 9110], 10.00th=[10290], 20.00th=[11731], 00:16:55.332 | 30.00th=[12256], 40.00th=[12649], 50.00th=[13435], 60.00th=[13960], 00:16:55.332 | 70.00th=[14615], 80.00th=[18220], 90.00th=[23462], 95.00th=[27919], 00:16:55.332 | 99.00th=[33162], 99.50th=[33817], 99.90th=[36963], 99.95th=[36963], 00:16:55.332 | 99.99th=[36963] 00:16:55.332 write: IOPS=3432, BW=13.4MiB/s (14.1MB/s)(13.6MiB/1011msec); 0 zone resets 00:16:55.332 slat (usec): min=4, max=41080, avg=168.50, stdev=993.90 00:16:55.332 clat (usec): min=2210, max=43288, avg=21511.77, stdev=8975.90 00:16:55.332 lat (usec): min=2238, max=60058, avg=21680.27, stdev=9057.17 00:16:55.332 clat percentiles (usec): 00:16:55.332 | 1.00th=[ 4686], 5.00th=[ 8291], 10.00th=[11600], 20.00th=[14484], 00:16:55.332 | 30.00th=[14877], 40.00th=[15401], 50.00th=[21627], 60.00th=[23725], 00:16:55.332 | 70.00th=[25822], 80.00th=[30278], 90.00th=[35390], 95.00th=[37487], 00:16:55.332 | 99.00th=[39584], 99.50th=[39584], 99.90th=[39584], 99.95th=[39584], 00:16:55.332 | 99.99th=[43254] 00:16:55.332 bw ( KiB/s): min=12992, max=13716, per=18.53%, avg=13354.00, stdev=511.95, samples=2 00:16:55.332 iops : min= 3248, max= 3429, avg=3338.50, stdev=127.99, samples=2 00:16:55.332 lat (msec) : 4=0.49%, 10=8.13%, 20=55.38%, 50=36.00% 00:16:55.332 cpu : usr=4.26%, sys=6.73%, ctx=415, majf=0, minf=1 00:16:55.332 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:16:55.332 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.332 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.332 issued rwts: total=3072,3470,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.332 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.332 job3: (groupid=0, jobs=1): err= 0: pid=212160: Tue Nov 26 23:09:21 2024 00:16:55.332 read: IOPS=4980, BW=19.5MiB/s (20.4MB/s)(19.5MiB/1003msec) 00:16:55.332 slat (usec): min=3, max=10595, avg=96.36, stdev=556.73 00:16:55.332 clat (usec): min=534, max=23200, avg=12459.82, stdev=1942.31 00:16:55.332 lat (usec): min=3881, max=23205, avg=12556.19, stdev=1974.13 00:16:55.332 clat percentiles (usec): 00:16:55.332 | 1.00th=[ 4686], 5.00th=[ 9634], 10.00th=[10683], 20.00th=[11469], 00:16:55.332 | 30.00th=[11994], 40.00th=[12125], 50.00th=[12387], 60.00th=[12518], 00:16:55.332 | 70.00th=[12780], 80.00th=[13435], 90.00th=[14091], 95.00th=[15926], 00:16:55.332 | 99.00th=[18220], 99.50th=[20841], 99.90th=[23200], 99.95th=[23200], 00:16:55.332 | 99.99th=[23200] 00:16:55.332 write: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:16:55.332 slat (usec): min=3, max=10564, avg=91.77, stdev=525.13 00:16:55.332 clat (usec): min=3277, max=23392, avg=12694.07, stdev=1924.20 00:16:55.332 lat (usec): min=3284, max=23434, avg=12785.84, stdev=1969.17 00:16:55.332 clat percentiles (usec): 00:16:55.332 | 1.00th=[ 5211], 5.00th=[ 9634], 10.00th=[10552], 20.00th=[11863], 00:16:55.332 | 30.00th=[12518], 40.00th=[12780], 50.00th=[12911], 60.00th=[13173], 00:16:55.332 | 70.00th=[13435], 80.00th=[13698], 90.00th=[13960], 95.00th=[14222], 00:16:55.332 | 99.00th=[19268], 99.50th=[20579], 99.90th=[22414], 99.95th=[23200], 00:16:55.332 | 99.99th=[23462] 00:16:55.332 bw ( KiB/s): min=20439, max=20480, per=28.39%, avg=20459.50, stdev=28.99, samples=2 00:16:55.332 iops : min= 5109, max= 5120, avg=5114.50, stdev= 7.78, samples=2 00:16:55.332 lat (usec) : 750=0.01% 00:16:55.332 lat (msec) : 4=0.30%, 10=6.09%, 20=92.95%, 50=0.65% 00:16:55.332 cpu : usr=6.39%, sys=9.28%, ctx=487, majf=0, minf=1 00:16:55.332 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:55.332 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.332 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.332 issued rwts: total=4995,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.332 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.332 00:16:55.332 Run status group 0 (all jobs): 00:16:55.332 READ: bw=65.9MiB/s (69.1MB/s), 11.9MiB/s-21.9MiB/s (12.4MB/s-23.0MB/s), io=66.6MiB (69.9MB), run=1003-1011msec 00:16:55.332 WRITE: bw=70.4MiB/s (73.8MB/s), 13.4MiB/s-23.5MiB/s (14.1MB/s-24.6MB/s), io=71.1MiB (74.6MB), run=1003-1011msec 00:16:55.332 00:16:55.332 Disk stats (read/write): 00:16:55.332 nvme0n1: ios=3122/3116, merge=0/0, ticks=23206/14342, in_queue=37548, util=86.07% 00:16:55.332 nvme0n2: ios=4700/5120, merge=0/0, ticks=18445/19297, in_queue=37742, util=90.44% 00:16:55.332 nvme0n3: ios=2620/2759, merge=0/0, ticks=38734/58686, in_queue=97420, util=99.90% 00:16:55.332 nvme0n4: ios=4124/4409, merge=0/0, ticks=29019/32938, in_queue=61957, util=92.59% 00:16:55.332 23:09:21 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:55.332 [global] 00:16:55.332 thread=1 00:16:55.332 invalidate=1 00:16:55.332 rw=randwrite 00:16:55.332 time_based=1 00:16:55.332 runtime=1 00:16:55.332 ioengine=libaio 00:16:55.332 direct=1 00:16:55.332 bs=4096 00:16:55.332 iodepth=128 00:16:55.332 norandommap=0 00:16:55.332 numjobs=1 00:16:55.332 00:16:55.332 verify_dump=1 00:16:55.332 verify_backlog=512 00:16:55.332 verify_state_save=0 00:16:55.332 do_verify=1 00:16:55.332 verify=crc32c-intel 00:16:55.332 [job0] 00:16:55.332 filename=/dev/nvme0n1 00:16:55.332 [job1] 00:16:55.332 filename=/dev/nvme0n2 00:16:55.332 [job2] 00:16:55.332 filename=/dev/nvme0n3 00:16:55.332 [job3] 00:16:55.332 filename=/dev/nvme0n4 00:16:55.332 Could not set queue depth (nvme0n1) 00:16:55.332 Could not set queue depth (nvme0n2) 00:16:55.332 Could not set queue depth (nvme0n3) 00:16:55.332 Could not set queue depth (nvme0n4) 00:16:55.591 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:55.591 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:55.591 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:55.591 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:55.591 fio-3.35 00:16:55.591 Starting 4 threads 00:16:56.965 00:16:56.965 job0: (groupid=0, jobs=1): err= 0: pid=212390: Tue Nov 26 23:09:22 2024 00:16:56.965 read: IOPS=5498, BW=21.5MiB/s (22.5MB/s)(21.5MiB/1002msec) 00:16:56.965 slat (usec): min=2, max=3572, avg=83.30, stdev=414.00 00:16:56.965 clat (usec): min=441, max=15261, avg=10845.40, stdev=1387.23 00:16:56.965 lat (usec): min=2251, max=15268, avg=10928.70, stdev=1388.79 00:16:56.965 clat percentiles (usec): 00:16:56.965 | 1.00th=[ 6194], 5.00th=[ 8717], 10.00th=[ 9503], 20.00th=[ 9896], 00:16:56.965 | 30.00th=[10290], 40.00th=[10683], 50.00th=[11076], 60.00th=[11338], 00:16:56.965 | 70.00th=[11469], 80.00th=[11731], 90.00th=[12125], 95.00th=[12780], 00:16:56.965 | 99.00th=[14091], 99.50th=[14222], 99.90th=[14746], 99.95th=[14746], 00:16:56.965 | 99.99th=[15270] 00:16:56.965 write: IOPS=5620, BW=22.0MiB/s (23.0MB/s)(22.0MiB/1002msec); 0 zone resets 00:16:56.965 slat (usec): min=3, max=6695, avg=87.34, stdev=426.27 00:16:56.965 clat (usec): min=6216, max=24262, avg=11760.72, stdev=1949.87 00:16:56.965 lat (usec): min=6225, max=24281, avg=11848.06, stdev=1955.50 00:16:56.965 clat percentiles (usec): 00:16:56.965 | 1.00th=[ 7832], 5.00th=[ 9503], 10.00th=[10159], 20.00th=[10552], 00:16:56.965 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11600], 00:16:56.965 | 70.00th=[12256], 80.00th=[12911], 90.00th=[13960], 95.00th=[14615], 00:16:56.965 | 99.00th=[19792], 99.50th=[20841], 99.90th=[22676], 99.95th=[22676], 00:16:56.965 | 99.99th=[24249] 00:16:56.965 bw ( KiB/s): min=23376, max=23376, per=32.90%, avg=23376.00, stdev= 0.00, samples=1 00:16:56.965 iops : min= 5844, max= 5844, avg=5844.00, stdev= 0.00, samples=1 00:16:56.965 lat (usec) : 500=0.01% 00:16:56.965 lat (msec) : 4=0.30%, 10=14.45%, 20=84.79%, 50=0.46% 00:16:56.965 cpu : usr=5.89%, sys=8.89%, ctx=564, majf=0, minf=1 00:16:56.965 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:56.965 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.965 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.965 issued rwts: total=5509,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.965 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.965 job1: (groupid=0, jobs=1): err= 0: pid=212391: Tue Nov 26 23:09:22 2024 00:16:56.965 read: IOPS=3135, BW=12.2MiB/s (12.8MB/s)(12.3MiB/1004msec) 00:16:56.965 slat (usec): min=2, max=18624, avg=146.24, stdev=930.55 00:16:56.965 clat (usec): min=886, max=59355, avg=16544.65, stdev=9795.83 00:16:56.965 lat (usec): min=3927, max=59361, avg=16690.89, stdev=9891.09 00:16:56.965 clat percentiles (usec): 00:16:56.965 | 1.00th=[ 6390], 5.00th=[ 7832], 10.00th=[ 9372], 20.00th=[ 9634], 00:16:56.965 | 30.00th=[10159], 40.00th=[11076], 50.00th=[13304], 60.00th=[14222], 00:16:56.965 | 70.00th=[16581], 80.00th=[21627], 90.00th=[32637], 95.00th=[39060], 00:16:56.965 | 99.00th=[45876], 99.50th=[52691], 99.90th=[59507], 99.95th=[59507], 00:16:56.965 | 99.99th=[59507] 00:16:56.965 write: IOPS=3569, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1004msec); 0 zone resets 00:16:56.965 slat (usec): min=4, max=17393, avg=141.89, stdev=782.24 00:16:56.965 clat (usec): min=1396, max=59358, avg=20746.29, stdev=12386.37 00:16:56.965 lat (usec): min=1430, max=59369, avg=20888.18, stdev=12473.59 00:16:56.965 clat percentiles (usec): 00:16:56.965 | 1.00th=[ 3818], 5.00th=[ 7177], 10.00th=[ 9896], 20.00th=[10814], 00:16:56.965 | 30.00th=[11863], 40.00th=[13698], 50.00th=[17695], 60.00th=[21627], 00:16:56.965 | 70.00th=[22414], 80.00th=[30802], 90.00th=[41157], 95.00th=[46924], 00:16:56.965 | 99.00th=[55313], 99.50th=[56361], 99.90th=[58459], 99.95th=[59507], 00:16:56.965 | 99.99th=[59507] 00:16:56.965 bw ( KiB/s): min=11488, max=16768, per=19.89%, avg=14128.00, stdev=3733.52, samples=2 00:16:56.965 iops : min= 2872, max= 4192, avg=3532.00, stdev=933.38, samples=2 00:16:56.965 lat (usec) : 1000=0.01% 00:16:56.965 lat (msec) : 2=0.07%, 4=1.04%, 10=17.88%, 20=46.94%, 50=31.88% 00:16:56.965 lat (msec) : 100=2.17% 00:16:56.965 cpu : usr=2.89%, sys=7.28%, ctx=353, majf=0, minf=1 00:16:56.965 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:56.965 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.965 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.965 issued rwts: total=3148,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.965 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.965 job2: (groupid=0, jobs=1): err= 0: pid=212392: Tue Nov 26 23:09:22 2024 00:16:56.965 read: IOPS=3433, BW=13.4MiB/s (14.1MB/s)(13.5MiB/1004msec) 00:16:56.965 slat (usec): min=2, max=20086, avg=128.86, stdev=940.06 00:16:56.965 clat (usec): min=1327, max=45813, avg=17299.97, stdev=6711.03 00:16:56.965 lat (usec): min=1341, max=45879, avg=17428.83, stdev=6777.07 00:16:56.965 clat percentiles (usec): 00:16:56.965 | 1.00th=[ 5997], 5.00th=[ 8848], 10.00th=[10945], 20.00th=[13829], 00:16:56.965 | 30.00th=[14222], 40.00th=[14877], 50.00th=[15533], 60.00th=[16188], 00:16:56.965 | 70.00th=[17171], 80.00th=[20841], 90.00th=[26084], 95.00th=[31065], 00:16:56.965 | 99.00th=[41681], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:16:56.965 | 99.99th=[45876] 00:16:56.965 write: IOPS=3569, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1004msec); 0 zone resets 00:16:56.965 slat (usec): min=3, max=24700, avg=133.12, stdev=881.90 00:16:56.965 clat (usec): min=488, max=65216, avg=18779.91, stdev=9329.91 00:16:56.965 lat (usec): min=1508, max=65232, avg=18913.03, stdev=9413.34 00:16:56.965 clat percentiles (usec): 00:16:56.965 | 1.00th=[ 6456], 5.00th=[ 8029], 10.00th=[11469], 20.00th=[13435], 00:16:56.965 | 30.00th=[14353], 40.00th=[14746], 50.00th=[15926], 60.00th=[17957], 00:16:56.965 | 70.00th=[21890], 80.00th=[23200], 90.00th=[26608], 95.00th=[36963], 00:16:56.965 | 99.00th=[58459], 99.50th=[61604], 99.90th=[65274], 99.95th=[65274], 00:16:56.965 | 99.99th=[65274] 00:16:56.965 bw ( KiB/s): min=13352, max=15320, per=20.18%, avg=14336.00, stdev=1391.59, samples=2 00:16:56.965 iops : min= 3338, max= 3830, avg=3584.00, stdev=347.90, samples=2 00:16:56.965 lat (usec) : 500=0.01% 00:16:56.965 lat (msec) : 2=0.03%, 10=7.98%, 20=62.79%, 50=27.83%, 100=1.35% 00:16:56.965 cpu : usr=2.39%, sys=4.69%, ctx=279, majf=0, minf=1 00:16:56.965 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:56.965 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.965 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.966 issued rwts: total=3447,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.966 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.966 job3: (groupid=0, jobs=1): err= 0: pid=212398: Tue Nov 26 23:09:22 2024 00:16:56.966 read: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec) 00:16:56.966 slat (usec): min=3, max=12179, avg=96.37, stdev=606.17 00:16:56.966 clat (usec): min=4604, max=26515, avg=12542.81, stdev=2552.51 00:16:56.966 lat (usec): min=4616, max=26524, avg=12639.18, stdev=2594.15 00:16:56.966 clat percentiles (usec): 00:16:56.966 | 1.00th=[ 8455], 5.00th=[ 9372], 10.00th=[10159], 20.00th=[11076], 00:16:56.966 | 30.00th=[11338], 40.00th=[11600], 50.00th=[12125], 60.00th=[12256], 00:16:56.966 | 70.00th=[12780], 80.00th=[13698], 90.00th=[15664], 95.00th=[17695], 00:16:56.966 | 99.00th=[21890], 99.50th=[23987], 99.90th=[26608], 99.95th=[26608], 00:16:56.966 | 99.99th=[26608] 00:16:56.966 write: IOPS=5016, BW=19.6MiB/s (20.5MB/s)(19.7MiB/1003msec); 0 zone resets 00:16:56.966 slat (usec): min=3, max=10170, avg=100.90, stdev=569.94 00:16:56.966 clat (usec): min=1251, max=60367, avg=13802.17, stdev=7943.54 00:16:56.966 lat (usec): min=1262, max=60374, avg=13903.07, stdev=7997.88 00:16:56.966 clat percentiles (usec): 00:16:56.966 | 1.00th=[ 3916], 5.00th=[ 7177], 10.00th=[ 9372], 20.00th=[10945], 00:16:56.966 | 30.00th=[12125], 40.00th=[12256], 50.00th=[12518], 60.00th=[12649], 00:16:56.966 | 70.00th=[12780], 80.00th=[13042], 90.00th=[16057], 95.00th=[30278], 00:16:56.966 | 99.00th=[53740], 99.50th=[54789], 99.90th=[60556], 99.95th=[60556], 00:16:56.966 | 99.99th=[60556] 00:16:56.966 bw ( KiB/s): min=17752, max=21488, per=27.62%, avg=19620.00, stdev=2641.75, samples=2 00:16:56.966 iops : min= 4438, max= 5372, avg=4905.00, stdev=660.44, samples=2 00:16:56.966 lat (msec) : 2=0.02%, 4=0.51%, 10=10.88%, 20=84.11%, 50=3.77% 00:16:56.966 lat (msec) : 100=0.72% 00:16:56.966 cpu : usr=6.29%, sys=8.48%, ctx=420, majf=0, minf=1 00:16:56.966 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:56.966 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.966 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.966 issued rwts: total=4608,5032,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.966 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.966 00:16:56.966 Run status group 0 (all jobs): 00:16:56.966 READ: bw=65.0MiB/s (68.2MB/s), 12.2MiB/s-21.5MiB/s (12.8MB/s-22.5MB/s), io=65.3MiB (68.5MB), run=1002-1004msec 00:16:56.966 WRITE: bw=69.4MiB/s (72.7MB/s), 13.9MiB/s-22.0MiB/s (14.6MB/s-23.0MB/s), io=69.7MiB (73.0MB), run=1002-1004msec 00:16:56.966 00:16:56.966 Disk stats (read/write): 00:16:56.966 nvme0n1: ios=4660/4901, merge=0/0, ticks=15699/17114, in_queue=32813, util=97.80% 00:16:56.966 nvme0n2: ios=2907/3072, merge=0/0, ticks=38401/56441, in_queue=94842, util=96.14% 00:16:56.966 nvme0n3: ios=2985/3072, merge=0/0, ticks=30459/33375, in_queue=63834, util=96.05% 00:16:56.966 nvme0n4: ios=3916/4096, merge=0/0, ticks=33063/42460, in_queue=75523, util=90.88% 00:16:56.966 23:09:22 -- target/fio.sh@55 -- # sync 00:16:56.966 23:09:22 -- target/fio.sh@59 -- # fio_pid=212552 00:16:56.966 23:09:22 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:56.966 23:09:22 -- target/fio.sh@61 -- # sleep 3 00:16:56.966 [global] 00:16:56.966 thread=1 00:16:56.966 invalidate=1 00:16:56.966 rw=read 00:16:56.966 time_based=1 00:16:56.966 runtime=10 00:16:56.966 ioengine=libaio 00:16:56.966 direct=1 00:16:56.966 bs=4096 00:16:56.966 iodepth=1 00:16:56.966 norandommap=1 00:16:56.966 numjobs=1 00:16:56.966 00:16:56.966 [job0] 00:16:56.966 filename=/dev/nvme0n1 00:16:56.966 [job1] 00:16:56.966 filename=/dev/nvme0n2 00:16:56.966 [job2] 00:16:56.966 filename=/dev/nvme0n3 00:16:56.966 [job3] 00:16:56.966 filename=/dev/nvme0n4 00:16:56.966 Could not set queue depth (nvme0n1) 00:16:56.966 Could not set queue depth (nvme0n2) 00:16:56.966 Could not set queue depth (nvme0n3) 00:16:56.966 Could not set queue depth (nvme0n4) 00:16:56.966 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:56.966 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:56.966 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:56.966 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:56.966 fio-3.35 00:16:56.966 Starting 4 threads 00:17:00.246 23:09:25 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:17:00.246 23:09:26 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:17:00.246 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=45756416, buflen=4096 00:17:00.246 fio: pid=212757, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:00.246 23:09:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.246 23:09:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:17:00.246 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=3481600, buflen=4096 00:17:00.246 fio: pid=212756, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:00.504 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=6762496, buflen=4096 00:17:00.504 fio: pid=212754, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:00.504 23:09:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.504 23:09:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:17:00.763 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=20656128, buflen=4096 00:17:00.763 fio: pid=212755, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:00.763 23:09:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.763 23:09:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:17:00.763 00:17:00.763 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212754: Tue Nov 26 23:09:27 2024 00:17:00.763 read: IOPS=482, BW=1929KiB/s (1975kB/s)(6604KiB/3424msec) 00:17:00.763 slat (usec): min=5, max=14882, avg=24.91, stdev=365.83 00:17:00.763 clat (usec): min=194, max=49013, avg=2030.77, stdev=8228.70 00:17:00.763 lat (usec): min=204, max=55936, avg=2055.70, stdev=8280.53 00:17:00.763 clat percentiles (usec): 00:17:00.763 | 1.00th=[ 243], 5.00th=[ 260], 10.00th=[ 269], 20.00th=[ 281], 00:17:00.763 | 30.00th=[ 289], 40.00th=[ 293], 50.00th=[ 297], 60.00th=[ 302], 00:17:00.763 | 70.00th=[ 306], 80.00th=[ 318], 90.00th=[ 355], 95.00th=[ 424], 00:17:00.763 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[49021], 00:17:00.763 | 99.99th=[49021] 00:17:00.763 bw ( KiB/s): min= 96, max= 5040, per=10.76%, avg=2188.00, stdev=2343.14, samples=6 00:17:00.763 iops : min= 24, max= 1260, avg=547.00, stdev=585.79, samples=6 00:17:00.763 lat (usec) : 250=2.06%, 500=93.64% 00:17:00.763 lat (msec) : 50=4.24% 00:17:00.763 cpu : usr=0.41%, sys=1.23%, ctx=1654, majf=0, minf=1 00:17:00.763 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.763 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.763 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.763 issued rwts: total=1652,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.763 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.763 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212755: Tue Nov 26 23:09:27 2024 00:17:00.763 read: IOPS=1369, BW=5479KiB/s (5610kB/s)(19.7MiB/3682msec) 00:17:00.763 slat (usec): min=5, max=10857, avg=17.79, stdev=227.20 00:17:00.763 clat (usec): min=164, max=46014, avg=706.90, stdev=4337.34 00:17:00.763 lat (usec): min=170, max=46032, avg=724.69, stdev=4343.46 00:17:00.763 clat percentiles (usec): 00:17:00.763 | 1.00th=[ 172], 5.00th=[ 180], 10.00th=[ 188], 20.00th=[ 200], 00:17:00.763 | 30.00th=[ 217], 40.00th=[ 231], 50.00th=[ 245], 60.00th=[ 269], 00:17:00.763 | 70.00th=[ 281], 80.00th=[ 289], 90.00th=[ 297], 95.00th=[ 302], 00:17:00.763 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:00.763 | 99.99th=[45876] 00:17:00.763 bw ( KiB/s): min= 96, max=13984, per=25.72%, avg=5230.86, stdev=5508.98, samples=7 00:17:00.763 iops : min= 24, max= 3496, avg=1307.71, stdev=1377.25, samples=7 00:17:00.763 lat (usec) : 250=53.37%, 500=45.36%, 750=0.04%, 1000=0.02% 00:17:00.763 lat (msec) : 2=0.02%, 4=0.06%, 50=1.11% 00:17:00.763 cpu : usr=1.25%, sys=2.58%, ctx=5049, majf=0, minf=1 00:17:00.763 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.763 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.763 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.763 issued rwts: total=5044,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.763 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.763 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212756: Tue Nov 26 23:09:27 2024 00:17:00.763 read: IOPS=269, BW=1076KiB/s (1101kB/s)(3400KiB/3161msec) 00:17:00.763 slat (nsec): min=5871, max=35610, avg=8284.76, stdev=5488.66 00:17:00.763 clat (usec): min=178, max=42020, avg=3680.84, stdev=11483.85 00:17:00.763 lat (usec): min=187, max=42037, avg=3689.12, stdev=11488.17 00:17:00.763 clat percentiles (usec): 00:17:00.763 | 1.00th=[ 188], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 198], 00:17:00.763 | 30.00th=[ 200], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 210], 00:17:00.763 | 70.00th=[ 221], 80.00th=[ 265], 90.00th=[ 277], 95.00th=[42206], 00:17:00.763 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:00.763 | 99.99th=[42206] 00:17:00.763 bw ( KiB/s): min= 96, max= 1496, per=1.62%, avg=329.33, stdev=571.55, samples=6 00:17:00.763 iops : min= 24, max= 374, avg=82.33, stdev=142.89, samples=6 00:17:00.763 lat (usec) : 250=72.03%, 500=19.51% 00:17:00.763 lat (msec) : 50=8.34% 00:17:00.763 cpu : usr=0.28%, sys=0.13%, ctx=852, majf=0, minf=1 00:17:00.763 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.763 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.763 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.763 issued rwts: total=851,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.763 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.763 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212757: Tue Nov 26 23:09:27 2024 00:17:00.763 read: IOPS=3872, BW=15.1MiB/s (15.9MB/s)(43.6MiB/2885msec) 00:17:00.763 slat (nsec): min=5251, max=62579, avg=11309.94, stdev=5666.09 00:17:00.763 clat (usec): min=176, max=1180, avg=241.85, stdev=44.59 00:17:00.763 lat (usec): min=182, max=1187, avg=253.16, stdev=48.40 00:17:00.763 clat percentiles (usec): 00:17:00.763 | 1.00th=[ 184], 5.00th=[ 192], 10.00th=[ 196], 20.00th=[ 202], 00:17:00.763 | 30.00th=[ 210], 40.00th=[ 219], 50.00th=[ 229], 60.00th=[ 245], 00:17:00.763 | 70.00th=[ 273], 80.00th=[ 289], 90.00th=[ 302], 95.00th=[ 310], 00:17:00.763 | 99.00th=[ 334], 99.50th=[ 383], 99.90th=[ 441], 99.95th=[ 506], 00:17:00.763 | 99.99th=[ 1057] 00:17:00.764 bw ( KiB/s): min=12664, max=17048, per=75.65%, avg=15380.80, stdev=1674.14, samples=5 00:17:00.764 iops : min= 3166, max= 4262, avg=3845.20, stdev=418.53, samples=5 00:17:00.764 lat (usec) : 250=62.15%, 500=37.79%, 750=0.02%, 1000=0.02% 00:17:00.764 lat (msec) : 2=0.02% 00:17:00.764 cpu : usr=2.46%, sys=7.14%, ctx=11172, majf=0, minf=2 00:17:00.764 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.764 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.764 issued rwts: total=11172,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.764 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.764 00:17:00.764 Run status group 0 (all jobs): 00:17:00.764 READ: bw=19.9MiB/s (20.8MB/s), 1076KiB/s-15.1MiB/s (1101kB/s-15.9MB/s), io=73.1MiB (76.7MB), run=2885-3682msec 00:17:00.764 00:17:00.764 Disk stats (read/write): 00:17:00.764 nvme0n1: ios=1667/0, merge=0/0, ticks=3553/0, in_queue=3553, util=99.00% 00:17:00.764 nvme0n2: ios=4707/0, merge=0/0, ticks=3439/0, in_queue=3439, util=95.93% 00:17:00.764 nvme0n3: ios=751/0, merge=0/0, ticks=4033/0, in_queue=4033, util=99.38% 00:17:00.764 nvme0n4: ios=11151/0, merge=0/0, ticks=2579/0, in_queue=2579, util=96.75% 00:17:01.022 23:09:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.022 23:09:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:17:01.280 23:09:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.280 23:09:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:17:01.538 23:09:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.538 23:09:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:17:01.797 23:09:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.797 23:09:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:17:02.055 23:09:28 -- target/fio.sh@69 -- # fio_status=0 00:17:02.055 23:09:28 -- target/fio.sh@70 -- # wait 212552 00:17:02.055 23:09:28 -- target/fio.sh@70 -- # fio_status=4 00:17:02.055 23:09:28 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:02.313 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:02.313 23:09:28 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:02.313 23:09:28 -- common/autotest_common.sh@1208 -- # local i=0 00:17:02.313 23:09:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:17:02.313 23:09:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:02.313 23:09:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:17:02.313 23:09:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:02.313 23:09:28 -- common/autotest_common.sh@1220 -- # return 0 00:17:02.313 23:09:28 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:17:02.313 23:09:28 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:17:02.313 nvmf hotplug test: fio failed as expected 00:17:02.313 23:09:28 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:02.571 23:09:28 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:17:02.571 23:09:28 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:17:02.571 23:09:28 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:17:02.571 23:09:28 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:17:02.571 23:09:28 -- target/fio.sh@91 -- # nvmftestfini 00:17:02.571 23:09:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:02.571 23:09:28 -- nvmf/common.sh@116 -- # sync 00:17:02.571 23:09:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:02.571 23:09:28 -- nvmf/common.sh@119 -- # set +e 00:17:02.571 23:09:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:02.571 23:09:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:02.571 rmmod nvme_tcp 00:17:02.571 rmmod nvme_fabrics 00:17:02.571 rmmod nvme_keyring 00:17:02.571 23:09:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:02.571 23:09:28 -- nvmf/common.sh@123 -- # set -e 00:17:02.571 23:09:28 -- nvmf/common.sh@124 -- # return 0 00:17:02.571 23:09:28 -- nvmf/common.sh@477 -- # '[' -n 210445 ']' 00:17:02.571 23:09:28 -- nvmf/common.sh@478 -- # killprocess 210445 00:17:02.571 23:09:28 -- common/autotest_common.sh@936 -- # '[' -z 210445 ']' 00:17:02.571 23:09:28 -- common/autotest_common.sh@940 -- # kill -0 210445 00:17:02.571 23:09:28 -- common/autotest_common.sh@941 -- # uname 00:17:02.571 23:09:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:02.571 23:09:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 210445 00:17:02.571 23:09:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:02.571 23:09:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:02.571 23:09:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 210445' 00:17:02.571 killing process with pid 210445 00:17:02.571 23:09:28 -- common/autotest_common.sh@955 -- # kill 210445 00:17:02.571 23:09:28 -- common/autotest_common.sh@960 -- # wait 210445 00:17:02.829 23:09:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:02.829 23:09:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:02.829 23:09:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:02.829 23:09:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:02.829 23:09:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:02.829 23:09:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.829 23:09:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.829 23:09:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:05.362 23:09:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:05.362 00:17:05.362 real 0m24.307s 00:17:05.362 user 1m26.020s 00:17:05.362 sys 0m6.865s 00:17:05.362 23:09:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:05.362 23:09:31 -- common/autotest_common.sh@10 -- # set +x 00:17:05.362 ************************************ 00:17:05.362 END TEST nvmf_fio_target 00:17:05.362 ************************************ 00:17:05.362 23:09:31 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:05.362 23:09:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:05.362 23:09:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:05.362 23:09:31 -- common/autotest_common.sh@10 -- # set +x 00:17:05.362 ************************************ 00:17:05.362 START TEST nvmf_bdevio 00:17:05.362 ************************************ 00:17:05.362 23:09:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:05.362 * Looking for test storage... 00:17:05.362 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:05.362 23:09:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:05.362 23:09:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:05.362 23:09:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:05.362 23:09:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:05.362 23:09:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:05.362 23:09:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:05.362 23:09:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:05.362 23:09:31 -- scripts/common.sh@335 -- # IFS=.-: 00:17:05.362 23:09:31 -- scripts/common.sh@335 -- # read -ra ver1 00:17:05.362 23:09:31 -- scripts/common.sh@336 -- # IFS=.-: 00:17:05.362 23:09:31 -- scripts/common.sh@336 -- # read -ra ver2 00:17:05.362 23:09:31 -- scripts/common.sh@337 -- # local 'op=<' 00:17:05.362 23:09:31 -- scripts/common.sh@339 -- # ver1_l=2 00:17:05.362 23:09:31 -- scripts/common.sh@340 -- # ver2_l=1 00:17:05.362 23:09:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:05.362 23:09:31 -- scripts/common.sh@343 -- # case "$op" in 00:17:05.362 23:09:31 -- scripts/common.sh@344 -- # : 1 00:17:05.362 23:09:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:05.362 23:09:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:05.362 23:09:31 -- scripts/common.sh@364 -- # decimal 1 00:17:05.362 23:09:31 -- scripts/common.sh@352 -- # local d=1 00:17:05.362 23:09:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:05.362 23:09:31 -- scripts/common.sh@354 -- # echo 1 00:17:05.362 23:09:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:05.362 23:09:31 -- scripts/common.sh@365 -- # decimal 2 00:17:05.362 23:09:31 -- scripts/common.sh@352 -- # local d=2 00:17:05.362 23:09:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:05.362 23:09:31 -- scripts/common.sh@354 -- # echo 2 00:17:05.362 23:09:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:05.362 23:09:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:05.362 23:09:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:05.362 23:09:31 -- scripts/common.sh@367 -- # return 0 00:17:05.362 23:09:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:05.362 23:09:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:05.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.362 --rc genhtml_branch_coverage=1 00:17:05.362 --rc genhtml_function_coverage=1 00:17:05.362 --rc genhtml_legend=1 00:17:05.362 --rc geninfo_all_blocks=1 00:17:05.362 --rc geninfo_unexecuted_blocks=1 00:17:05.362 00:17:05.362 ' 00:17:05.362 23:09:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:05.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.362 --rc genhtml_branch_coverage=1 00:17:05.362 --rc genhtml_function_coverage=1 00:17:05.362 --rc genhtml_legend=1 00:17:05.362 --rc geninfo_all_blocks=1 00:17:05.362 --rc geninfo_unexecuted_blocks=1 00:17:05.362 00:17:05.362 ' 00:17:05.362 23:09:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:05.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.362 --rc genhtml_branch_coverage=1 00:17:05.362 --rc genhtml_function_coverage=1 00:17:05.362 --rc genhtml_legend=1 00:17:05.362 --rc geninfo_all_blocks=1 00:17:05.362 --rc geninfo_unexecuted_blocks=1 00:17:05.362 00:17:05.362 ' 00:17:05.362 23:09:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:05.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.362 --rc genhtml_branch_coverage=1 00:17:05.362 --rc genhtml_function_coverage=1 00:17:05.362 --rc genhtml_legend=1 00:17:05.362 --rc geninfo_all_blocks=1 00:17:05.362 --rc geninfo_unexecuted_blocks=1 00:17:05.362 00:17:05.362 ' 00:17:05.362 23:09:31 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:05.362 23:09:31 -- nvmf/common.sh@7 -- # uname -s 00:17:05.362 23:09:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:05.362 23:09:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:05.362 23:09:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:05.362 23:09:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:05.362 23:09:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:05.362 23:09:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:05.362 23:09:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:05.362 23:09:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:05.362 23:09:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:05.362 23:09:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:05.362 23:09:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:05.362 23:09:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:05.362 23:09:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:05.362 23:09:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:05.362 23:09:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:05.362 23:09:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:05.362 23:09:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:05.362 23:09:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:05.362 23:09:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:05.362 23:09:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.362 23:09:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.362 23:09:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.362 23:09:31 -- paths/export.sh@5 -- # export PATH 00:17:05.362 23:09:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.362 23:09:31 -- nvmf/common.sh@46 -- # : 0 00:17:05.362 23:09:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:05.362 23:09:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:05.362 23:09:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:05.362 23:09:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:05.362 23:09:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:05.362 23:09:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:05.362 23:09:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:05.362 23:09:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:05.362 23:09:31 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:05.362 23:09:31 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:05.362 23:09:31 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:05.362 23:09:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:05.362 23:09:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:05.362 23:09:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:05.362 23:09:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:05.362 23:09:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:05.362 23:09:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:05.362 23:09:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:05.362 23:09:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:05.362 23:09:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:05.362 23:09:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:05.362 23:09:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:05.362 23:09:31 -- common/autotest_common.sh@10 -- # set +x 00:17:07.265 23:09:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:07.265 23:09:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:07.265 23:09:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:07.265 23:09:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:07.265 23:09:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:07.265 23:09:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:07.265 23:09:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:07.265 23:09:33 -- nvmf/common.sh@294 -- # net_devs=() 00:17:07.265 23:09:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:07.265 23:09:33 -- nvmf/common.sh@295 -- # e810=() 00:17:07.265 23:09:33 -- nvmf/common.sh@295 -- # local -ga e810 00:17:07.265 23:09:33 -- nvmf/common.sh@296 -- # x722=() 00:17:07.265 23:09:33 -- nvmf/common.sh@296 -- # local -ga x722 00:17:07.265 23:09:33 -- nvmf/common.sh@297 -- # mlx=() 00:17:07.265 23:09:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:07.265 23:09:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:07.265 23:09:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:07.265 23:09:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:07.265 23:09:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:07.265 23:09:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:07.265 23:09:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:07.265 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:07.265 23:09:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:07.265 23:09:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:07.265 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:07.265 23:09:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:07.265 23:09:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:07.265 23:09:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.265 23:09:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:07.265 23:09:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.265 23:09:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:07.265 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:07.265 23:09:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.265 23:09:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:07.265 23:09:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.265 23:09:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:07.265 23:09:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.265 23:09:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:07.265 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:07.265 23:09:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.265 23:09:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:07.265 23:09:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:07.265 23:09:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:07.265 23:09:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:07.265 23:09:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:07.265 23:09:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:07.265 23:09:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:07.265 23:09:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:07.265 23:09:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:07.265 23:09:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:07.265 23:09:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:07.265 23:09:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:07.265 23:09:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:07.265 23:09:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:07.265 23:09:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:07.265 23:09:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:07.265 23:09:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:07.265 23:09:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:07.265 23:09:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:07.265 23:09:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:07.265 23:09:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:07.265 23:09:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:07.265 23:09:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:07.265 23:09:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:07.265 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:07.265 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:17:07.265 00:17:07.265 --- 10.0.0.2 ping statistics --- 00:17:07.265 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.265 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:17:07.265 23:09:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:07.265 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:07.265 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:17:07.266 00:17:07.266 --- 10.0.0.1 ping statistics --- 00:17:07.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.266 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:17:07.266 23:09:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:07.266 23:09:33 -- nvmf/common.sh@410 -- # return 0 00:17:07.266 23:09:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:07.266 23:09:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:07.266 23:09:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:07.266 23:09:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:07.266 23:09:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:07.266 23:09:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:07.266 23:09:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:07.266 23:09:33 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:07.266 23:09:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:07.266 23:09:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:07.266 23:09:33 -- common/autotest_common.sh@10 -- # set +x 00:17:07.266 23:09:33 -- nvmf/common.sh@469 -- # nvmfpid=215412 00:17:07.266 23:09:33 -- nvmf/common.sh@470 -- # waitforlisten 215412 00:17:07.266 23:09:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:07.266 23:09:33 -- common/autotest_common.sh@829 -- # '[' -z 215412 ']' 00:17:07.266 23:09:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:07.266 23:09:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:07.266 23:09:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:07.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:07.266 23:09:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:07.266 23:09:33 -- common/autotest_common.sh@10 -- # set +x 00:17:07.266 [2024-11-26 23:09:33.548162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:07.266 [2024-11-26 23:09:33.548257] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:07.266 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.266 [2024-11-26 23:09:33.617481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:07.523 [2024-11-26 23:09:33.737007] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:07.523 [2024-11-26 23:09:33.737195] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:07.523 [2024-11-26 23:09:33.737215] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:07.523 [2024-11-26 23:09:33.737229] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:07.523 [2024-11-26 23:09:33.737365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:07.523 [2024-11-26 23:09:33.737446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:07.523 [2024-11-26 23:09:33.737557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:07.523 [2024-11-26 23:09:33.737562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:08.457 23:09:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:08.457 23:09:34 -- common/autotest_common.sh@862 -- # return 0 00:17:08.457 23:09:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:08.457 23:09:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:08.457 23:09:34 -- common/autotest_common.sh@10 -- # set +x 00:17:08.457 23:09:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:08.457 23:09:34 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:08.457 23:09:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.457 23:09:34 -- common/autotest_common.sh@10 -- # set +x 00:17:08.457 [2024-11-26 23:09:34.535059] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:08.457 23:09:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.457 23:09:34 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:08.457 23:09:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.457 23:09:34 -- common/autotest_common.sh@10 -- # set +x 00:17:08.457 Malloc0 00:17:08.457 23:09:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.457 23:09:34 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:08.457 23:09:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.457 23:09:34 -- common/autotest_common.sh@10 -- # set +x 00:17:08.457 23:09:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.457 23:09:34 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:08.457 23:09:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.457 23:09:34 -- common/autotest_common.sh@10 -- # set +x 00:17:08.457 23:09:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.457 23:09:34 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:08.457 23:09:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.457 23:09:34 -- common/autotest_common.sh@10 -- # set +x 00:17:08.457 [2024-11-26 23:09:34.588297] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:08.457 23:09:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.457 23:09:34 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:08.457 23:09:34 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:08.457 23:09:34 -- nvmf/common.sh@520 -- # config=() 00:17:08.457 23:09:34 -- nvmf/common.sh@520 -- # local subsystem config 00:17:08.457 23:09:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:08.457 23:09:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:08.457 { 00:17:08.457 "params": { 00:17:08.457 "name": "Nvme$subsystem", 00:17:08.457 "trtype": "$TEST_TRANSPORT", 00:17:08.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:08.457 "adrfam": "ipv4", 00:17:08.457 "trsvcid": "$NVMF_PORT", 00:17:08.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:08.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:08.457 "hdgst": ${hdgst:-false}, 00:17:08.457 "ddgst": ${ddgst:-false} 00:17:08.457 }, 00:17:08.457 "method": "bdev_nvme_attach_controller" 00:17:08.457 } 00:17:08.457 EOF 00:17:08.457 )") 00:17:08.457 23:09:34 -- nvmf/common.sh@542 -- # cat 00:17:08.457 23:09:34 -- nvmf/common.sh@544 -- # jq . 00:17:08.457 23:09:34 -- nvmf/common.sh@545 -- # IFS=, 00:17:08.457 23:09:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:08.458 "params": { 00:17:08.458 "name": "Nvme1", 00:17:08.458 "trtype": "tcp", 00:17:08.458 "traddr": "10.0.0.2", 00:17:08.458 "adrfam": "ipv4", 00:17:08.458 "trsvcid": "4420", 00:17:08.458 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:08.458 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:08.458 "hdgst": false, 00:17:08.458 "ddgst": false 00:17:08.458 }, 00:17:08.458 "method": "bdev_nvme_attach_controller" 00:17:08.458 }' 00:17:08.458 [2024-11-26 23:09:34.627950] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:08.458 [2024-11-26 23:09:34.628028] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid215572 ] 00:17:08.458 EAL: No free 2048 kB hugepages reported on node 1 00:17:08.458 [2024-11-26 23:09:34.689850] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:08.458 [2024-11-26 23:09:34.803627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:08.458 [2024-11-26 23:09:34.803676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:08.458 [2024-11-26 23:09:34.803679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:08.715 [2024-11-26 23:09:35.019551] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:08.715 [2024-11-26 23:09:35.019608] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:08.715 I/O targets: 00:17:08.715 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:08.715 00:17:08.715 00:17:08.716 CUnit - A unit testing framework for C - Version 2.1-3 00:17:08.716 http://cunit.sourceforge.net/ 00:17:08.716 00:17:08.716 00:17:08.716 Suite: bdevio tests on: Nvme1n1 00:17:08.716 Test: blockdev write read block ...passed 00:17:08.973 Test: blockdev write zeroes read block ...passed 00:17:08.973 Test: blockdev write zeroes read no split ...passed 00:17:08.973 Test: blockdev write zeroes read split ...passed 00:17:08.973 Test: blockdev write zeroes read split partial ...passed 00:17:08.973 Test: blockdev reset ...[2024-11-26 23:09:35.175984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:08.973 [2024-11-26 23:09:35.176092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8f3f20 (9): Bad file descriptor 00:17:08.973 [2024-11-26 23:09:35.230199] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:08.973 passed 00:17:08.973 Test: blockdev write read 8 blocks ...passed 00:17:08.973 Test: blockdev write read size > 128k ...passed 00:17:08.973 Test: blockdev write read invalid size ...passed 00:17:08.973 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:08.973 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:08.973 Test: blockdev write read max offset ...passed 00:17:09.232 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:09.232 Test: blockdev writev readv 8 blocks ...passed 00:17:09.232 Test: blockdev writev readv 30 x 1block ...passed 00:17:09.232 Test: blockdev writev readv block ...passed 00:17:09.232 Test: blockdev writev readv size > 128k ...passed 00:17:09.232 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:09.232 Test: blockdev comparev and writev ...[2024-11-26 23:09:35.443582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.232 [2024-11-26 23:09:35.443620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.443646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.232 [2024-11-26 23:09:35.443663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.443974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.232 [2024-11-26 23:09:35.443999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.444020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.232 [2024-11-26 23:09:35.444036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.444315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.232 [2024-11-26 23:09:35.444339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.444361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.232 [2024-11-26 23:09:35.444376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.444675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.232 [2024-11-26 23:09:35.444700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.444721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.232 [2024-11-26 23:09:35.444736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:09.232 passed 00:17:09.232 Test: blockdev nvme passthru rw ...passed 00:17:09.232 Test: blockdev nvme passthru vendor specific ...[2024-11-26 23:09:35.527780] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.232 [2024-11-26 23:09:35.527809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.527957] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.232 [2024-11-26 23:09:35.527979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.528107] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.232 [2024-11-26 23:09:35.528130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:09.232 [2024-11-26 23:09:35.528260] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.232 [2024-11-26 23:09:35.528283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:09.232 passed 00:17:09.232 Test: blockdev nvme admin passthru ...passed 00:17:09.232 Test: blockdev copy ...passed 00:17:09.232 00:17:09.232 Run Summary: Type Total Ran Passed Failed Inactive 00:17:09.232 suites 1 1 n/a 0 0 00:17:09.232 tests 23 23 23 0 0 00:17:09.232 asserts 152 152 152 0 n/a 00:17:09.232 00:17:09.232 Elapsed time = 1.140 seconds 00:17:09.490 23:09:35 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:09.490 23:09:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.490 23:09:35 -- common/autotest_common.sh@10 -- # set +x 00:17:09.490 23:09:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.490 23:09:35 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:09.490 23:09:35 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:09.490 23:09:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:09.490 23:09:35 -- nvmf/common.sh@116 -- # sync 00:17:09.490 23:09:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:09.490 23:09:35 -- nvmf/common.sh@119 -- # set +e 00:17:09.490 23:09:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:09.490 23:09:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:09.490 rmmod nvme_tcp 00:17:09.490 rmmod nvme_fabrics 00:17:09.490 rmmod nvme_keyring 00:17:09.490 23:09:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:09.490 23:09:35 -- nvmf/common.sh@123 -- # set -e 00:17:09.490 23:09:35 -- nvmf/common.sh@124 -- # return 0 00:17:09.490 23:09:35 -- nvmf/common.sh@477 -- # '[' -n 215412 ']' 00:17:09.490 23:09:35 -- nvmf/common.sh@478 -- # killprocess 215412 00:17:09.490 23:09:35 -- common/autotest_common.sh@936 -- # '[' -z 215412 ']' 00:17:09.490 23:09:35 -- common/autotest_common.sh@940 -- # kill -0 215412 00:17:09.490 23:09:35 -- common/autotest_common.sh@941 -- # uname 00:17:09.490 23:09:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:09.490 23:09:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 215412 00:17:09.749 23:09:35 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:09.749 23:09:35 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:09.749 23:09:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 215412' 00:17:09.749 killing process with pid 215412 00:17:09.749 23:09:35 -- common/autotest_common.sh@955 -- # kill 215412 00:17:09.749 23:09:35 -- common/autotest_common.sh@960 -- # wait 215412 00:17:10.008 23:09:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:10.008 23:09:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:10.008 23:09:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:10.008 23:09:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:10.008 23:09:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:10.008 23:09:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.008 23:09:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.008 23:09:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.915 23:09:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:11.915 00:17:11.915 real 0m6.997s 00:17:11.915 user 0m12.830s 00:17:11.915 sys 0m2.088s 00:17:11.915 23:09:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:11.915 23:09:38 -- common/autotest_common.sh@10 -- # set +x 00:17:11.915 ************************************ 00:17:11.915 END TEST nvmf_bdevio 00:17:11.915 ************************************ 00:17:11.915 23:09:38 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:11.915 23:09:38 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:11.915 23:09:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:11.915 23:09:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:11.915 23:09:38 -- common/autotest_common.sh@10 -- # set +x 00:17:11.915 ************************************ 00:17:11.915 START TEST nvmf_bdevio_no_huge 00:17:11.915 ************************************ 00:17:11.915 23:09:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:11.915 * Looking for test storage... 00:17:12.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:12.175 23:09:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:12.175 23:09:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:12.175 23:09:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:12.175 23:09:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:12.175 23:09:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:12.175 23:09:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:12.175 23:09:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:12.175 23:09:38 -- scripts/common.sh@335 -- # IFS=.-: 00:17:12.175 23:09:38 -- scripts/common.sh@335 -- # read -ra ver1 00:17:12.175 23:09:38 -- scripts/common.sh@336 -- # IFS=.-: 00:17:12.175 23:09:38 -- scripts/common.sh@336 -- # read -ra ver2 00:17:12.175 23:09:38 -- scripts/common.sh@337 -- # local 'op=<' 00:17:12.175 23:09:38 -- scripts/common.sh@339 -- # ver1_l=2 00:17:12.175 23:09:38 -- scripts/common.sh@340 -- # ver2_l=1 00:17:12.175 23:09:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:12.175 23:09:38 -- scripts/common.sh@343 -- # case "$op" in 00:17:12.175 23:09:38 -- scripts/common.sh@344 -- # : 1 00:17:12.175 23:09:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:12.175 23:09:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:12.175 23:09:38 -- scripts/common.sh@364 -- # decimal 1 00:17:12.175 23:09:38 -- scripts/common.sh@352 -- # local d=1 00:17:12.175 23:09:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:12.175 23:09:38 -- scripts/common.sh@354 -- # echo 1 00:17:12.175 23:09:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:12.175 23:09:38 -- scripts/common.sh@365 -- # decimal 2 00:17:12.175 23:09:38 -- scripts/common.sh@352 -- # local d=2 00:17:12.175 23:09:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:12.175 23:09:38 -- scripts/common.sh@354 -- # echo 2 00:17:12.175 23:09:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:12.175 23:09:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:12.175 23:09:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:12.175 23:09:38 -- scripts/common.sh@367 -- # return 0 00:17:12.175 23:09:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:12.175 23:09:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:12.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.175 --rc genhtml_branch_coverage=1 00:17:12.175 --rc genhtml_function_coverage=1 00:17:12.175 --rc genhtml_legend=1 00:17:12.175 --rc geninfo_all_blocks=1 00:17:12.175 --rc geninfo_unexecuted_blocks=1 00:17:12.175 00:17:12.175 ' 00:17:12.175 23:09:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:12.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.175 --rc genhtml_branch_coverage=1 00:17:12.175 --rc genhtml_function_coverage=1 00:17:12.175 --rc genhtml_legend=1 00:17:12.175 --rc geninfo_all_blocks=1 00:17:12.175 --rc geninfo_unexecuted_blocks=1 00:17:12.175 00:17:12.175 ' 00:17:12.175 23:09:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:12.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.175 --rc genhtml_branch_coverage=1 00:17:12.175 --rc genhtml_function_coverage=1 00:17:12.175 --rc genhtml_legend=1 00:17:12.175 --rc geninfo_all_blocks=1 00:17:12.175 --rc geninfo_unexecuted_blocks=1 00:17:12.175 00:17:12.175 ' 00:17:12.175 23:09:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:12.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.175 --rc genhtml_branch_coverage=1 00:17:12.175 --rc genhtml_function_coverage=1 00:17:12.175 --rc genhtml_legend=1 00:17:12.175 --rc geninfo_all_blocks=1 00:17:12.175 --rc geninfo_unexecuted_blocks=1 00:17:12.175 00:17:12.175 ' 00:17:12.175 23:09:38 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:12.175 23:09:38 -- nvmf/common.sh@7 -- # uname -s 00:17:12.175 23:09:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:12.175 23:09:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:12.175 23:09:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:12.175 23:09:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:12.175 23:09:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:12.175 23:09:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:12.175 23:09:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:12.175 23:09:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:12.175 23:09:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:12.175 23:09:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:12.175 23:09:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:12.175 23:09:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:12.175 23:09:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:12.175 23:09:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:12.175 23:09:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:12.175 23:09:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:12.175 23:09:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:12.175 23:09:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:12.175 23:09:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:12.175 23:09:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.175 23:09:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.175 23:09:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.175 23:09:38 -- paths/export.sh@5 -- # export PATH 00:17:12.175 23:09:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.175 23:09:38 -- nvmf/common.sh@46 -- # : 0 00:17:12.175 23:09:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:12.175 23:09:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:12.175 23:09:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:12.175 23:09:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:12.175 23:09:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:12.175 23:09:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:12.175 23:09:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:12.175 23:09:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:12.175 23:09:38 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:12.175 23:09:38 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:12.175 23:09:38 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:12.175 23:09:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:12.176 23:09:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:12.176 23:09:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:12.176 23:09:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:12.176 23:09:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:12.176 23:09:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:12.176 23:09:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:12.176 23:09:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:12.176 23:09:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:12.176 23:09:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:12.176 23:09:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:12.176 23:09:38 -- common/autotest_common.sh@10 -- # set +x 00:17:14.706 23:09:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:14.706 23:09:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:14.706 23:09:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:14.706 23:09:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:14.706 23:09:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:14.706 23:09:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:14.706 23:09:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:14.706 23:09:40 -- nvmf/common.sh@294 -- # net_devs=() 00:17:14.706 23:09:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:14.706 23:09:40 -- nvmf/common.sh@295 -- # e810=() 00:17:14.706 23:09:40 -- nvmf/common.sh@295 -- # local -ga e810 00:17:14.706 23:09:40 -- nvmf/common.sh@296 -- # x722=() 00:17:14.706 23:09:40 -- nvmf/common.sh@296 -- # local -ga x722 00:17:14.706 23:09:40 -- nvmf/common.sh@297 -- # mlx=() 00:17:14.706 23:09:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:14.706 23:09:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:14.706 23:09:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:14.706 23:09:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:14.706 23:09:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:14.706 23:09:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:14.706 23:09:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:14.707 23:09:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:14.707 23:09:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.707 23:09:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:14.707 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:14.707 23:09:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.707 23:09:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:14.707 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:14.707 23:09:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:14.707 23:09:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.707 23:09:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.707 23:09:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.707 23:09:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.707 23:09:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:14.707 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:14.707 23:09:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.707 23:09:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.707 23:09:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.707 23:09:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.707 23:09:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.707 23:09:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:14.707 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:14.707 23:09:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.707 23:09:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:14.707 23:09:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:14.707 23:09:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:14.707 23:09:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:14.707 23:09:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:14.707 23:09:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:14.707 23:09:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:14.707 23:09:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:14.707 23:09:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:14.707 23:09:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:14.707 23:09:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:14.707 23:09:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:14.707 23:09:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:14.707 23:09:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:14.707 23:09:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:14.707 23:09:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:14.707 23:09:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:14.707 23:09:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:14.707 23:09:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:14.707 23:09:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:14.707 23:09:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:14.707 23:09:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:14.707 23:09:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:14.707 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:14.707 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:17:14.707 00:17:14.707 --- 10.0.0.2 ping statistics --- 00:17:14.707 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.707 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:17:14.707 23:09:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:14.707 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:14.707 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:17:14.707 00:17:14.707 --- 10.0.0.1 ping statistics --- 00:17:14.707 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.707 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:17:14.707 23:09:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:14.707 23:09:40 -- nvmf/common.sh@410 -- # return 0 00:17:14.707 23:09:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:14.707 23:09:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:14.707 23:09:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:14.707 23:09:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:14.707 23:09:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:14.707 23:09:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:14.707 23:09:40 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:14.707 23:09:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:14.707 23:09:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:14.707 23:09:40 -- common/autotest_common.sh@10 -- # set +x 00:17:14.707 23:09:40 -- nvmf/common.sh@469 -- # nvmfpid=217663 00:17:14.707 23:09:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:14.707 23:09:40 -- nvmf/common.sh@470 -- # waitforlisten 217663 00:17:14.707 23:09:40 -- common/autotest_common.sh@829 -- # '[' -z 217663 ']' 00:17:14.707 23:09:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:14.707 23:09:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:14.707 23:09:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:14.707 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:14.707 23:09:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:14.707 23:09:40 -- common/autotest_common.sh@10 -- # set +x 00:17:14.707 [2024-11-26 23:09:40.769982] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:14.707 [2024-11-26 23:09:40.770080] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:14.707 [2024-11-26 23:09:40.843218] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:14.707 [2024-11-26 23:09:40.951032] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:14.707 [2024-11-26 23:09:40.951187] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:14.707 [2024-11-26 23:09:40.951203] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:14.707 [2024-11-26 23:09:40.951215] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:14.707 [2024-11-26 23:09:40.951306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:14.707 [2024-11-26 23:09:40.951433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:14.707 [2024-11-26 23:09:40.951499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:14.707 [2024-11-26 23:09:40.951501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:15.639 23:09:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:15.639 23:09:41 -- common/autotest_common.sh@862 -- # return 0 00:17:15.639 23:09:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:15.639 23:09:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:15.639 23:09:41 -- common/autotest_common.sh@10 -- # set +x 00:17:15.639 23:09:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:15.639 23:09:41 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:15.639 23:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.639 23:09:41 -- common/autotest_common.sh@10 -- # set +x 00:17:15.639 [2024-11-26 23:09:41.821093] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:15.639 23:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.639 23:09:41 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:15.639 23:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.639 23:09:41 -- common/autotest_common.sh@10 -- # set +x 00:17:15.639 Malloc0 00:17:15.639 23:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.639 23:09:41 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:15.639 23:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.639 23:09:41 -- common/autotest_common.sh@10 -- # set +x 00:17:15.639 23:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.639 23:09:41 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:15.639 23:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.639 23:09:41 -- common/autotest_common.sh@10 -- # set +x 00:17:15.639 23:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.639 23:09:41 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:15.639 23:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.639 23:09:41 -- common/autotest_common.sh@10 -- # set +x 00:17:15.639 [2024-11-26 23:09:41.861366] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:15.639 23:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.639 23:09:41 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:15.639 23:09:41 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:15.639 23:09:41 -- nvmf/common.sh@520 -- # config=() 00:17:15.639 23:09:41 -- nvmf/common.sh@520 -- # local subsystem config 00:17:15.639 23:09:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:15.639 23:09:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:15.639 { 00:17:15.639 "params": { 00:17:15.639 "name": "Nvme$subsystem", 00:17:15.639 "trtype": "$TEST_TRANSPORT", 00:17:15.639 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:15.639 "adrfam": "ipv4", 00:17:15.639 "trsvcid": "$NVMF_PORT", 00:17:15.639 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:15.639 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:15.639 "hdgst": ${hdgst:-false}, 00:17:15.639 "ddgst": ${ddgst:-false} 00:17:15.639 }, 00:17:15.639 "method": "bdev_nvme_attach_controller" 00:17:15.639 } 00:17:15.639 EOF 00:17:15.639 )") 00:17:15.639 23:09:41 -- nvmf/common.sh@542 -- # cat 00:17:15.639 23:09:41 -- nvmf/common.sh@544 -- # jq . 00:17:15.639 23:09:41 -- nvmf/common.sh@545 -- # IFS=, 00:17:15.639 23:09:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:15.639 "params": { 00:17:15.639 "name": "Nvme1", 00:17:15.639 "trtype": "tcp", 00:17:15.639 "traddr": "10.0.0.2", 00:17:15.639 "adrfam": "ipv4", 00:17:15.639 "trsvcid": "4420", 00:17:15.639 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:15.639 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:15.639 "hdgst": false, 00:17:15.639 "ddgst": false 00:17:15.639 }, 00:17:15.639 "method": "bdev_nvme_attach_controller" 00:17:15.639 }' 00:17:15.639 [2024-11-26 23:09:41.904426] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:15.639 [2024-11-26 23:09:41.904500] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid217820 ] 00:17:15.639 [2024-11-26 23:09:41.968480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:15.896 [2024-11-26 23:09:42.079189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:15.896 [2024-11-26 23:09:42.079237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:15.896 [2024-11-26 23:09:42.079240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:16.154 [2024-11-26 23:09:42.395782] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:16.154 [2024-11-26 23:09:42.395835] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:16.154 I/O targets: 00:17:16.154 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:16.154 00:17:16.154 00:17:16.154 CUnit - A unit testing framework for C - Version 2.1-3 00:17:16.154 http://cunit.sourceforge.net/ 00:17:16.154 00:17:16.154 00:17:16.154 Suite: bdevio tests on: Nvme1n1 00:17:16.154 Test: blockdev write read block ...passed 00:17:16.154 Test: blockdev write zeroes read block ...passed 00:17:16.154 Test: blockdev write zeroes read no split ...passed 00:17:16.154 Test: blockdev write zeroes read split ...passed 00:17:16.154 Test: blockdev write zeroes read split partial ...passed 00:17:16.154 Test: blockdev reset ...[2024-11-26 23:09:42.514482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:16.154 [2024-11-26 23:09:42.514604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7a07d0 (9): Bad file descriptor 00:17:16.411 [2024-11-26 23:09:42.624541] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:16.411 passed 00:17:16.411 Test: blockdev write read 8 blocks ...passed 00:17:16.411 Test: blockdev write read size > 128k ...passed 00:17:16.411 Test: blockdev write read invalid size ...passed 00:17:16.411 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:16.411 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:16.411 Test: blockdev write read max offset ...passed 00:17:16.411 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:16.411 Test: blockdev writev readv 8 blocks ...passed 00:17:16.669 Test: blockdev writev readv 30 x 1block ...passed 00:17:16.669 Test: blockdev writev readv block ...passed 00:17:16.669 Test: blockdev writev readv size > 128k ...passed 00:17:16.669 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:16.669 Test: blockdev comparev and writev ...[2024-11-26 23:09:42.881863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.669 [2024-11-26 23:09:42.881900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:16.669 [2024-11-26 23:09:42.881931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.669 [2024-11-26 23:09:42.881950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:16.669 [2024-11-26 23:09:42.882306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.669 [2024-11-26 23:09:42.882330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:16.669 [2024-11-26 23:09:42.882352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.669 [2024-11-26 23:09:42.882368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:16.669 [2024-11-26 23:09:42.882696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.669 [2024-11-26 23:09:42.882722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:16.669 [2024-11-26 23:09:42.882743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.669 [2024-11-26 23:09:42.882759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:16.670 [2024-11-26 23:09:42.883103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.670 [2024-11-26 23:09:42.883129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:16.670 [2024-11-26 23:09:42.883149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.670 [2024-11-26 23:09:42.883165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:16.670 passed 00:17:16.670 Test: blockdev nvme passthru rw ...passed 00:17:16.670 Test: blockdev nvme passthru vendor specific ...[2024-11-26 23:09:42.966790] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.670 [2024-11-26 23:09:42.966819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:16.670 [2024-11-26 23:09:42.966972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.670 [2024-11-26 23:09:42.966995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:16.670 [2024-11-26 23:09:42.967138] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.670 [2024-11-26 23:09:42.967160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:16.670 [2024-11-26 23:09:42.967304] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.670 [2024-11-26 23:09:42.967326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:16.670 passed 00:17:16.670 Test: blockdev nvme admin passthru ...passed 00:17:16.670 Test: blockdev copy ...passed 00:17:16.670 00:17:16.670 Run Summary: Type Total Ran Passed Failed Inactive 00:17:16.670 suites 1 1 n/a 0 0 00:17:16.670 tests 23 23 23 0 0 00:17:16.670 asserts 152 152 152 0 n/a 00:17:16.670 00:17:16.670 Elapsed time = 1.262 seconds 00:17:17.235 23:09:43 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:17.235 23:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.235 23:09:43 -- common/autotest_common.sh@10 -- # set +x 00:17:17.235 23:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.235 23:09:43 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:17.235 23:09:43 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:17.235 23:09:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:17.235 23:09:43 -- nvmf/common.sh@116 -- # sync 00:17:17.236 23:09:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:17.236 23:09:43 -- nvmf/common.sh@119 -- # set +e 00:17:17.236 23:09:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:17.236 23:09:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:17.236 rmmod nvme_tcp 00:17:17.236 rmmod nvme_fabrics 00:17:17.236 rmmod nvme_keyring 00:17:17.236 23:09:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:17.236 23:09:43 -- nvmf/common.sh@123 -- # set -e 00:17:17.236 23:09:43 -- nvmf/common.sh@124 -- # return 0 00:17:17.236 23:09:43 -- nvmf/common.sh@477 -- # '[' -n 217663 ']' 00:17:17.236 23:09:43 -- nvmf/common.sh@478 -- # killprocess 217663 00:17:17.236 23:09:43 -- common/autotest_common.sh@936 -- # '[' -z 217663 ']' 00:17:17.236 23:09:43 -- common/autotest_common.sh@940 -- # kill -0 217663 00:17:17.236 23:09:43 -- common/autotest_common.sh@941 -- # uname 00:17:17.236 23:09:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:17.236 23:09:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 217663 00:17:17.236 23:09:43 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:17.236 23:09:43 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:17.236 23:09:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 217663' 00:17:17.236 killing process with pid 217663 00:17:17.236 23:09:43 -- common/autotest_common.sh@955 -- # kill 217663 00:17:17.236 23:09:43 -- common/autotest_common.sh@960 -- # wait 217663 00:17:17.803 23:09:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:17.803 23:09:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:17.803 23:09:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:17.803 23:09:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:17.803 23:09:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:17.803 23:09:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:17.803 23:09:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:17.803 23:09:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.708 23:09:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:19.708 00:17:19.708 real 0m7.700s 00:17:19.708 user 0m15.098s 00:17:19.708 sys 0m2.677s 00:17:19.708 23:09:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:19.708 23:09:45 -- common/autotest_common.sh@10 -- # set +x 00:17:19.708 ************************************ 00:17:19.708 END TEST nvmf_bdevio_no_huge 00:17:19.708 ************************************ 00:17:19.708 23:09:45 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:19.708 23:09:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:19.708 23:09:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:19.708 23:09:45 -- common/autotest_common.sh@10 -- # set +x 00:17:19.708 ************************************ 00:17:19.708 START TEST nvmf_tls 00:17:19.708 ************************************ 00:17:19.708 23:09:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:19.708 * Looking for test storage... 00:17:19.708 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:19.708 23:09:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:19.708 23:09:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:19.708 23:09:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:19.966 23:09:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:19.966 23:09:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:19.966 23:09:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:19.966 23:09:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:19.966 23:09:46 -- scripts/common.sh@335 -- # IFS=.-: 00:17:19.966 23:09:46 -- scripts/common.sh@335 -- # read -ra ver1 00:17:19.966 23:09:46 -- scripts/common.sh@336 -- # IFS=.-: 00:17:19.966 23:09:46 -- scripts/common.sh@336 -- # read -ra ver2 00:17:19.966 23:09:46 -- scripts/common.sh@337 -- # local 'op=<' 00:17:19.966 23:09:46 -- scripts/common.sh@339 -- # ver1_l=2 00:17:19.966 23:09:46 -- scripts/common.sh@340 -- # ver2_l=1 00:17:19.966 23:09:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:19.966 23:09:46 -- scripts/common.sh@343 -- # case "$op" in 00:17:19.966 23:09:46 -- scripts/common.sh@344 -- # : 1 00:17:19.966 23:09:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:19.966 23:09:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:19.966 23:09:46 -- scripts/common.sh@364 -- # decimal 1 00:17:19.966 23:09:46 -- scripts/common.sh@352 -- # local d=1 00:17:19.966 23:09:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:19.966 23:09:46 -- scripts/common.sh@354 -- # echo 1 00:17:19.966 23:09:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:19.966 23:09:46 -- scripts/common.sh@365 -- # decimal 2 00:17:19.966 23:09:46 -- scripts/common.sh@352 -- # local d=2 00:17:19.966 23:09:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:19.966 23:09:46 -- scripts/common.sh@354 -- # echo 2 00:17:19.967 23:09:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:19.967 23:09:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:19.967 23:09:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:19.967 23:09:46 -- scripts/common.sh@367 -- # return 0 00:17:19.967 23:09:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:19.967 23:09:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:19.967 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.967 --rc genhtml_branch_coverage=1 00:17:19.967 --rc genhtml_function_coverage=1 00:17:19.967 --rc genhtml_legend=1 00:17:19.967 --rc geninfo_all_blocks=1 00:17:19.967 --rc geninfo_unexecuted_blocks=1 00:17:19.967 00:17:19.967 ' 00:17:19.967 23:09:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:19.967 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.967 --rc genhtml_branch_coverage=1 00:17:19.967 --rc genhtml_function_coverage=1 00:17:19.967 --rc genhtml_legend=1 00:17:19.967 --rc geninfo_all_blocks=1 00:17:19.967 --rc geninfo_unexecuted_blocks=1 00:17:19.967 00:17:19.967 ' 00:17:19.967 23:09:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:19.967 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.967 --rc genhtml_branch_coverage=1 00:17:19.967 --rc genhtml_function_coverage=1 00:17:19.967 --rc genhtml_legend=1 00:17:19.967 --rc geninfo_all_blocks=1 00:17:19.967 --rc geninfo_unexecuted_blocks=1 00:17:19.967 00:17:19.967 ' 00:17:19.967 23:09:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:19.967 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.967 --rc genhtml_branch_coverage=1 00:17:19.967 --rc genhtml_function_coverage=1 00:17:19.967 --rc genhtml_legend=1 00:17:19.967 --rc geninfo_all_blocks=1 00:17:19.967 --rc geninfo_unexecuted_blocks=1 00:17:19.967 00:17:19.967 ' 00:17:19.967 23:09:46 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:19.967 23:09:46 -- nvmf/common.sh@7 -- # uname -s 00:17:19.967 23:09:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:19.967 23:09:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:19.967 23:09:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:19.967 23:09:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:19.967 23:09:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:19.967 23:09:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:19.967 23:09:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:19.967 23:09:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:19.967 23:09:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:19.967 23:09:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:19.967 23:09:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:19.967 23:09:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:19.967 23:09:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:19.967 23:09:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:19.967 23:09:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:19.967 23:09:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:19.967 23:09:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:19.967 23:09:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:19.967 23:09:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:19.967 23:09:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.967 23:09:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.967 23:09:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.967 23:09:46 -- paths/export.sh@5 -- # export PATH 00:17:19.967 23:09:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.967 23:09:46 -- nvmf/common.sh@46 -- # : 0 00:17:19.967 23:09:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:19.967 23:09:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:19.967 23:09:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:19.967 23:09:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:19.967 23:09:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:19.967 23:09:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:19.967 23:09:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:19.967 23:09:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:19.967 23:09:46 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:19.967 23:09:46 -- target/tls.sh@71 -- # nvmftestinit 00:17:19.967 23:09:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:19.967 23:09:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:19.967 23:09:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:19.967 23:09:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:19.967 23:09:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:19.967 23:09:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:19.967 23:09:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:19.967 23:09:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.967 23:09:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:19.967 23:09:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:19.967 23:09:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:19.967 23:09:46 -- common/autotest_common.sh@10 -- # set +x 00:17:21.867 23:09:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:21.867 23:09:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:21.867 23:09:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:21.867 23:09:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:21.867 23:09:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:21.867 23:09:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:21.867 23:09:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:21.867 23:09:48 -- nvmf/common.sh@294 -- # net_devs=() 00:17:21.867 23:09:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:21.867 23:09:48 -- nvmf/common.sh@295 -- # e810=() 00:17:21.867 23:09:48 -- nvmf/common.sh@295 -- # local -ga e810 00:17:21.867 23:09:48 -- nvmf/common.sh@296 -- # x722=() 00:17:21.867 23:09:48 -- nvmf/common.sh@296 -- # local -ga x722 00:17:21.867 23:09:48 -- nvmf/common.sh@297 -- # mlx=() 00:17:21.867 23:09:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:21.867 23:09:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:21.867 23:09:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:21.867 23:09:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:21.867 23:09:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:21.867 23:09:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:21.867 23:09:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:21.867 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:21.867 23:09:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:21.867 23:09:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:21.867 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:21.867 23:09:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:21.867 23:09:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:21.867 23:09:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:21.867 23:09:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:21.867 23:09:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:21.867 23:09:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:21.867 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:21.867 23:09:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:21.867 23:09:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:21.867 23:09:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:21.867 23:09:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:21.867 23:09:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:21.867 23:09:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:21.867 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:21.867 23:09:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:21.867 23:09:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:21.867 23:09:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:21.867 23:09:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:21.867 23:09:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:21.867 23:09:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:21.867 23:09:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:21.867 23:09:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:21.867 23:09:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:21.867 23:09:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:21.867 23:09:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:21.867 23:09:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:21.867 23:09:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:21.867 23:09:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:21.867 23:09:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:21.867 23:09:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:21.867 23:09:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:21.867 23:09:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:22.126 23:09:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:22.126 23:09:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:22.126 23:09:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:22.126 23:09:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:22.126 23:09:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:22.126 23:09:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:22.126 23:09:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:22.126 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:22.126 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:17:22.126 00:17:22.126 --- 10.0.0.2 ping statistics --- 00:17:22.126 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.126 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:17:22.126 23:09:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:22.126 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:22.126 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:17:22.126 00:17:22.126 --- 10.0.0.1 ping statistics --- 00:17:22.126 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.126 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:17:22.126 23:09:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:22.126 23:09:48 -- nvmf/common.sh@410 -- # return 0 00:17:22.126 23:09:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:22.126 23:09:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:22.126 23:09:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:22.126 23:09:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:22.126 23:09:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:22.126 23:09:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:22.126 23:09:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:22.126 23:09:48 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:22.126 23:09:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:22.126 23:09:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:22.126 23:09:48 -- common/autotest_common.sh@10 -- # set +x 00:17:22.126 23:09:48 -- nvmf/common.sh@469 -- # nvmfpid=220041 00:17:22.126 23:09:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:22.126 23:09:48 -- nvmf/common.sh@470 -- # waitforlisten 220041 00:17:22.126 23:09:48 -- common/autotest_common.sh@829 -- # '[' -z 220041 ']' 00:17:22.126 23:09:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:22.126 23:09:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:22.126 23:09:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:22.126 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:22.126 23:09:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:22.126 23:09:48 -- common/autotest_common.sh@10 -- # set +x 00:17:22.126 [2024-11-26 23:09:48.391545] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:22.126 [2024-11-26 23:09:48.391614] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:22.126 EAL: No free 2048 kB hugepages reported on node 1 00:17:22.126 [2024-11-26 23:09:48.457509] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:22.385 [2024-11-26 23:09:48.568972] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:22.385 [2024-11-26 23:09:48.569121] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:22.385 [2024-11-26 23:09:48.569138] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:22.385 [2024-11-26 23:09:48.569151] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:22.385 [2024-11-26 23:09:48.569190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:22.385 23:09:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.385 23:09:48 -- common/autotest_common.sh@862 -- # return 0 00:17:22.385 23:09:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:22.385 23:09:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:22.385 23:09:48 -- common/autotest_common.sh@10 -- # set +x 00:17:22.385 23:09:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:22.385 23:09:48 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:22.385 23:09:48 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:22.643 true 00:17:22.643 23:09:48 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:22.643 23:09:48 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:22.900 23:09:49 -- target/tls.sh@82 -- # version=0 00:17:22.900 23:09:49 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:22.900 23:09:49 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:23.160 23:09:49 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.160 23:09:49 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:23.418 23:09:49 -- target/tls.sh@90 -- # version=13 00:17:23.418 23:09:49 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:23.418 23:09:49 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:23.676 23:09:49 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.676 23:09:49 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:23.934 23:09:50 -- target/tls.sh@98 -- # version=7 00:17:23.934 23:09:50 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:23.934 23:09:50 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.934 23:09:50 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:24.192 23:09:50 -- target/tls.sh@105 -- # ktls=false 00:17:24.192 23:09:50 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:24.192 23:09:50 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:24.450 23:09:50 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.450 23:09:50 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:24.707 23:09:51 -- target/tls.sh@113 -- # ktls=true 00:17:24.707 23:09:51 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:24.707 23:09:51 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:24.965 23:09:51 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.965 23:09:51 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:25.223 23:09:51 -- target/tls.sh@121 -- # ktls=false 00:17:25.223 23:09:51 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:25.223 23:09:51 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:25.223 23:09:51 -- target/tls.sh@49 -- # local key hash crc 00:17:25.223 23:09:51 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:25.224 23:09:51 -- target/tls.sh@51 -- # hash=01 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # gzip -1 -c 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # tail -c8 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # head -c 4 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # crc='p$H�' 00:17:25.224 23:09:51 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:25.224 23:09:51 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:25.224 23:09:51 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.224 23:09:51 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.224 23:09:51 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:25.224 23:09:51 -- target/tls.sh@49 -- # local key hash crc 00:17:25.224 23:09:51 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:25.224 23:09:51 -- target/tls.sh@51 -- # hash=01 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # gzip -1 -c 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # tail -c8 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # head -c 4 00:17:25.224 23:09:51 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:25.224 23:09:51 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:25.224 23:09:51 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:25.482 23:09:51 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.482 23:09:51 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.482 23:09:51 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.482 23:09:51 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:25.482 23:09:51 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.482 23:09:51 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.482 23:09:51 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.482 23:09:51 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:25.482 23:09:51 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:25.482 23:09:51 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:26.048 23:09:52 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.048 23:09:52 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.048 23:09:52 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:26.306 [2024-11-26 23:09:52.541679] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:26.306 23:09:52 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:26.564 23:09:52 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:26.822 [2024-11-26 23:09:53.051033] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:26.822 [2024-11-26 23:09:53.051305] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:26.822 23:09:53 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:27.081 malloc0 00:17:27.081 23:09:53 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:27.339 23:09:53 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.597 23:09:53 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.597 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.585 Initializing NVMe Controllers 00:17:37.586 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:37.586 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:37.586 Initialization complete. Launching workers. 00:17:37.586 ======================================================== 00:17:37.586 Latency(us) 00:17:37.586 Device Information : IOPS MiB/s Average min max 00:17:37.586 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7694.83 30.06 8319.93 1136.80 9422.20 00:17:37.586 ======================================================== 00:17:37.586 Total : 7694.83 30.06 8319.93 1136.80 9422.20 00:17:37.586 00:17:37.586 23:10:03 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.586 23:10:03 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:37.586 23:10:03 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:37.586 23:10:03 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:37.586 23:10:03 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:37.586 23:10:03 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:37.586 23:10:03 -- target/tls.sh@28 -- # bdevperf_pid=222002 00:17:37.586 23:10:03 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:37.586 23:10:03 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:37.586 23:10:03 -- target/tls.sh@31 -- # waitforlisten 222002 /var/tmp/bdevperf.sock 00:17:37.586 23:10:03 -- common/autotest_common.sh@829 -- # '[' -z 222002 ']' 00:17:37.586 23:10:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.586 23:10:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.586 23:10:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.586 23:10:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.586 23:10:03 -- common/autotest_common.sh@10 -- # set +x 00:17:37.844 [2024-11-26 23:10:03.981777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.844 [2024-11-26 23:10:03.981862] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid222002 ] 00:17:37.844 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.844 [2024-11-26 23:10:04.038954] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.844 [2024-11-26 23:10:04.142558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.102 23:10:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.102 23:10:04 -- common/autotest_common.sh@862 -- # return 0 00:17:38.102 23:10:04 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.102 [2024-11-26 23:10:04.482646] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:38.360 TLSTESTn1 00:17:38.360 23:10:04 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:38.360 Running I/O for 10 seconds... 00:17:50.566 00:17:50.566 Latency(us) 00:17:50.566 [2024-11-26T22:10:16.960Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:50.566 [2024-11-26T22:10:16.960Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:50.566 Verification LBA range: start 0x0 length 0x2000 00:17:50.566 TLSTESTn1 : 10.02 4081.93 15.95 0.00 0.00 31312.14 4951.61 47768.46 00:17:50.566 [2024-11-26T22:10:16.960Z] =================================================================================================================== 00:17:50.566 [2024-11-26T22:10:16.960Z] Total : 4081.93 15.95 0.00 0.00 31312.14 4951.61 47768.46 00:17:50.566 0 00:17:50.566 23:10:14 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:50.566 23:10:14 -- target/tls.sh@45 -- # killprocess 222002 00:17:50.566 23:10:14 -- common/autotest_common.sh@936 -- # '[' -z 222002 ']' 00:17:50.566 23:10:14 -- common/autotest_common.sh@940 -- # kill -0 222002 00:17:50.566 23:10:14 -- common/autotest_common.sh@941 -- # uname 00:17:50.566 23:10:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:50.566 23:10:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 222002 00:17:50.566 23:10:14 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:50.566 23:10:14 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:50.566 23:10:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 222002' 00:17:50.566 killing process with pid 222002 00:17:50.566 23:10:14 -- common/autotest_common.sh@955 -- # kill 222002 00:17:50.566 Received shutdown signal, test time was about 10.000000 seconds 00:17:50.566 00:17:50.566 Latency(us) 00:17:50.566 [2024-11-26T22:10:16.960Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:50.566 [2024-11-26T22:10:16.960Z] =================================================================================================================== 00:17:50.566 [2024-11-26T22:10:16.960Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:50.566 23:10:14 -- common/autotest_common.sh@960 -- # wait 222002 00:17:50.566 23:10:15 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:50.566 23:10:15 -- common/autotest_common.sh@650 -- # local es=0 00:17:50.566 23:10:15 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:50.566 23:10:15 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:50.566 23:10:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.566 23:10:15 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:50.566 23:10:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.566 23:10:15 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:50.566 23:10:15 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:50.566 23:10:15 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:50.566 23:10:15 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:50.566 23:10:15 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:50.566 23:10:15 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:50.566 23:10:15 -- target/tls.sh@28 -- # bdevperf_pid=223242 00:17:50.566 23:10:15 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:50.566 23:10:15 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:50.566 23:10:15 -- target/tls.sh@31 -- # waitforlisten 223242 /var/tmp/bdevperf.sock 00:17:50.566 23:10:15 -- common/autotest_common.sh@829 -- # '[' -z 223242 ']' 00:17:50.566 23:10:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:50.566 23:10:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:50.566 23:10:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:50.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:50.566 23:10:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:50.566 23:10:15 -- common/autotest_common.sh@10 -- # set +x 00:17:50.566 [2024-11-26 23:10:15.089916] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:50.566 [2024-11-26 23:10:15.090008] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid223242 ] 00:17:50.566 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.566 [2024-11-26 23:10:15.149161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.567 [2024-11-26 23:10:15.253849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:50.567 23:10:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:50.567 23:10:16 -- common/autotest_common.sh@862 -- # return 0 00:17:50.567 23:10:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:50.567 [2024-11-26 23:10:16.302235] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:50.567 [2024-11-26 23:10:16.312308] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:50.567 [2024-11-26 23:10:16.313052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc781f0 (107): Transport endpoint is not connected 00:17:50.567 [2024-11-26 23:10:16.314021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc781f0 (9): Bad file descriptor 00:17:50.567 [2024-11-26 23:10:16.315021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:50.567 [2024-11-26 23:10:16.315042] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:50.567 [2024-11-26 23:10:16.315056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:50.567 request: 00:17:50.567 { 00:17:50.567 "name": "TLSTEST", 00:17:50.567 "trtype": "tcp", 00:17:50.567 "traddr": "10.0.0.2", 00:17:50.567 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:50.567 "adrfam": "ipv4", 00:17:50.567 "trsvcid": "4420", 00:17:50.567 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:50.567 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:50.567 "method": "bdev_nvme_attach_controller", 00:17:50.567 "req_id": 1 00:17:50.567 } 00:17:50.567 Got JSON-RPC error response 00:17:50.567 response: 00:17:50.567 { 00:17:50.567 "code": -32602, 00:17:50.567 "message": "Invalid parameters" 00:17:50.567 } 00:17:50.567 23:10:16 -- target/tls.sh@36 -- # killprocess 223242 00:17:50.567 23:10:16 -- common/autotest_common.sh@936 -- # '[' -z 223242 ']' 00:17:50.567 23:10:16 -- common/autotest_common.sh@940 -- # kill -0 223242 00:17:50.567 23:10:16 -- common/autotest_common.sh@941 -- # uname 00:17:50.567 23:10:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:50.567 23:10:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 223242 00:17:50.567 23:10:16 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:50.567 23:10:16 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:50.567 23:10:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 223242' 00:17:50.567 killing process with pid 223242 00:17:50.567 23:10:16 -- common/autotest_common.sh@955 -- # kill 223242 00:17:50.567 Received shutdown signal, test time was about 10.000000 seconds 00:17:50.567 00:17:50.567 Latency(us) 00:17:50.567 [2024-11-26T22:10:16.961Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:50.567 [2024-11-26T22:10:16.961Z] =================================================================================================================== 00:17:50.567 [2024-11-26T22:10:16.961Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:50.567 23:10:16 -- common/autotest_common.sh@960 -- # wait 223242 00:17:50.567 23:10:16 -- target/tls.sh@37 -- # return 1 00:17:50.567 23:10:16 -- common/autotest_common.sh@653 -- # es=1 00:17:50.567 23:10:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:50.567 23:10:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:50.567 23:10:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:50.567 23:10:16 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:50.567 23:10:16 -- common/autotest_common.sh@650 -- # local es=0 00:17:50.567 23:10:16 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:50.567 23:10:16 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:50.567 23:10:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.567 23:10:16 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:50.567 23:10:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.567 23:10:16 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:50.567 23:10:16 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:50.567 23:10:16 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:50.567 23:10:16 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:50.567 23:10:16 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:50.567 23:10:16 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:50.567 23:10:16 -- target/tls.sh@28 -- # bdevperf_pid=223510 00:17:50.567 23:10:16 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:50.567 23:10:16 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:50.567 23:10:16 -- target/tls.sh@31 -- # waitforlisten 223510 /var/tmp/bdevperf.sock 00:17:50.567 23:10:16 -- common/autotest_common.sh@829 -- # '[' -z 223510 ']' 00:17:50.567 23:10:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:50.567 23:10:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:50.567 23:10:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:50.567 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:50.567 23:10:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:50.567 23:10:16 -- common/autotest_common.sh@10 -- # set +x 00:17:50.567 [2024-11-26 23:10:16.677155] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:50.567 [2024-11-26 23:10:16.677233] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid223510 ] 00:17:50.567 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.567 [2024-11-26 23:10:16.733642] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.567 [2024-11-26 23:10:16.835469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:51.500 23:10:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:51.500 23:10:17 -- common/autotest_common.sh@862 -- # return 0 00:17:51.500 23:10:17 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.500 [2024-11-26 23:10:17.853912] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:51.500 [2024-11-26 23:10:17.859063] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:51.500 [2024-11-26 23:10:17.859096] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:51.500 [2024-11-26 23:10:17.859157] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:51.500 [2024-11-26 23:10:17.859657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x25411f0 (107): Transport endpoint is not connected 00:17:51.500 [2024-11-26 23:10:17.860646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x25411f0 (9): Bad file descriptor 00:17:51.500 [2024-11-26 23:10:17.861645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:51.500 [2024-11-26 23:10:17.861675] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:51.500 [2024-11-26 23:10:17.861690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:51.500 request: 00:17:51.500 { 00:17:51.500 "name": "TLSTEST", 00:17:51.500 "trtype": "tcp", 00:17:51.500 "traddr": "10.0.0.2", 00:17:51.500 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:51.501 "adrfam": "ipv4", 00:17:51.501 "trsvcid": "4420", 00:17:51.501 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:51.501 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:51.501 "method": "bdev_nvme_attach_controller", 00:17:51.501 "req_id": 1 00:17:51.501 } 00:17:51.501 Got JSON-RPC error response 00:17:51.501 response: 00:17:51.501 { 00:17:51.501 "code": -32602, 00:17:51.501 "message": "Invalid parameters" 00:17:51.501 } 00:17:51.501 23:10:17 -- target/tls.sh@36 -- # killprocess 223510 00:17:51.501 23:10:17 -- common/autotest_common.sh@936 -- # '[' -z 223510 ']' 00:17:51.501 23:10:17 -- common/autotest_common.sh@940 -- # kill -0 223510 00:17:51.501 23:10:17 -- common/autotest_common.sh@941 -- # uname 00:17:51.501 23:10:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:51.501 23:10:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 223510 00:17:51.760 23:10:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:51.760 23:10:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:51.760 23:10:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 223510' 00:17:51.760 killing process with pid 223510 00:17:51.760 23:10:17 -- common/autotest_common.sh@955 -- # kill 223510 00:17:51.760 Received shutdown signal, test time was about 10.000000 seconds 00:17:51.760 00:17:51.760 Latency(us) 00:17:51.760 [2024-11-26T22:10:18.154Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:51.760 [2024-11-26T22:10:18.154Z] =================================================================================================================== 00:17:51.760 [2024-11-26T22:10:18.154Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:51.760 23:10:17 -- common/autotest_common.sh@960 -- # wait 223510 00:17:52.018 23:10:18 -- target/tls.sh@37 -- # return 1 00:17:52.018 23:10:18 -- common/autotest_common.sh@653 -- # es=1 00:17:52.018 23:10:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:52.018 23:10:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:52.018 23:10:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:52.018 23:10:18 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.018 23:10:18 -- common/autotest_common.sh@650 -- # local es=0 00:17:52.018 23:10:18 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.018 23:10:18 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:52.018 23:10:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:52.018 23:10:18 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:52.018 23:10:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:52.018 23:10:18 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.018 23:10:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:52.018 23:10:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:52.018 23:10:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:52.018 23:10:18 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:52.018 23:10:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:52.018 23:10:18 -- target/tls.sh@28 -- # bdevperf_pid=223666 00:17:52.018 23:10:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:52.018 23:10:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:52.018 23:10:18 -- target/tls.sh@31 -- # waitforlisten 223666 /var/tmp/bdevperf.sock 00:17:52.018 23:10:18 -- common/autotest_common.sh@829 -- # '[' -z 223666 ']' 00:17:52.018 23:10:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:52.018 23:10:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:52.018 23:10:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:52.018 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:52.018 23:10:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:52.018 23:10:18 -- common/autotest_common.sh@10 -- # set +x 00:17:52.018 [2024-11-26 23:10:18.214994] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:52.018 [2024-11-26 23:10:18.215085] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid223666 ] 00:17:52.018 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.018 [2024-11-26 23:10:18.273498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.018 [2024-11-26 23:10:18.374340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:52.951 23:10:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:52.951 23:10:19 -- common/autotest_common.sh@862 -- # return 0 00:17:52.951 23:10:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:53.210 [2024-11-26 23:10:19.390743] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:53.210 [2024-11-26 23:10:19.400143] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:53.210 [2024-11-26 23:10:19.400176] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:53.210 [2024-11-26 23:10:19.400228] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:53.210 [2024-11-26 23:10:19.400482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x243c1f0 (107): Transport endpoint is not connected 00:17:53.210 [2024-11-26 23:10:19.401471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x243c1f0 (9): Bad file descriptor 00:17:53.210 [2024-11-26 23:10:19.402471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:53.210 [2024-11-26 23:10:19.402490] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:53.210 [2024-11-26 23:10:19.402504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:53.210 request: 00:17:53.210 { 00:17:53.210 "name": "TLSTEST", 00:17:53.210 "trtype": "tcp", 00:17:53.210 "traddr": "10.0.0.2", 00:17:53.210 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:53.210 "adrfam": "ipv4", 00:17:53.210 "trsvcid": "4420", 00:17:53.210 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:53.210 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:53.210 "method": "bdev_nvme_attach_controller", 00:17:53.210 "req_id": 1 00:17:53.210 } 00:17:53.210 Got JSON-RPC error response 00:17:53.210 response: 00:17:53.210 { 00:17:53.210 "code": -32602, 00:17:53.210 "message": "Invalid parameters" 00:17:53.210 } 00:17:53.210 23:10:19 -- target/tls.sh@36 -- # killprocess 223666 00:17:53.210 23:10:19 -- common/autotest_common.sh@936 -- # '[' -z 223666 ']' 00:17:53.210 23:10:19 -- common/autotest_common.sh@940 -- # kill -0 223666 00:17:53.210 23:10:19 -- common/autotest_common.sh@941 -- # uname 00:17:53.210 23:10:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:53.210 23:10:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 223666 00:17:53.210 23:10:19 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:53.210 23:10:19 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:53.210 23:10:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 223666' 00:17:53.210 killing process with pid 223666 00:17:53.210 23:10:19 -- common/autotest_common.sh@955 -- # kill 223666 00:17:53.210 Received shutdown signal, test time was about 10.000000 seconds 00:17:53.210 00:17:53.210 Latency(us) 00:17:53.210 [2024-11-26T22:10:19.604Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.210 [2024-11-26T22:10:19.604Z] =================================================================================================================== 00:17:53.210 [2024-11-26T22:10:19.604Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:53.210 23:10:19 -- common/autotest_common.sh@960 -- # wait 223666 00:17:53.469 23:10:19 -- target/tls.sh@37 -- # return 1 00:17:53.469 23:10:19 -- common/autotest_common.sh@653 -- # es=1 00:17:53.469 23:10:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:53.469 23:10:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:53.469 23:10:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:53.469 23:10:19 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:53.469 23:10:19 -- common/autotest_common.sh@650 -- # local es=0 00:17:53.469 23:10:19 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:53.469 23:10:19 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:53.469 23:10:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.469 23:10:19 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:53.469 23:10:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.469 23:10:19 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:53.469 23:10:19 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:53.469 23:10:19 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:53.469 23:10:19 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:53.469 23:10:19 -- target/tls.sh@23 -- # psk= 00:17:53.469 23:10:19 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:53.469 23:10:19 -- target/tls.sh@28 -- # bdevperf_pid=223934 00:17:53.469 23:10:19 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:53.469 23:10:19 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:53.469 23:10:19 -- target/tls.sh@31 -- # waitforlisten 223934 /var/tmp/bdevperf.sock 00:17:53.470 23:10:19 -- common/autotest_common.sh@829 -- # '[' -z 223934 ']' 00:17:53.470 23:10:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:53.470 23:10:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:53.470 23:10:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:53.470 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:53.470 23:10:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:53.470 23:10:19 -- common/autotest_common.sh@10 -- # set +x 00:17:53.470 [2024-11-26 23:10:19.753871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:53.470 [2024-11-26 23:10:19.753963] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid223934 ] 00:17:53.470 EAL: No free 2048 kB hugepages reported on node 1 00:17:53.470 [2024-11-26 23:10:19.812351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:53.728 [2024-11-26 23:10:19.914716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:54.661 23:10:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:54.661 23:10:20 -- common/autotest_common.sh@862 -- # return 0 00:17:54.661 23:10:20 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:54.661 [2024-11-26 23:10:20.954313] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:54.662 [2024-11-26 23:10:20.955860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1702050 (9): Bad file descriptor 00:17:54.662 [2024-11-26 23:10:20.956869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:54.662 [2024-11-26 23:10:20.956890] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:54.662 [2024-11-26 23:10:20.956904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:54.662 request: 00:17:54.662 { 00:17:54.662 "name": "TLSTEST", 00:17:54.662 "trtype": "tcp", 00:17:54.662 "traddr": "10.0.0.2", 00:17:54.662 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:54.662 "adrfam": "ipv4", 00:17:54.662 "trsvcid": "4420", 00:17:54.662 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:54.662 "method": "bdev_nvme_attach_controller", 00:17:54.662 "req_id": 1 00:17:54.662 } 00:17:54.662 Got JSON-RPC error response 00:17:54.662 response: 00:17:54.662 { 00:17:54.662 "code": -32602, 00:17:54.662 "message": "Invalid parameters" 00:17:54.662 } 00:17:54.662 23:10:20 -- target/tls.sh@36 -- # killprocess 223934 00:17:54.662 23:10:20 -- common/autotest_common.sh@936 -- # '[' -z 223934 ']' 00:17:54.662 23:10:20 -- common/autotest_common.sh@940 -- # kill -0 223934 00:17:54.662 23:10:20 -- common/autotest_common.sh@941 -- # uname 00:17:54.662 23:10:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.662 23:10:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 223934 00:17:54.662 23:10:21 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:54.662 23:10:21 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:54.662 23:10:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 223934' 00:17:54.662 killing process with pid 223934 00:17:54.662 23:10:21 -- common/autotest_common.sh@955 -- # kill 223934 00:17:54.662 Received shutdown signal, test time was about 10.000000 seconds 00:17:54.662 00:17:54.662 Latency(us) 00:17:54.662 [2024-11-26T22:10:21.056Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.662 [2024-11-26T22:10:21.056Z] =================================================================================================================== 00:17:54.662 [2024-11-26T22:10:21.056Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:54.662 23:10:21 -- common/autotest_common.sh@960 -- # wait 223934 00:17:54.920 23:10:21 -- target/tls.sh@37 -- # return 1 00:17:54.920 23:10:21 -- common/autotest_common.sh@653 -- # es=1 00:17:54.920 23:10:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:54.920 23:10:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:54.920 23:10:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:54.920 23:10:21 -- target/tls.sh@167 -- # killprocess 220041 00:17:54.920 23:10:21 -- common/autotest_common.sh@936 -- # '[' -z 220041 ']' 00:17:54.920 23:10:21 -- common/autotest_common.sh@940 -- # kill -0 220041 00:17:54.920 23:10:21 -- common/autotest_common.sh@941 -- # uname 00:17:54.920 23:10:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.920 23:10:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 220041 00:17:55.178 23:10:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:55.178 23:10:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:55.178 23:10:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 220041' 00:17:55.178 killing process with pid 220041 00:17:55.178 23:10:21 -- common/autotest_common.sh@955 -- # kill 220041 00:17:55.178 23:10:21 -- common/autotest_common.sh@960 -- # wait 220041 00:17:55.436 23:10:21 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:55.436 23:10:21 -- target/tls.sh@49 -- # local key hash crc 00:17:55.436 23:10:21 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:55.436 23:10:21 -- target/tls.sh@51 -- # hash=02 00:17:55.436 23:10:21 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:55.436 23:10:21 -- target/tls.sh@52 -- # gzip -1 -c 00:17:55.436 23:10:21 -- target/tls.sh@52 -- # tail -c8 00:17:55.436 23:10:21 -- target/tls.sh@52 -- # head -c 4 00:17:55.436 23:10:21 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:55.436 23:10:21 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:55.436 23:10:21 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:55.436 23:10:21 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:55.436 23:10:21 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:55.436 23:10:21 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.436 23:10:21 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:55.436 23:10:21 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.436 23:10:21 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:55.436 23:10:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:55.436 23:10:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:55.436 23:10:21 -- common/autotest_common.sh@10 -- # set +x 00:17:55.436 23:10:21 -- nvmf/common.sh@469 -- # nvmfpid=224108 00:17:55.436 23:10:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:55.436 23:10:21 -- nvmf/common.sh@470 -- # waitforlisten 224108 00:17:55.436 23:10:21 -- common/autotest_common.sh@829 -- # '[' -z 224108 ']' 00:17:55.436 23:10:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:55.436 23:10:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:55.436 23:10:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:55.436 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:55.436 23:10:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:55.436 23:10:21 -- common/autotest_common.sh@10 -- # set +x 00:17:55.436 [2024-11-26 23:10:21.667907] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:55.436 [2024-11-26 23:10:21.667983] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:55.436 EAL: No free 2048 kB hugepages reported on node 1 00:17:55.436 [2024-11-26 23:10:21.731295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:55.695 [2024-11-26 23:10:21.841331] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:55.695 [2024-11-26 23:10:21.841451] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:55.695 [2024-11-26 23:10:21.841467] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:55.695 [2024-11-26 23:10:21.841477] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:55.695 [2024-11-26 23:10:21.841501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:56.630 23:10:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.630 23:10:22 -- common/autotest_common.sh@862 -- # return 0 00:17:56.630 23:10:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:56.630 23:10:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:56.630 23:10:22 -- common/autotest_common.sh@10 -- # set +x 00:17:56.630 23:10:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:56.630 23:10:22 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.630 23:10:22 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.630 23:10:22 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:56.630 [2024-11-26 23:10:22.985248] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:56.630 23:10:23 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:56.889 23:10:23 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:57.147 [2024-11-26 23:10:23.498640] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:57.147 [2024-11-26 23:10:23.498892] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:57.147 23:10:23 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:57.714 malloc0 00:17:57.714 23:10:23 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:57.714 23:10:24 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.280 23:10:24 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.280 23:10:24 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:58.280 23:10:24 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:58.280 23:10:24 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:58.280 23:10:24 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:58.280 23:10:24 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:58.280 23:10:24 -- target/tls.sh@28 -- # bdevperf_pid=224533 00:17:58.280 23:10:24 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:58.280 23:10:24 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:58.280 23:10:24 -- target/tls.sh@31 -- # waitforlisten 224533 /var/tmp/bdevperf.sock 00:17:58.280 23:10:24 -- common/autotest_common.sh@829 -- # '[' -z 224533 ']' 00:17:58.280 23:10:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:58.280 23:10:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:58.280 23:10:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:58.280 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:58.280 23:10:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:58.280 23:10:24 -- common/autotest_common.sh@10 -- # set +x 00:17:58.280 [2024-11-26 23:10:24.409708] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:58.280 [2024-11-26 23:10:24.409792] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid224533 ] 00:17:58.280 EAL: No free 2048 kB hugepages reported on node 1 00:17:58.280 [2024-11-26 23:10:24.466274] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:58.280 [2024-11-26 23:10:24.570027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:59.215 23:10:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:59.215 23:10:25 -- common/autotest_common.sh@862 -- # return 0 00:17:59.215 23:10:25 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.473 [2024-11-26 23:10:25.691598] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:59.473 TLSTESTn1 00:17:59.473 23:10:25 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:59.731 Running I/O for 10 seconds... 00:18:09.706 00:18:09.706 Latency(us) 00:18:09.706 [2024-11-26T22:10:36.100Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:09.706 [2024-11-26T22:10:36.100Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:09.706 Verification LBA range: start 0x0 length 0x2000 00:18:09.706 TLSTESTn1 : 10.02 4222.23 16.49 0.00 0.00 30283.68 4126.34 48545.19 00:18:09.706 [2024-11-26T22:10:36.100Z] =================================================================================================================== 00:18:09.706 [2024-11-26T22:10:36.100Z] Total : 4222.23 16.49 0.00 0.00 30283.68 4126.34 48545.19 00:18:09.706 0 00:18:09.706 23:10:35 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:09.706 23:10:35 -- target/tls.sh@45 -- # killprocess 224533 00:18:09.706 23:10:35 -- common/autotest_common.sh@936 -- # '[' -z 224533 ']' 00:18:09.706 23:10:35 -- common/autotest_common.sh@940 -- # kill -0 224533 00:18:09.706 23:10:35 -- common/autotest_common.sh@941 -- # uname 00:18:09.706 23:10:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:09.706 23:10:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224533 00:18:09.706 23:10:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:09.706 23:10:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:09.706 23:10:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224533' 00:18:09.706 killing process with pid 224533 00:18:09.706 23:10:35 -- common/autotest_common.sh@955 -- # kill 224533 00:18:09.706 Received shutdown signal, test time was about 10.000000 seconds 00:18:09.706 00:18:09.706 Latency(us) 00:18:09.706 [2024-11-26T22:10:36.100Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:09.706 [2024-11-26T22:10:36.100Z] =================================================================================================================== 00:18:09.706 [2024-11-26T22:10:36.100Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:09.706 23:10:35 -- common/autotest_common.sh@960 -- # wait 224533 00:18:09.964 23:10:36 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.964 23:10:36 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.964 23:10:36 -- common/autotest_common.sh@650 -- # local es=0 00:18:09.964 23:10:36 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.964 23:10:36 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:09.964 23:10:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.964 23:10:36 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:09.964 23:10:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.964 23:10:36 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.964 23:10:36 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:09.964 23:10:36 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:09.964 23:10:36 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:09.964 23:10:36 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:09.964 23:10:36 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:09.964 23:10:36 -- target/tls.sh@28 -- # bdevperf_pid=225903 00:18:09.964 23:10:36 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:09.964 23:10:36 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:09.964 23:10:36 -- target/tls.sh@31 -- # waitforlisten 225903 /var/tmp/bdevperf.sock 00:18:09.964 23:10:36 -- common/autotest_common.sh@829 -- # '[' -z 225903 ']' 00:18:09.964 23:10:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:09.964 23:10:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:09.964 23:10:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:09.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:09.964 23:10:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:09.964 23:10:36 -- common/autotest_common.sh@10 -- # set +x 00:18:09.964 [2024-11-26 23:10:36.273218] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:09.964 [2024-11-26 23:10:36.273317] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid225903 ] 00:18:09.964 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.964 [2024-11-26 23:10:36.332936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:10.223 [2024-11-26 23:10:36.440759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:11.157 23:10:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:11.157 23:10:37 -- common/autotest_common.sh@862 -- # return 0 00:18:11.157 23:10:37 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.415 [2024-11-26 23:10:37.558054] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:11.415 [2024-11-26 23:10:37.558110] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:11.415 request: 00:18:11.415 { 00:18:11.415 "name": "TLSTEST", 00:18:11.415 "trtype": "tcp", 00:18:11.415 "traddr": "10.0.0.2", 00:18:11.415 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:11.415 "adrfam": "ipv4", 00:18:11.415 "trsvcid": "4420", 00:18:11.415 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:11.415 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:11.415 "method": "bdev_nvme_attach_controller", 00:18:11.415 "req_id": 1 00:18:11.415 } 00:18:11.415 Got JSON-RPC error response 00:18:11.415 response: 00:18:11.415 { 00:18:11.415 "code": -22, 00:18:11.415 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:11.415 } 00:18:11.415 23:10:37 -- target/tls.sh@36 -- # killprocess 225903 00:18:11.415 23:10:37 -- common/autotest_common.sh@936 -- # '[' -z 225903 ']' 00:18:11.415 23:10:37 -- common/autotest_common.sh@940 -- # kill -0 225903 00:18:11.415 23:10:37 -- common/autotest_common.sh@941 -- # uname 00:18:11.415 23:10:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:11.415 23:10:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 225903 00:18:11.415 23:10:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:11.415 23:10:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:11.415 23:10:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 225903' 00:18:11.415 killing process with pid 225903 00:18:11.415 23:10:37 -- common/autotest_common.sh@955 -- # kill 225903 00:18:11.415 Received shutdown signal, test time was about 10.000000 seconds 00:18:11.415 00:18:11.416 Latency(us) 00:18:11.416 [2024-11-26T22:10:37.810Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:11.416 [2024-11-26T22:10:37.810Z] =================================================================================================================== 00:18:11.416 [2024-11-26T22:10:37.810Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:11.416 23:10:37 -- common/autotest_common.sh@960 -- # wait 225903 00:18:11.674 23:10:37 -- target/tls.sh@37 -- # return 1 00:18:11.674 23:10:37 -- common/autotest_common.sh@653 -- # es=1 00:18:11.674 23:10:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:11.674 23:10:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:11.674 23:10:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:11.674 23:10:37 -- target/tls.sh@183 -- # killprocess 224108 00:18:11.674 23:10:37 -- common/autotest_common.sh@936 -- # '[' -z 224108 ']' 00:18:11.674 23:10:37 -- common/autotest_common.sh@940 -- # kill -0 224108 00:18:11.674 23:10:37 -- common/autotest_common.sh@941 -- # uname 00:18:11.674 23:10:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:11.674 23:10:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224108 00:18:11.674 23:10:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:11.674 23:10:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:11.674 23:10:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224108' 00:18:11.674 killing process with pid 224108 00:18:11.674 23:10:37 -- common/autotest_common.sh@955 -- # kill 224108 00:18:11.674 23:10:37 -- common/autotest_common.sh@960 -- # wait 224108 00:18:11.933 23:10:38 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:11.933 23:10:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:11.933 23:10:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:11.933 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:11.933 23:10:38 -- nvmf/common.sh@469 -- # nvmfpid=226188 00:18:11.933 23:10:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:11.933 23:10:38 -- nvmf/common.sh@470 -- # waitforlisten 226188 00:18:11.933 23:10:38 -- common/autotest_common.sh@829 -- # '[' -z 226188 ']' 00:18:11.933 23:10:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:11.933 23:10:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:11.933 23:10:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:11.933 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:11.933 23:10:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:11.933 23:10:38 -- common/autotest_common.sh@10 -- # set +x 00:18:11.933 [2024-11-26 23:10:38.253037] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:11.933 [2024-11-26 23:10:38.253138] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:11.933 EAL: No free 2048 kB hugepages reported on node 1 00:18:11.933 [2024-11-26 23:10:38.320712] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:12.191 [2024-11-26 23:10:38.432085] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:12.191 [2024-11-26 23:10:38.432258] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:12.191 [2024-11-26 23:10:38.432279] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:12.191 [2024-11-26 23:10:38.432294] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:12.191 [2024-11-26 23:10:38.432326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:13.126 23:10:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:13.126 23:10:39 -- common/autotest_common.sh@862 -- # return 0 00:18:13.126 23:10:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:13.126 23:10:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:13.126 23:10:39 -- common/autotest_common.sh@10 -- # set +x 00:18:13.126 23:10:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:13.126 23:10:39 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.126 23:10:39 -- common/autotest_common.sh@650 -- # local es=0 00:18:13.126 23:10:39 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.126 23:10:39 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:13.126 23:10:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:13.126 23:10:39 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:13.126 23:10:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:13.126 23:10:39 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.126 23:10:39 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.126 23:10:39 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:13.126 [2024-11-26 23:10:39.491348] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:13.126 23:10:39 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:13.384 23:10:39 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:13.642 [2024-11-26 23:10:39.972663] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:13.642 [2024-11-26 23:10:39.972927] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:13.642 23:10:39 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:13.900 malloc0 00:18:13.900 23:10:40 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:14.158 23:10:40 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.417 [2024-11-26 23:10:40.719320] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:14.417 [2024-11-26 23:10:40.719359] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:14.417 [2024-11-26 23:10:40.719388] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:14.417 request: 00:18:14.417 { 00:18:14.417 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.417 "host": "nqn.2016-06.io.spdk:host1", 00:18:14.417 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:14.417 "method": "nvmf_subsystem_add_host", 00:18:14.417 "req_id": 1 00:18:14.417 } 00:18:14.417 Got JSON-RPC error response 00:18:14.417 response: 00:18:14.417 { 00:18:14.417 "code": -32603, 00:18:14.417 "message": "Internal error" 00:18:14.417 } 00:18:14.417 23:10:40 -- common/autotest_common.sh@653 -- # es=1 00:18:14.417 23:10:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:14.417 23:10:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:14.417 23:10:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:14.417 23:10:40 -- target/tls.sh@189 -- # killprocess 226188 00:18:14.417 23:10:40 -- common/autotest_common.sh@936 -- # '[' -z 226188 ']' 00:18:14.417 23:10:40 -- common/autotest_common.sh@940 -- # kill -0 226188 00:18:14.417 23:10:40 -- common/autotest_common.sh@941 -- # uname 00:18:14.417 23:10:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:14.417 23:10:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 226188 00:18:14.417 23:10:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:14.417 23:10:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:14.417 23:10:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 226188' 00:18:14.417 killing process with pid 226188 00:18:14.417 23:10:40 -- common/autotest_common.sh@955 -- # kill 226188 00:18:14.417 23:10:40 -- common/autotest_common.sh@960 -- # wait 226188 00:18:14.675 23:10:41 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.675 23:10:41 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:14.675 23:10:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:14.675 23:10:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:14.933 23:10:41 -- common/autotest_common.sh@10 -- # set +x 00:18:14.933 23:10:41 -- nvmf/common.sh@469 -- # nvmfpid=226518 00:18:14.933 23:10:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:14.933 23:10:41 -- nvmf/common.sh@470 -- # waitforlisten 226518 00:18:14.933 23:10:41 -- common/autotest_common.sh@829 -- # '[' -z 226518 ']' 00:18:14.933 23:10:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:14.933 23:10:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:14.933 23:10:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:14.933 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:14.933 23:10:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:14.933 23:10:41 -- common/autotest_common.sh@10 -- # set +x 00:18:14.933 [2024-11-26 23:10:41.113948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:14.933 [2024-11-26 23:10:41.114041] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:14.933 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.933 [2024-11-26 23:10:41.181998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.933 [2024-11-26 23:10:41.292020] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:14.933 [2024-11-26 23:10:41.292185] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:14.933 [2024-11-26 23:10:41.292202] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:14.933 [2024-11-26 23:10:41.292214] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:14.934 [2024-11-26 23:10:41.292240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:15.867 23:10:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:15.867 23:10:42 -- common/autotest_common.sh@862 -- # return 0 00:18:15.867 23:10:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:15.867 23:10:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:15.867 23:10:42 -- common/autotest_common.sh@10 -- # set +x 00:18:15.867 23:10:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:15.867 23:10:42 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.867 23:10:42 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.867 23:10:42 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:16.124 [2024-11-26 23:10:42.412548] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:16.124 23:10:42 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:16.383 23:10:42 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:16.641 [2024-11-26 23:10:43.006135] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:16.641 [2024-11-26 23:10:43.006399] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:16.641 23:10:43 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:17.206 malloc0 00:18:17.206 23:10:43 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:17.464 23:10:43 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.722 23:10:43 -- target/tls.sh@197 -- # bdevperf_pid=226923 00:18:17.722 23:10:43 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:17.722 23:10:43 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:17.722 23:10:43 -- target/tls.sh@200 -- # waitforlisten 226923 /var/tmp/bdevperf.sock 00:18:17.722 23:10:43 -- common/autotest_common.sh@829 -- # '[' -z 226923 ']' 00:18:17.722 23:10:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:17.722 23:10:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:17.722 23:10:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:17.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:17.722 23:10:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:17.722 23:10:43 -- common/autotest_common.sh@10 -- # set +x 00:18:17.722 [2024-11-26 23:10:43.957655] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:17.722 [2024-11-26 23:10:43.957738] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid226923 ] 00:18:17.722 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.722 [2024-11-26 23:10:44.015655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.984 [2024-11-26 23:10:44.123840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:18.918 23:10:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:18.918 23:10:44 -- common/autotest_common.sh@862 -- # return 0 00:18:18.918 23:10:44 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:18.918 [2024-11-26 23:10:45.270962] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:19.176 TLSTESTn1 00:18:19.176 23:10:45 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:19.434 23:10:45 -- target/tls.sh@205 -- # tgtconf='{ 00:18:19.434 "subsystems": [ 00:18:19.434 { 00:18:19.434 "subsystem": "iobuf", 00:18:19.434 "config": [ 00:18:19.434 { 00:18:19.434 "method": "iobuf_set_options", 00:18:19.434 "params": { 00:18:19.434 "small_pool_count": 8192, 00:18:19.434 "large_pool_count": 1024, 00:18:19.434 "small_bufsize": 8192, 00:18:19.434 "large_bufsize": 135168 00:18:19.434 } 00:18:19.434 } 00:18:19.434 ] 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "subsystem": "sock", 00:18:19.434 "config": [ 00:18:19.434 { 00:18:19.434 "method": "sock_impl_set_options", 00:18:19.434 "params": { 00:18:19.434 "impl_name": "posix", 00:18:19.434 "recv_buf_size": 2097152, 00:18:19.434 "send_buf_size": 2097152, 00:18:19.434 "enable_recv_pipe": true, 00:18:19.434 "enable_quickack": false, 00:18:19.434 "enable_placement_id": 0, 00:18:19.434 "enable_zerocopy_send_server": true, 00:18:19.434 "enable_zerocopy_send_client": false, 00:18:19.434 "zerocopy_threshold": 0, 00:18:19.434 "tls_version": 0, 00:18:19.434 "enable_ktls": false 00:18:19.434 } 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "method": "sock_impl_set_options", 00:18:19.434 "params": { 00:18:19.434 "impl_name": "ssl", 00:18:19.434 "recv_buf_size": 4096, 00:18:19.434 "send_buf_size": 4096, 00:18:19.434 "enable_recv_pipe": true, 00:18:19.434 "enable_quickack": false, 00:18:19.434 "enable_placement_id": 0, 00:18:19.434 "enable_zerocopy_send_server": true, 00:18:19.434 "enable_zerocopy_send_client": false, 00:18:19.434 "zerocopy_threshold": 0, 00:18:19.434 "tls_version": 0, 00:18:19.434 "enable_ktls": false 00:18:19.434 } 00:18:19.434 } 00:18:19.434 ] 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "subsystem": "vmd", 00:18:19.434 "config": [] 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "subsystem": "accel", 00:18:19.434 "config": [ 00:18:19.434 { 00:18:19.434 "method": "accel_set_options", 00:18:19.434 "params": { 00:18:19.434 "small_cache_size": 128, 00:18:19.434 "large_cache_size": 16, 00:18:19.434 "task_count": 2048, 00:18:19.434 "sequence_count": 2048, 00:18:19.434 "buf_count": 2048 00:18:19.434 } 00:18:19.434 } 00:18:19.434 ] 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "subsystem": "bdev", 00:18:19.434 "config": [ 00:18:19.434 { 00:18:19.434 "method": "bdev_set_options", 00:18:19.434 "params": { 00:18:19.434 "bdev_io_pool_size": 65535, 00:18:19.434 "bdev_io_cache_size": 256, 00:18:19.434 "bdev_auto_examine": true, 00:18:19.434 "iobuf_small_cache_size": 128, 00:18:19.434 "iobuf_large_cache_size": 16 00:18:19.434 } 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "method": "bdev_raid_set_options", 00:18:19.434 "params": { 00:18:19.434 "process_window_size_kb": 1024 00:18:19.434 } 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "method": "bdev_iscsi_set_options", 00:18:19.434 "params": { 00:18:19.434 "timeout_sec": 30 00:18:19.434 } 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "method": "bdev_nvme_set_options", 00:18:19.434 "params": { 00:18:19.434 "action_on_timeout": "none", 00:18:19.434 "timeout_us": 0, 00:18:19.434 "timeout_admin_us": 0, 00:18:19.434 "keep_alive_timeout_ms": 10000, 00:18:19.434 "transport_retry_count": 4, 00:18:19.434 "arbitration_burst": 0, 00:18:19.434 "low_priority_weight": 0, 00:18:19.434 "medium_priority_weight": 0, 00:18:19.434 "high_priority_weight": 0, 00:18:19.434 "nvme_adminq_poll_period_us": 10000, 00:18:19.434 "nvme_ioq_poll_period_us": 0, 00:18:19.434 "io_queue_requests": 0, 00:18:19.434 "delay_cmd_submit": true, 00:18:19.434 "bdev_retry_count": 3, 00:18:19.434 "transport_ack_timeout": 0, 00:18:19.434 "ctrlr_loss_timeout_sec": 0, 00:18:19.434 "reconnect_delay_sec": 0, 00:18:19.434 "fast_io_fail_timeout_sec": 0, 00:18:19.434 "generate_uuids": false, 00:18:19.434 "transport_tos": 0, 00:18:19.434 "io_path_stat": false, 00:18:19.434 "allow_accel_sequence": false 00:18:19.434 } 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "method": "bdev_nvme_set_hotplug", 00:18:19.434 "params": { 00:18:19.434 "period_us": 100000, 00:18:19.434 "enable": false 00:18:19.434 } 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "method": "bdev_malloc_create", 00:18:19.434 "params": { 00:18:19.434 "name": "malloc0", 00:18:19.434 "num_blocks": 8192, 00:18:19.434 "block_size": 4096, 00:18:19.434 "physical_block_size": 4096, 00:18:19.434 "uuid": "51b66e6a-40f8-4248-bc4e-e6f86bda883a", 00:18:19.434 "optimal_io_boundary": 0 00:18:19.434 } 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "method": "bdev_wait_for_examine" 00:18:19.434 } 00:18:19.434 ] 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "subsystem": "nbd", 00:18:19.434 "config": [] 00:18:19.434 }, 00:18:19.434 { 00:18:19.434 "subsystem": "scheduler", 00:18:19.434 "config": [ 00:18:19.434 { 00:18:19.434 "method": "framework_set_scheduler", 00:18:19.435 "params": { 00:18:19.435 "name": "static" 00:18:19.435 } 00:18:19.435 } 00:18:19.435 ] 00:18:19.435 }, 00:18:19.435 { 00:18:19.435 "subsystem": "nvmf", 00:18:19.435 "config": [ 00:18:19.435 { 00:18:19.435 "method": "nvmf_set_config", 00:18:19.435 "params": { 00:18:19.435 "discovery_filter": "match_any", 00:18:19.435 "admin_cmd_passthru": { 00:18:19.435 "identify_ctrlr": false 00:18:19.435 } 00:18:19.435 } 00:18:19.435 }, 00:18:19.435 { 00:18:19.435 "method": "nvmf_set_max_subsystems", 00:18:19.435 "params": { 00:18:19.435 "max_subsystems": 1024 00:18:19.435 } 00:18:19.435 }, 00:18:19.435 { 00:18:19.435 "method": "nvmf_set_crdt", 00:18:19.435 "params": { 00:18:19.435 "crdt1": 0, 00:18:19.435 "crdt2": 0, 00:18:19.435 "crdt3": 0 00:18:19.435 } 00:18:19.435 }, 00:18:19.435 { 00:18:19.435 "method": "nvmf_create_transport", 00:18:19.435 "params": { 00:18:19.435 "trtype": "TCP", 00:18:19.435 "max_queue_depth": 128, 00:18:19.435 "max_io_qpairs_per_ctrlr": 127, 00:18:19.435 "in_capsule_data_size": 4096, 00:18:19.435 "max_io_size": 131072, 00:18:19.435 "io_unit_size": 131072, 00:18:19.435 "max_aq_depth": 128, 00:18:19.435 "num_shared_buffers": 511, 00:18:19.435 "buf_cache_size": 4294967295, 00:18:19.435 "dif_insert_or_strip": false, 00:18:19.435 "zcopy": false, 00:18:19.435 "c2h_success": false, 00:18:19.435 "sock_priority": 0, 00:18:19.435 "abort_timeout_sec": 1 00:18:19.435 } 00:18:19.435 }, 00:18:19.435 { 00:18:19.435 "method": "nvmf_create_subsystem", 00:18:19.435 "params": { 00:18:19.435 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.435 "allow_any_host": false, 00:18:19.435 "serial_number": "SPDK00000000000001", 00:18:19.435 "model_number": "SPDK bdev Controller", 00:18:19.435 "max_namespaces": 10, 00:18:19.435 "min_cntlid": 1, 00:18:19.435 "max_cntlid": 65519, 00:18:19.435 "ana_reporting": false 00:18:19.435 } 00:18:19.435 }, 00:18:19.435 { 00:18:19.435 "method": "nvmf_subsystem_add_host", 00:18:19.435 "params": { 00:18:19.435 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.435 "host": "nqn.2016-06.io.spdk:host1", 00:18:19.435 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:19.435 } 00:18:19.435 }, 00:18:19.435 { 00:18:19.435 "method": "nvmf_subsystem_add_ns", 00:18:19.435 "params": { 00:18:19.435 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.435 "namespace": { 00:18:19.435 "nsid": 1, 00:18:19.435 "bdev_name": "malloc0", 00:18:19.435 "nguid": "51B66E6A40F84248BC4EE6F86BDA883A", 00:18:19.435 "uuid": "51b66e6a-40f8-4248-bc4e-e6f86bda883a" 00:18:19.435 } 00:18:19.435 } 00:18:19.435 }, 00:18:19.435 { 00:18:19.435 "method": "nvmf_subsystem_add_listener", 00:18:19.435 "params": { 00:18:19.435 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.435 "listen_address": { 00:18:19.435 "trtype": "TCP", 00:18:19.435 "adrfam": "IPv4", 00:18:19.435 "traddr": "10.0.0.2", 00:18:19.435 "trsvcid": "4420" 00:18:19.435 }, 00:18:19.435 "secure_channel": true 00:18:19.435 } 00:18:19.435 } 00:18:19.435 ] 00:18:19.435 } 00:18:19.435 ] 00:18:19.435 }' 00:18:19.435 23:10:45 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:19.693 23:10:45 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:19.693 "subsystems": [ 00:18:19.693 { 00:18:19.693 "subsystem": "iobuf", 00:18:19.693 "config": [ 00:18:19.693 { 00:18:19.693 "method": "iobuf_set_options", 00:18:19.693 "params": { 00:18:19.693 "small_pool_count": 8192, 00:18:19.693 "large_pool_count": 1024, 00:18:19.693 "small_bufsize": 8192, 00:18:19.693 "large_bufsize": 135168 00:18:19.693 } 00:18:19.693 } 00:18:19.693 ] 00:18:19.693 }, 00:18:19.693 { 00:18:19.693 "subsystem": "sock", 00:18:19.693 "config": [ 00:18:19.693 { 00:18:19.693 "method": "sock_impl_set_options", 00:18:19.693 "params": { 00:18:19.693 "impl_name": "posix", 00:18:19.693 "recv_buf_size": 2097152, 00:18:19.693 "send_buf_size": 2097152, 00:18:19.693 "enable_recv_pipe": true, 00:18:19.693 "enable_quickack": false, 00:18:19.693 "enable_placement_id": 0, 00:18:19.693 "enable_zerocopy_send_server": true, 00:18:19.693 "enable_zerocopy_send_client": false, 00:18:19.693 "zerocopy_threshold": 0, 00:18:19.693 "tls_version": 0, 00:18:19.693 "enable_ktls": false 00:18:19.693 } 00:18:19.693 }, 00:18:19.693 { 00:18:19.693 "method": "sock_impl_set_options", 00:18:19.693 "params": { 00:18:19.693 "impl_name": "ssl", 00:18:19.693 "recv_buf_size": 4096, 00:18:19.693 "send_buf_size": 4096, 00:18:19.693 "enable_recv_pipe": true, 00:18:19.693 "enable_quickack": false, 00:18:19.693 "enable_placement_id": 0, 00:18:19.693 "enable_zerocopy_send_server": true, 00:18:19.693 "enable_zerocopy_send_client": false, 00:18:19.693 "zerocopy_threshold": 0, 00:18:19.693 "tls_version": 0, 00:18:19.693 "enable_ktls": false 00:18:19.693 } 00:18:19.693 } 00:18:19.693 ] 00:18:19.693 }, 00:18:19.693 { 00:18:19.693 "subsystem": "vmd", 00:18:19.693 "config": [] 00:18:19.693 }, 00:18:19.693 { 00:18:19.693 "subsystem": "accel", 00:18:19.693 "config": [ 00:18:19.693 { 00:18:19.693 "method": "accel_set_options", 00:18:19.693 "params": { 00:18:19.693 "small_cache_size": 128, 00:18:19.693 "large_cache_size": 16, 00:18:19.693 "task_count": 2048, 00:18:19.693 "sequence_count": 2048, 00:18:19.693 "buf_count": 2048 00:18:19.693 } 00:18:19.694 } 00:18:19.694 ] 00:18:19.694 }, 00:18:19.694 { 00:18:19.694 "subsystem": "bdev", 00:18:19.694 "config": [ 00:18:19.694 { 00:18:19.694 "method": "bdev_set_options", 00:18:19.694 "params": { 00:18:19.694 "bdev_io_pool_size": 65535, 00:18:19.694 "bdev_io_cache_size": 256, 00:18:19.694 "bdev_auto_examine": true, 00:18:19.694 "iobuf_small_cache_size": 128, 00:18:19.694 "iobuf_large_cache_size": 16 00:18:19.694 } 00:18:19.694 }, 00:18:19.694 { 00:18:19.694 "method": "bdev_raid_set_options", 00:18:19.694 "params": { 00:18:19.694 "process_window_size_kb": 1024 00:18:19.694 } 00:18:19.694 }, 00:18:19.694 { 00:18:19.694 "method": "bdev_iscsi_set_options", 00:18:19.694 "params": { 00:18:19.694 "timeout_sec": 30 00:18:19.694 } 00:18:19.694 }, 00:18:19.694 { 00:18:19.694 "method": "bdev_nvme_set_options", 00:18:19.694 "params": { 00:18:19.694 "action_on_timeout": "none", 00:18:19.694 "timeout_us": 0, 00:18:19.694 "timeout_admin_us": 0, 00:18:19.694 "keep_alive_timeout_ms": 10000, 00:18:19.694 "transport_retry_count": 4, 00:18:19.694 "arbitration_burst": 0, 00:18:19.694 "low_priority_weight": 0, 00:18:19.694 "medium_priority_weight": 0, 00:18:19.694 "high_priority_weight": 0, 00:18:19.694 "nvme_adminq_poll_period_us": 10000, 00:18:19.694 "nvme_ioq_poll_period_us": 0, 00:18:19.694 "io_queue_requests": 512, 00:18:19.694 "delay_cmd_submit": true, 00:18:19.694 "bdev_retry_count": 3, 00:18:19.694 "transport_ack_timeout": 0, 00:18:19.694 "ctrlr_loss_timeout_sec": 0, 00:18:19.694 "reconnect_delay_sec": 0, 00:18:19.694 "fast_io_fail_timeout_sec": 0, 00:18:19.694 "generate_uuids": false, 00:18:19.694 "transport_tos": 0, 00:18:19.694 "io_path_stat": false, 00:18:19.694 "allow_accel_sequence": false 00:18:19.694 } 00:18:19.694 }, 00:18:19.694 { 00:18:19.694 "method": "bdev_nvme_attach_controller", 00:18:19.694 "params": { 00:18:19.694 "name": "TLSTEST", 00:18:19.694 "trtype": "TCP", 00:18:19.694 "adrfam": "IPv4", 00:18:19.694 "traddr": "10.0.0.2", 00:18:19.694 "trsvcid": "4420", 00:18:19.694 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.694 "prchk_reftag": false, 00:18:19.694 "prchk_guard": false, 00:18:19.694 "ctrlr_loss_timeout_sec": 0, 00:18:19.694 "reconnect_delay_sec": 0, 00:18:19.694 "fast_io_fail_timeout_sec": 0, 00:18:19.694 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:19.694 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:19.694 "hdgst": false, 00:18:19.694 "ddgst": false 00:18:19.694 } 00:18:19.694 }, 00:18:19.694 { 00:18:19.694 "method": "bdev_nvme_set_hotplug", 00:18:19.694 "params": { 00:18:19.694 "period_us": 100000, 00:18:19.694 "enable": false 00:18:19.694 } 00:18:19.694 }, 00:18:19.694 { 00:18:19.694 "method": "bdev_wait_for_examine" 00:18:19.694 } 00:18:19.694 ] 00:18:19.694 }, 00:18:19.694 { 00:18:19.694 "subsystem": "nbd", 00:18:19.694 "config": [] 00:18:19.694 } 00:18:19.694 ] 00:18:19.694 }' 00:18:19.694 23:10:45 -- target/tls.sh@208 -- # killprocess 226923 00:18:19.694 23:10:45 -- common/autotest_common.sh@936 -- # '[' -z 226923 ']' 00:18:19.694 23:10:45 -- common/autotest_common.sh@940 -- # kill -0 226923 00:18:19.694 23:10:45 -- common/autotest_common.sh@941 -- # uname 00:18:19.694 23:10:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.694 23:10:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 226923 00:18:19.694 23:10:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:19.694 23:10:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:19.694 23:10:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 226923' 00:18:19.694 killing process with pid 226923 00:18:19.694 23:10:46 -- common/autotest_common.sh@955 -- # kill 226923 00:18:19.694 Received shutdown signal, test time was about 10.000000 seconds 00:18:19.694 00:18:19.694 Latency(us) 00:18:19.694 [2024-11-26T22:10:46.088Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.694 [2024-11-26T22:10:46.088Z] =================================================================================================================== 00:18:19.694 [2024-11-26T22:10:46.088Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:19.694 23:10:46 -- common/autotest_common.sh@960 -- # wait 226923 00:18:19.952 23:10:46 -- target/tls.sh@209 -- # killprocess 226518 00:18:19.952 23:10:46 -- common/autotest_common.sh@936 -- # '[' -z 226518 ']' 00:18:19.952 23:10:46 -- common/autotest_common.sh@940 -- # kill -0 226518 00:18:19.952 23:10:46 -- common/autotest_common.sh@941 -- # uname 00:18:19.952 23:10:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.952 23:10:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 226518 00:18:19.952 23:10:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:19.952 23:10:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:19.952 23:10:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 226518' 00:18:19.952 killing process with pid 226518 00:18:19.952 23:10:46 -- common/autotest_common.sh@955 -- # kill 226518 00:18:19.952 23:10:46 -- common/autotest_common.sh@960 -- # wait 226518 00:18:20.518 23:10:46 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:20.518 23:10:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:20.518 23:10:46 -- target/tls.sh@212 -- # echo '{ 00:18:20.518 "subsystems": [ 00:18:20.518 { 00:18:20.518 "subsystem": "iobuf", 00:18:20.518 "config": [ 00:18:20.518 { 00:18:20.518 "method": "iobuf_set_options", 00:18:20.518 "params": { 00:18:20.518 "small_pool_count": 8192, 00:18:20.518 "large_pool_count": 1024, 00:18:20.518 "small_bufsize": 8192, 00:18:20.518 "large_bufsize": 135168 00:18:20.518 } 00:18:20.518 } 00:18:20.518 ] 00:18:20.518 }, 00:18:20.518 { 00:18:20.518 "subsystem": "sock", 00:18:20.518 "config": [ 00:18:20.518 { 00:18:20.518 "method": "sock_impl_set_options", 00:18:20.518 "params": { 00:18:20.518 "impl_name": "posix", 00:18:20.518 "recv_buf_size": 2097152, 00:18:20.518 "send_buf_size": 2097152, 00:18:20.518 "enable_recv_pipe": true, 00:18:20.518 "enable_quickack": false, 00:18:20.518 "enable_placement_id": 0, 00:18:20.518 "enable_zerocopy_send_server": true, 00:18:20.518 "enable_zerocopy_send_client": false, 00:18:20.518 "zerocopy_threshold": 0, 00:18:20.518 "tls_version": 0, 00:18:20.518 "enable_ktls": false 00:18:20.518 } 00:18:20.518 }, 00:18:20.518 { 00:18:20.518 "method": "sock_impl_set_options", 00:18:20.518 "params": { 00:18:20.518 "impl_name": "ssl", 00:18:20.518 "recv_buf_size": 4096, 00:18:20.518 "send_buf_size": 4096, 00:18:20.518 "enable_recv_pipe": true, 00:18:20.518 "enable_quickack": false, 00:18:20.518 "enable_placement_id": 0, 00:18:20.518 "enable_zerocopy_send_server": true, 00:18:20.518 "enable_zerocopy_send_client": false, 00:18:20.518 "zerocopy_threshold": 0, 00:18:20.518 "tls_version": 0, 00:18:20.518 "enable_ktls": false 00:18:20.518 } 00:18:20.518 } 00:18:20.518 ] 00:18:20.518 }, 00:18:20.518 { 00:18:20.518 "subsystem": "vmd", 00:18:20.518 "config": [] 00:18:20.518 }, 00:18:20.518 { 00:18:20.518 "subsystem": "accel", 00:18:20.518 "config": [ 00:18:20.518 { 00:18:20.518 "method": "accel_set_options", 00:18:20.518 "params": { 00:18:20.518 "small_cache_size": 128, 00:18:20.518 "large_cache_size": 16, 00:18:20.518 "task_count": 2048, 00:18:20.518 "sequence_count": 2048, 00:18:20.518 "buf_count": 2048 00:18:20.518 } 00:18:20.518 } 00:18:20.518 ] 00:18:20.518 }, 00:18:20.518 { 00:18:20.518 "subsystem": "bdev", 00:18:20.518 "config": [ 00:18:20.519 { 00:18:20.519 "method": "bdev_set_options", 00:18:20.519 "params": { 00:18:20.519 "bdev_io_pool_size": 65535, 00:18:20.519 "bdev_io_cache_size": 256, 00:18:20.519 "bdev_auto_examine": true, 00:18:20.519 "iobuf_small_cache_size": 128, 00:18:20.519 "iobuf_large_cache_size": 16 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "bdev_raid_set_options", 00:18:20.519 "params": { 00:18:20.519 "process_window_size_kb": 1024 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "bdev_iscsi_set_options", 00:18:20.519 "params": { 00:18:20.519 "timeout_sec": 30 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "bdev_nvme_set_options", 00:18:20.519 "params": { 00:18:20.519 "action_on_timeout": "none", 00:18:20.519 "timeout_us": 0, 00:18:20.519 "timeout_admin_us": 0, 00:18:20.519 "keep_alive_timeout_ms": 10000, 00:18:20.519 "transport_retry_count": 4, 00:18:20.519 "arbitration_burst": 0, 00:18:20.519 "low_priority_weight": 0, 00:18:20.519 "medium_priority_weight": 0, 00:18:20.519 "high_priority_weight": 0, 00:18:20.519 "nvme_adminq_poll_period_us": 10000, 00:18:20.519 "nvme_ioq_poll_period_us": 0, 00:18:20.519 "io_queue_requests": 0, 00:18:20.519 "delay_cmd_submit": true, 00:18:20.519 "bdev_retry_count": 3, 00:18:20.519 "transport_ack_timeout": 0, 00:18:20.519 "ctrlr_loss_timeout_sec": 0, 00:18:20.519 "reconnect_delay_sec": 0, 00:18:20.519 "fast_io_fail_timeout_sec": 0, 00:18:20.519 "generate_uuids": false, 00:18:20.519 "transport_tos": 0, 00:18:20.519 "io_path_stat": false, 00:18:20.519 "allow_accel_sequence": false 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "bdev_nvme_set_hotplug", 00:18:20.519 "params": { 00:18:20.519 "period_us": 100000, 00:18:20.519 "enable": false 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "bdev_malloc_create", 00:18:20.519 "params": { 00:18:20.519 "name": "malloc0", 00:18:20.519 "num_blocks": 8192, 00:18:20.519 "block_size": 4096, 00:18:20.519 "physical_block_size": 4096, 00:18:20.519 "uuid": "51b66e6a-40f8-4248-bc4e-e6f86bda883a", 00:18:20.519 "optimal_io_boundary": 0 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "bdev_wait_for_examine" 00:18:20.519 } 00:18:20.519 ] 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "subsystem": "nbd", 00:18:20.519 "config": [] 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "subsystem": "sch 23:10:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:20.519 eduler", 00:18:20.519 "config": [ 00:18:20.519 { 00:18:20.519 "method": "framework_set_scheduler", 00:18:20.519 "params": { 00:18:20.519 "name": "static" 00:18:20.519 } 00:18:20.519 } 00:18:20.519 ] 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "subsystem": "nvmf", 00:18:20.519 "config": [ 00:18:20.519 { 00:18:20.519 "method": "nvmf_set_config", 00:18:20.519 "params": { 00:18:20.519 "discovery_filter": "match_any", 00:18:20.519 "admin_cmd_passthru": { 00:18:20.519 "identify_ctrlr": false 00:18:20.519 } 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "nvmf_set_max_subsystems", 00:18:20.519 "params": { 00:18:20.519 "max_subsystems": 1024 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "nvmf_set_crdt", 00:18:20.519 "params": { 00:18:20.519 "crdt1": 0, 00:18:20.519 "crdt2": 0, 00:18:20.519 "crdt3": 0 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "nvmf_create_transport", 00:18:20.519 "params": { 00:18:20.519 "trtype": "TCP", 00:18:20.519 "max_queue_depth": 128, 00:18:20.519 "max_io_qpairs_per_ctrlr": 127, 00:18:20.519 "in_capsule_data_size": 4096, 00:18:20.519 "max_io_size": 131072, 00:18:20.519 "io_unit_size": 131072, 00:18:20.519 "max_aq_depth": 128, 00:18:20.519 "num_shared_buffers": 511, 00:18:20.519 "buf_cache_size": 4294967295, 00:18:20.519 "dif_insert_or_strip": false, 00:18:20.519 "zcopy": false, 00:18:20.519 "c2h_success": false, 00:18:20.519 "sock_priority": 0, 00:18:20.519 "abort_timeout_sec": 1 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "nvmf_create_subsystem", 00:18:20.519 "params": { 00:18:20.519 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.519 "allow_any_host": false, 00:18:20.519 "serial_number": "SPDK00000000000001", 00:18:20.519 "model_number": "SPDK bdev Controller", 00:18:20.519 "max_namespaces": 10, 00:18:20.519 "min_cntlid": 1, 00:18:20.519 "max_cntlid": 65519, 00:18:20.519 "ana_reporting": false 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "nvmf_subsystem_add_host", 00:18:20.519 "params": { 00:18:20.519 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.519 "host": "nqn.2016-06.io.spdk:host1", 00:18:20.519 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "nvmf_subsystem_add_ns", 00:18:20.519 "params": { 00:18:20.519 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.519 "namespace": { 00:18:20.519 "nsid": 1, 00:18:20.519 "bdev_name": "malloc0", 00:18:20.519 "nguid": "51B66E6A40F84248BC4EE6F86BDA883A", 00:18:20.519 "uuid": "51b66e6a-40f8-4248-bc4e-e6f86bda883a" 00:18:20.519 } 00:18:20.519 } 00:18:20.519 }, 00:18:20.519 { 00:18:20.519 "method": "nvmf_subsystem_add_listener", 00:18:20.519 "params": { 00:18:20.519 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.519 "listen_address": { 00:18:20.519 "trtype": "TCP", 00:18:20.519 "adrfam": "IPv4", 00:18:20.519 "traddr": "10.0.0.2", 00:18:20.519 "trsvcid": "4420" 00:18:20.519 }, 00:18:20.519 "secure_channel": true 00:18:20.519 } 00:18:20.519 } 00:18:20.519 ] 00:18:20.519 } 00:18:20.519 ] 00:18:20.519 }' 00:18:20.519 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:20.519 23:10:46 -- nvmf/common.sh@469 -- # nvmfpid=227218 00:18:20.519 23:10:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:20.519 23:10:46 -- nvmf/common.sh@470 -- # waitforlisten 227218 00:18:20.519 23:10:46 -- common/autotest_common.sh@829 -- # '[' -z 227218 ']' 00:18:20.519 23:10:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:20.519 23:10:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:20.519 23:10:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:20.519 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:20.519 23:10:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:20.519 23:10:46 -- common/autotest_common.sh@10 -- # set +x 00:18:20.519 [2024-11-26 23:10:46.689706] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:20.519 [2024-11-26 23:10:46.689801] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:20.519 EAL: No free 2048 kB hugepages reported on node 1 00:18:20.519 [2024-11-26 23:10:46.759297] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:20.519 [2024-11-26 23:10:46.876371] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:20.519 [2024-11-26 23:10:46.876542] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:20.519 [2024-11-26 23:10:46.876560] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:20.519 [2024-11-26 23:10:46.876573] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:20.519 [2024-11-26 23:10:46.876599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:20.778 [2024-11-26 23:10:47.105039] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:20.778 [2024-11-26 23:10:47.137046] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:20.778 [2024-11-26 23:10:47.137281] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:21.343 23:10:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:21.343 23:10:47 -- common/autotest_common.sh@862 -- # return 0 00:18:21.343 23:10:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:21.343 23:10:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:21.343 23:10:47 -- common/autotest_common.sh@10 -- # set +x 00:18:21.343 23:10:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:21.602 23:10:47 -- target/tls.sh@216 -- # bdevperf_pid=227374 00:18:21.602 23:10:47 -- target/tls.sh@217 -- # waitforlisten 227374 /var/tmp/bdevperf.sock 00:18:21.602 23:10:47 -- common/autotest_common.sh@829 -- # '[' -z 227374 ']' 00:18:21.602 23:10:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:21.602 23:10:47 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:21.602 23:10:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:21.602 23:10:47 -- target/tls.sh@213 -- # echo '{ 00:18:21.602 "subsystems": [ 00:18:21.602 { 00:18:21.602 "subsystem": "iobuf", 00:18:21.602 "config": [ 00:18:21.602 { 00:18:21.602 "method": "iobuf_set_options", 00:18:21.602 "params": { 00:18:21.602 "small_pool_count": 8192, 00:18:21.602 "large_pool_count": 1024, 00:18:21.602 "small_bufsize": 8192, 00:18:21.602 "large_bufsize": 135168 00:18:21.602 } 00:18:21.602 } 00:18:21.602 ] 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "subsystem": "sock", 00:18:21.602 "config": [ 00:18:21.602 { 00:18:21.602 "method": "sock_impl_set_options", 00:18:21.602 "params": { 00:18:21.602 "impl_name": "posix", 00:18:21.602 "recv_buf_size": 2097152, 00:18:21.602 "send_buf_size": 2097152, 00:18:21.602 "enable_recv_pipe": true, 00:18:21.602 "enable_quickack": false, 00:18:21.602 "enable_placement_id": 0, 00:18:21.602 "enable_zerocopy_send_server": true, 00:18:21.602 "enable_zerocopy_send_client": false, 00:18:21.602 "zerocopy_threshold": 0, 00:18:21.602 "tls_version": 0, 00:18:21.602 "enable_ktls": false 00:18:21.602 } 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "method": "sock_impl_set_options", 00:18:21.602 "params": { 00:18:21.602 "impl_name": "ssl", 00:18:21.602 "recv_buf_size": 4096, 00:18:21.602 "send_buf_size": 4096, 00:18:21.602 "enable_recv_pipe": true, 00:18:21.602 "enable_quickack": false, 00:18:21.602 "enable_placement_id": 0, 00:18:21.602 "enable_zerocopy_send_server": true, 00:18:21.602 "enable_zerocopy_send_client": false, 00:18:21.602 "zerocopy_threshold": 0, 00:18:21.602 "tls_version": 0, 00:18:21.602 "enable_ktls": false 00:18:21.602 } 00:18:21.602 } 00:18:21.602 ] 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "subsystem": "vmd", 00:18:21.602 "config": [] 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "subsystem": "accel", 00:18:21.602 "config": [ 00:18:21.602 { 00:18:21.602 "method": "accel_set_options", 00:18:21.602 "params": { 00:18:21.602 "small_cache_size": 128, 00:18:21.602 "large_cache_size": 16, 00:18:21.602 "task_count": 2048, 00:18:21.602 "sequence_count": 2048, 00:18:21.602 "buf_count": 2048 00:18:21.602 } 00:18:21.602 } 00:18:21.602 ] 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "subsystem": "bdev", 00:18:21.602 "config": [ 00:18:21.602 { 00:18:21.602 "method": "bdev_set_options", 00:18:21.602 "params": { 00:18:21.602 "bdev_io_pool_size": 65535, 00:18:21.602 "bdev_io_cache_size": 256, 00:18:21.602 "bdev_auto_examine": true, 00:18:21.602 "iobuf_small_cache_size": 128, 00:18:21.602 "iobuf_large_cache_size": 16 00:18:21.602 } 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "method": "bdev_raid_set_options", 00:18:21.602 "params": { 00:18:21.602 "process_window_size_kb": 1024 00:18:21.602 } 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "method": "bdev_iscsi_set_options", 00:18:21.602 "params": { 00:18:21.602 "timeout_sec": 30 00:18:21.602 } 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "method": "bdev_nvme_set_options", 00:18:21.602 "params": { 00:18:21.602 "action_on_timeout": "none", 00:18:21.602 "timeout_us": 0, 00:18:21.602 "timeout_admin_us": 0, 00:18:21.602 "keep_alive_timeout_ms": 10000, 00:18:21.602 "transport_retry_count": 4, 00:18:21.602 "arbitration_burst": 0, 00:18:21.602 "low_priority_weight": 0, 00:18:21.602 "medium_priority_weight": 0, 00:18:21.602 "high_priority_weight": 0, 00:18:21.602 "nvme_adminq_poll_period_us": 10000, 00:18:21.602 "nvme_ioq_poll_period_us": 0, 00:18:21.602 "io_queue_requests": 512, 00:18:21.602 "delay_cmd_submit": true, 00:18:21.602 "bdev_retry_count": 3, 00:18:21.602 "transport_ack_timeout": 0, 00:18:21.602 "ctrlr_loss_timeout_sec": 0, 00:18:21.602 "reconnect_delay_sec": 0, 00:18:21.602 "fast_io_fail_timeout_sec": 0, 00:18:21.602 "generate_uuids": false, 00:18:21.602 "transport_tos": 0, 00:18:21.602 "io_path_stat": false, 00:18:21.602 "allow_accel_sequence": false 00:18:21.602 } 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "method": "bdev_nvme_attach_controller", 00:18:21.602 "params": { 00:18:21.602 "name": "TLSTEST", 00:18:21.602 "trtype": "TCP", 00:18:21.602 "adrfam": "IPv4", 00:18:21.602 "traddr": "10.0.0.2", 00:18:21.602 "trsvcid": "4420", 00:18:21.602 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.602 "prchk_reftag": false, 00:18:21.602 "prchk_guard": false, 00:18:21.602 "ctrlr_loss_timeout_sec": 0, 00:18:21.602 "reconnect_delay_sec": 0, 00:18:21.602 "fast_io_fail_timeout_sec": 0, 00:18:21.602 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:21.602 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:21.602 "hdgst": false, 00:18:21.602 "ddgst": false 00:18:21.602 } 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "method": "bdev_nvme_set_hotplug", 00:18:21.602 "params": { 00:18:21.602 "period_us": 100000, 00:18:21.602 "enable": false 00:18:21.602 } 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "method": "bdev_wait_for_examine" 00:18:21.602 } 00:18:21.602 ] 00:18:21.602 }, 00:18:21.602 { 00:18:21.602 "subsystem": "nbd", 00:18:21.602 "config": [] 00:18:21.602 } 00:18:21.602 ] 00:18:21.602 }' 00:18:21.602 23:10:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:21.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:21.602 23:10:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:21.602 23:10:47 -- common/autotest_common.sh@10 -- # set +x 00:18:21.602 [2024-11-26 23:10:47.775007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:21.602 [2024-11-26 23:10:47.775096] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid227374 ] 00:18:21.602 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.602 [2024-11-26 23:10:47.838123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:21.602 [2024-11-26 23:10:47.959681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:21.861 [2024-11-26 23:10:48.128754] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:22.426 23:10:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:22.426 23:10:48 -- common/autotest_common.sh@862 -- # return 0 00:18:22.426 23:10:48 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:22.684 Running I/O for 10 seconds... 00:18:32.648 00:18:32.648 Latency(us) 00:18:32.648 [2024-11-26T22:10:59.042Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:32.648 [2024-11-26T22:10:59.042Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:32.648 Verification LBA range: start 0x0 length 0x2000 00:18:32.648 TLSTESTn1 : 10.01 3898.12 15.23 0.00 0.00 32793.90 4975.88 43690.67 00:18:32.648 [2024-11-26T22:10:59.042Z] =================================================================================================================== 00:18:32.648 [2024-11-26T22:10:59.042Z] Total : 3898.12 15.23 0.00 0.00 32793.90 4975.88 43690.67 00:18:32.648 0 00:18:32.648 23:10:58 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:32.648 23:10:58 -- target/tls.sh@223 -- # killprocess 227374 00:18:32.648 23:10:58 -- common/autotest_common.sh@936 -- # '[' -z 227374 ']' 00:18:32.648 23:10:58 -- common/autotest_common.sh@940 -- # kill -0 227374 00:18:32.648 23:10:58 -- common/autotest_common.sh@941 -- # uname 00:18:32.648 23:10:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:32.648 23:10:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 227374 00:18:32.648 23:10:58 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:32.648 23:10:58 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:32.648 23:10:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 227374' 00:18:32.648 killing process with pid 227374 00:18:32.648 23:10:58 -- common/autotest_common.sh@955 -- # kill 227374 00:18:32.648 Received shutdown signal, test time was about 10.000000 seconds 00:18:32.648 00:18:32.648 Latency(us) 00:18:32.648 [2024-11-26T22:10:59.042Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:32.648 [2024-11-26T22:10:59.042Z] =================================================================================================================== 00:18:32.648 [2024-11-26T22:10:59.042Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:32.648 23:10:58 -- common/autotest_common.sh@960 -- # wait 227374 00:18:32.913 23:10:59 -- target/tls.sh@224 -- # killprocess 227218 00:18:32.913 23:10:59 -- common/autotest_common.sh@936 -- # '[' -z 227218 ']' 00:18:32.913 23:10:59 -- common/autotest_common.sh@940 -- # kill -0 227218 00:18:32.913 23:10:59 -- common/autotest_common.sh@941 -- # uname 00:18:32.913 23:10:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:32.913 23:10:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 227218 00:18:32.913 23:10:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:32.913 23:10:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:32.913 23:10:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 227218' 00:18:32.913 killing process with pid 227218 00:18:32.913 23:10:59 -- common/autotest_common.sh@955 -- # kill 227218 00:18:32.913 23:10:59 -- common/autotest_common.sh@960 -- # wait 227218 00:18:33.176 23:10:59 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:33.176 23:10:59 -- target/tls.sh@227 -- # cleanup 00:18:33.176 23:10:59 -- target/tls.sh@15 -- # process_shm --id 0 00:18:33.176 23:10:59 -- common/autotest_common.sh@806 -- # type=--id 00:18:33.176 23:10:59 -- common/autotest_common.sh@807 -- # id=0 00:18:33.176 23:10:59 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:33.176 23:10:59 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:33.176 23:10:59 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:33.176 23:10:59 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:33.176 23:10:59 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:33.176 23:10:59 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:33.176 nvmf_trace.0 00:18:33.435 23:10:59 -- common/autotest_common.sh@821 -- # return 0 00:18:33.435 23:10:59 -- target/tls.sh@16 -- # killprocess 227374 00:18:33.435 23:10:59 -- common/autotest_common.sh@936 -- # '[' -z 227374 ']' 00:18:33.435 23:10:59 -- common/autotest_common.sh@940 -- # kill -0 227374 00:18:33.435 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (227374) - No such process 00:18:33.435 23:10:59 -- common/autotest_common.sh@963 -- # echo 'Process with pid 227374 is not found' 00:18:33.435 Process with pid 227374 is not found 00:18:33.435 23:10:59 -- target/tls.sh@17 -- # nvmftestfini 00:18:33.435 23:10:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:33.435 23:10:59 -- nvmf/common.sh@116 -- # sync 00:18:33.435 23:10:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:33.435 23:10:59 -- nvmf/common.sh@119 -- # set +e 00:18:33.435 23:10:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:33.435 23:10:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:33.435 rmmod nvme_tcp 00:18:33.435 rmmod nvme_fabrics 00:18:33.435 rmmod nvme_keyring 00:18:33.435 23:10:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:33.435 23:10:59 -- nvmf/common.sh@123 -- # set -e 00:18:33.435 23:10:59 -- nvmf/common.sh@124 -- # return 0 00:18:33.435 23:10:59 -- nvmf/common.sh@477 -- # '[' -n 227218 ']' 00:18:33.435 23:10:59 -- nvmf/common.sh@478 -- # killprocess 227218 00:18:33.435 23:10:59 -- common/autotest_common.sh@936 -- # '[' -z 227218 ']' 00:18:33.435 23:10:59 -- common/autotest_common.sh@940 -- # kill -0 227218 00:18:33.435 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (227218) - No such process 00:18:33.435 23:10:59 -- common/autotest_common.sh@963 -- # echo 'Process with pid 227218 is not found' 00:18:33.435 Process with pid 227218 is not found 00:18:33.435 23:10:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:33.435 23:10:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:33.435 23:10:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:33.435 23:10:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:33.435 23:10:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:33.435 23:10:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:33.435 23:10:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:33.435 23:10:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:35.340 23:11:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:35.340 23:11:01 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:35.340 00:18:35.340 real 1m15.702s 00:18:35.340 user 2m1.907s 00:18:35.340 sys 0m22.369s 00:18:35.340 23:11:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:35.340 23:11:01 -- common/autotest_common.sh@10 -- # set +x 00:18:35.340 ************************************ 00:18:35.340 END TEST nvmf_tls 00:18:35.340 ************************************ 00:18:35.340 23:11:01 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:35.340 23:11:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:35.340 23:11:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:35.340 23:11:01 -- common/autotest_common.sh@10 -- # set +x 00:18:35.340 ************************************ 00:18:35.340 START TEST nvmf_fips 00:18:35.340 ************************************ 00:18:35.340 23:11:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:35.600 * Looking for test storage... 00:18:35.600 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:35.600 23:11:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:35.600 23:11:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:35.600 23:11:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:35.600 23:11:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:35.600 23:11:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:35.600 23:11:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:35.600 23:11:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:35.600 23:11:01 -- scripts/common.sh@335 -- # IFS=.-: 00:18:35.600 23:11:01 -- scripts/common.sh@335 -- # read -ra ver1 00:18:35.600 23:11:01 -- scripts/common.sh@336 -- # IFS=.-: 00:18:35.600 23:11:01 -- scripts/common.sh@336 -- # read -ra ver2 00:18:35.600 23:11:01 -- scripts/common.sh@337 -- # local 'op=<' 00:18:35.600 23:11:01 -- scripts/common.sh@339 -- # ver1_l=2 00:18:35.600 23:11:01 -- scripts/common.sh@340 -- # ver2_l=1 00:18:35.600 23:11:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:35.600 23:11:01 -- scripts/common.sh@343 -- # case "$op" in 00:18:35.600 23:11:01 -- scripts/common.sh@344 -- # : 1 00:18:35.600 23:11:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:35.600 23:11:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:35.600 23:11:01 -- scripts/common.sh@364 -- # decimal 1 00:18:35.600 23:11:01 -- scripts/common.sh@352 -- # local d=1 00:18:35.600 23:11:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:35.600 23:11:01 -- scripts/common.sh@354 -- # echo 1 00:18:35.600 23:11:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:35.600 23:11:01 -- scripts/common.sh@365 -- # decimal 2 00:18:35.600 23:11:01 -- scripts/common.sh@352 -- # local d=2 00:18:35.600 23:11:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:35.600 23:11:01 -- scripts/common.sh@354 -- # echo 2 00:18:35.600 23:11:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:35.600 23:11:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:35.600 23:11:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:35.600 23:11:01 -- scripts/common.sh@367 -- # return 0 00:18:35.600 23:11:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:35.600 23:11:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:35.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:35.600 --rc genhtml_branch_coverage=1 00:18:35.600 --rc genhtml_function_coverage=1 00:18:35.600 --rc genhtml_legend=1 00:18:35.600 --rc geninfo_all_blocks=1 00:18:35.600 --rc geninfo_unexecuted_blocks=1 00:18:35.600 00:18:35.600 ' 00:18:35.600 23:11:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:35.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:35.600 --rc genhtml_branch_coverage=1 00:18:35.600 --rc genhtml_function_coverage=1 00:18:35.600 --rc genhtml_legend=1 00:18:35.600 --rc geninfo_all_blocks=1 00:18:35.600 --rc geninfo_unexecuted_blocks=1 00:18:35.600 00:18:35.600 ' 00:18:35.600 23:11:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:35.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:35.600 --rc genhtml_branch_coverage=1 00:18:35.600 --rc genhtml_function_coverage=1 00:18:35.600 --rc genhtml_legend=1 00:18:35.600 --rc geninfo_all_blocks=1 00:18:35.600 --rc geninfo_unexecuted_blocks=1 00:18:35.600 00:18:35.600 ' 00:18:35.600 23:11:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:35.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:35.600 --rc genhtml_branch_coverage=1 00:18:35.600 --rc genhtml_function_coverage=1 00:18:35.600 --rc genhtml_legend=1 00:18:35.600 --rc geninfo_all_blocks=1 00:18:35.600 --rc geninfo_unexecuted_blocks=1 00:18:35.600 00:18:35.600 ' 00:18:35.600 23:11:01 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:35.600 23:11:01 -- nvmf/common.sh@7 -- # uname -s 00:18:35.600 23:11:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:35.600 23:11:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:35.600 23:11:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:35.600 23:11:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:35.600 23:11:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:35.600 23:11:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:35.600 23:11:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:35.600 23:11:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:35.600 23:11:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:35.600 23:11:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:35.600 23:11:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:35.600 23:11:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:35.600 23:11:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:35.600 23:11:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:35.600 23:11:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:35.600 23:11:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:35.600 23:11:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:35.600 23:11:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:35.600 23:11:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:35.600 23:11:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:35.600 23:11:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:35.600 23:11:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:35.600 23:11:01 -- paths/export.sh@5 -- # export PATH 00:18:35.601 23:11:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:35.601 23:11:01 -- nvmf/common.sh@46 -- # : 0 00:18:35.601 23:11:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:35.601 23:11:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:35.601 23:11:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:35.601 23:11:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:35.601 23:11:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:35.601 23:11:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:35.601 23:11:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:35.601 23:11:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:35.601 23:11:01 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:35.601 23:11:01 -- fips/fips.sh@89 -- # check_openssl_version 00:18:35.601 23:11:01 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:35.601 23:11:01 -- fips/fips.sh@85 -- # openssl version 00:18:35.601 23:11:01 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:35.601 23:11:01 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:35.601 23:11:01 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:35.601 23:11:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:35.601 23:11:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:35.601 23:11:01 -- scripts/common.sh@335 -- # IFS=.-: 00:18:35.601 23:11:01 -- scripts/common.sh@335 -- # read -ra ver1 00:18:35.601 23:11:01 -- scripts/common.sh@336 -- # IFS=.-: 00:18:35.601 23:11:01 -- scripts/common.sh@336 -- # read -ra ver2 00:18:35.601 23:11:01 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:35.601 23:11:01 -- scripts/common.sh@339 -- # ver1_l=3 00:18:35.601 23:11:01 -- scripts/common.sh@340 -- # ver2_l=3 00:18:35.601 23:11:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:35.601 23:11:01 -- scripts/common.sh@343 -- # case "$op" in 00:18:35.601 23:11:01 -- scripts/common.sh@347 -- # : 1 00:18:35.601 23:11:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:35.601 23:11:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:35.601 23:11:01 -- scripts/common.sh@364 -- # decimal 3 00:18:35.601 23:11:01 -- scripts/common.sh@352 -- # local d=3 00:18:35.601 23:11:01 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:35.601 23:11:01 -- scripts/common.sh@354 -- # echo 3 00:18:35.601 23:11:01 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:35.601 23:11:01 -- scripts/common.sh@365 -- # decimal 3 00:18:35.601 23:11:01 -- scripts/common.sh@352 -- # local d=3 00:18:35.601 23:11:01 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:35.601 23:11:01 -- scripts/common.sh@354 -- # echo 3 00:18:35.601 23:11:01 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:35.601 23:11:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:35.601 23:11:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:35.601 23:11:01 -- scripts/common.sh@363 -- # (( v++ )) 00:18:35.601 23:11:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:35.601 23:11:01 -- scripts/common.sh@364 -- # decimal 1 00:18:35.601 23:11:01 -- scripts/common.sh@352 -- # local d=1 00:18:35.601 23:11:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:35.601 23:11:01 -- scripts/common.sh@354 -- # echo 1 00:18:35.601 23:11:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:35.601 23:11:01 -- scripts/common.sh@365 -- # decimal 0 00:18:35.601 23:11:01 -- scripts/common.sh@352 -- # local d=0 00:18:35.601 23:11:01 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:35.601 23:11:01 -- scripts/common.sh@354 -- # echo 0 00:18:35.601 23:11:01 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:35.601 23:11:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:35.601 23:11:01 -- scripts/common.sh@366 -- # return 0 00:18:35.601 23:11:01 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:35.601 23:11:01 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:35.601 23:11:01 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:35.601 23:11:01 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:35.601 23:11:01 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:35.601 23:11:01 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:35.601 23:11:01 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:35.601 23:11:01 -- fips/fips.sh@113 -- # build_openssl_config 00:18:35.601 23:11:01 -- fips/fips.sh@37 -- # cat 00:18:35.601 23:11:01 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:35.601 23:11:01 -- fips/fips.sh@58 -- # cat - 00:18:35.601 23:11:01 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:35.601 23:11:01 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:35.601 23:11:01 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:35.601 23:11:01 -- fips/fips.sh@116 -- # openssl list -providers 00:18:35.601 23:11:01 -- fips/fips.sh@116 -- # grep name 00:18:35.860 23:11:02 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:35.860 23:11:02 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:35.860 23:11:02 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:35.860 23:11:02 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:35.860 23:11:02 -- fips/fips.sh@127 -- # : 00:18:35.860 23:11:02 -- common/autotest_common.sh@650 -- # local es=0 00:18:35.860 23:11:02 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:35.860 23:11:02 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:35.860 23:11:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:35.860 23:11:02 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:35.860 23:11:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:35.860 23:11:02 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:35.860 23:11:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:35.860 23:11:02 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:35.860 23:11:02 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:35.860 23:11:02 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:35.860 Error setting digest 00:18:35.860 40B26BE58D7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:35.860 40B26BE58D7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:35.860 23:11:02 -- common/autotest_common.sh@653 -- # es=1 00:18:35.860 23:11:02 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:35.860 23:11:02 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:35.860 23:11:02 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:35.860 23:11:02 -- fips/fips.sh@130 -- # nvmftestinit 00:18:35.860 23:11:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:35.860 23:11:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:35.860 23:11:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:35.860 23:11:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:35.860 23:11:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:35.860 23:11:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:35.860 23:11:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:35.860 23:11:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:35.860 23:11:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:35.860 23:11:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:35.860 23:11:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:35.860 23:11:02 -- common/autotest_common.sh@10 -- # set +x 00:18:38.395 23:11:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:38.395 23:11:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:38.395 23:11:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:38.395 23:11:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:38.395 23:11:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:38.395 23:11:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:38.395 23:11:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:38.395 23:11:04 -- nvmf/common.sh@294 -- # net_devs=() 00:18:38.395 23:11:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:38.395 23:11:04 -- nvmf/common.sh@295 -- # e810=() 00:18:38.395 23:11:04 -- nvmf/common.sh@295 -- # local -ga e810 00:18:38.395 23:11:04 -- nvmf/common.sh@296 -- # x722=() 00:18:38.395 23:11:04 -- nvmf/common.sh@296 -- # local -ga x722 00:18:38.395 23:11:04 -- nvmf/common.sh@297 -- # mlx=() 00:18:38.395 23:11:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:38.395 23:11:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:38.395 23:11:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:38.395 23:11:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:38.395 23:11:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:38.395 23:11:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:38.395 23:11:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:38.396 23:11:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:38.396 23:11:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:38.396 23:11:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:38.396 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:38.396 23:11:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:38.396 23:11:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:38.396 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:38.396 23:11:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:38.396 23:11:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:38.396 23:11:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:38.396 23:11:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:38.396 23:11:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:38.396 23:11:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:38.396 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:38.396 23:11:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:38.396 23:11:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:38.396 23:11:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:38.396 23:11:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:38.396 23:11:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:38.396 23:11:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:38.396 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:38.396 23:11:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:38.396 23:11:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:38.396 23:11:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:38.396 23:11:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:38.396 23:11:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:38.396 23:11:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:38.396 23:11:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:38.396 23:11:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:38.396 23:11:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:38.396 23:11:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:38.396 23:11:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:38.396 23:11:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:38.396 23:11:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:38.396 23:11:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:38.396 23:11:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:38.396 23:11:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:38.396 23:11:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:38.396 23:11:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:38.396 23:11:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:38.396 23:11:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:38.396 23:11:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:38.396 23:11:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:38.396 23:11:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:38.396 23:11:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:38.396 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:38.396 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:18:38.396 00:18:38.396 --- 10.0.0.2 ping statistics --- 00:18:38.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:38.396 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:18:38.396 23:11:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:38.396 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:38.396 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:18:38.396 00:18:38.396 --- 10.0.0.1 ping statistics --- 00:18:38.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:38.396 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:18:38.396 23:11:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:38.396 23:11:04 -- nvmf/common.sh@410 -- # return 0 00:18:38.396 23:11:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:38.396 23:11:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:38.396 23:11:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:38.396 23:11:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:38.396 23:11:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:38.396 23:11:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:38.396 23:11:04 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:38.396 23:11:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:38.396 23:11:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:38.396 23:11:04 -- common/autotest_common.sh@10 -- # set +x 00:18:38.396 23:11:04 -- nvmf/common.sh@469 -- # nvmfpid=230842 00:18:38.396 23:11:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:38.396 23:11:04 -- nvmf/common.sh@470 -- # waitforlisten 230842 00:18:38.396 23:11:04 -- common/autotest_common.sh@829 -- # '[' -z 230842 ']' 00:18:38.396 23:11:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:38.396 23:11:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:38.396 23:11:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:38.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:38.396 23:11:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:38.396 23:11:04 -- common/autotest_common.sh@10 -- # set +x 00:18:38.396 [2024-11-26 23:11:04.446870] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:38.396 [2024-11-26 23:11:04.446949] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:38.396 EAL: No free 2048 kB hugepages reported on node 1 00:18:38.396 [2024-11-26 23:11:04.510299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:38.396 [2024-11-26 23:11:04.614355] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:38.396 [2024-11-26 23:11:04.614492] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:38.396 [2024-11-26 23:11:04.614521] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:38.396 [2024-11-26 23:11:04.614545] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:38.396 [2024-11-26 23:11:04.614593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:39.331 23:11:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:39.331 23:11:05 -- common/autotest_common.sh@862 -- # return 0 00:18:39.331 23:11:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:39.331 23:11:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:39.331 23:11:05 -- common/autotest_common.sh@10 -- # set +x 00:18:39.331 23:11:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:39.331 23:11:05 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:39.331 23:11:05 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:39.331 23:11:05 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:39.331 23:11:05 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:39.331 23:11:05 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:39.331 23:11:05 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:39.331 23:11:05 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:39.331 23:11:05 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:39.331 [2024-11-26 23:11:05.706679] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:39.331 [2024-11-26 23:11:05.722679] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:39.331 [2024-11-26 23:11:05.722888] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:39.590 malloc0 00:18:39.590 23:11:05 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:39.590 23:11:05 -- fips/fips.sh@147 -- # bdevperf_pid=231002 00:18:39.590 23:11:05 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:39.590 23:11:05 -- fips/fips.sh@148 -- # waitforlisten 231002 /var/tmp/bdevperf.sock 00:18:39.590 23:11:05 -- common/autotest_common.sh@829 -- # '[' -z 231002 ']' 00:18:39.590 23:11:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:39.590 23:11:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:39.590 23:11:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:39.590 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:39.590 23:11:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:39.590 23:11:05 -- common/autotest_common.sh@10 -- # set +x 00:18:39.590 [2024-11-26 23:11:05.844266] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:39.590 [2024-11-26 23:11:05.844349] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid231002 ] 00:18:39.590 EAL: No free 2048 kB hugepages reported on node 1 00:18:39.590 [2024-11-26 23:11:05.907571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:39.848 [2024-11-26 23:11:06.026020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:40.413 23:11:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:40.413 23:11:06 -- common/autotest_common.sh@862 -- # return 0 00:18:40.413 23:11:06 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.672 [2024-11-26 23:11:06.996412] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:40.930 TLSTESTn1 00:18:40.930 23:11:07 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:40.930 Running I/O for 10 seconds... 00:18:50.899 00:18:50.899 Latency(us) 00:18:50.899 [2024-11-26T22:11:17.293Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:50.899 [2024-11-26T22:11:17.293Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:50.899 Verification LBA range: start 0x0 length 0x2000 00:18:50.899 TLSTESTn1 : 10.02 4370.42 17.07 0.00 0.00 29255.74 3470.98 46991.74 00:18:50.899 [2024-11-26T22:11:17.293Z] =================================================================================================================== 00:18:50.899 [2024-11-26T22:11:17.293Z] Total : 4370.42 17.07 0.00 0.00 29255.74 3470.98 46991.74 00:18:50.899 0 00:18:50.899 23:11:17 -- fips/fips.sh@1 -- # cleanup 00:18:50.899 23:11:17 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:50.899 23:11:17 -- common/autotest_common.sh@806 -- # type=--id 00:18:50.899 23:11:17 -- common/autotest_common.sh@807 -- # id=0 00:18:50.899 23:11:17 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:50.899 23:11:17 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:50.899 23:11:17 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:50.899 23:11:17 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:50.899 23:11:17 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:50.899 23:11:17 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:50.899 nvmf_trace.0 00:18:51.158 23:11:17 -- common/autotest_common.sh@821 -- # return 0 00:18:51.158 23:11:17 -- fips/fips.sh@16 -- # killprocess 231002 00:18:51.158 23:11:17 -- common/autotest_common.sh@936 -- # '[' -z 231002 ']' 00:18:51.158 23:11:17 -- common/autotest_common.sh@940 -- # kill -0 231002 00:18:51.158 23:11:17 -- common/autotest_common.sh@941 -- # uname 00:18:51.158 23:11:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:51.158 23:11:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 231002 00:18:51.158 23:11:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:51.158 23:11:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:51.158 23:11:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 231002' 00:18:51.158 killing process with pid 231002 00:18:51.158 23:11:17 -- common/autotest_common.sh@955 -- # kill 231002 00:18:51.158 Received shutdown signal, test time was about 10.000000 seconds 00:18:51.158 00:18:51.158 Latency(us) 00:18:51.158 [2024-11-26T22:11:17.552Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:51.158 [2024-11-26T22:11:17.552Z] =================================================================================================================== 00:18:51.158 [2024-11-26T22:11:17.552Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:51.158 23:11:17 -- common/autotest_common.sh@960 -- # wait 231002 00:18:51.416 23:11:17 -- fips/fips.sh@17 -- # nvmftestfini 00:18:51.416 23:11:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:51.416 23:11:17 -- nvmf/common.sh@116 -- # sync 00:18:51.416 23:11:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:51.416 23:11:17 -- nvmf/common.sh@119 -- # set +e 00:18:51.416 23:11:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:51.416 23:11:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:51.416 rmmod nvme_tcp 00:18:51.416 rmmod nvme_fabrics 00:18:51.416 rmmod nvme_keyring 00:18:51.416 23:11:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:51.416 23:11:17 -- nvmf/common.sh@123 -- # set -e 00:18:51.416 23:11:17 -- nvmf/common.sh@124 -- # return 0 00:18:51.416 23:11:17 -- nvmf/common.sh@477 -- # '[' -n 230842 ']' 00:18:51.416 23:11:17 -- nvmf/common.sh@478 -- # killprocess 230842 00:18:51.416 23:11:17 -- common/autotest_common.sh@936 -- # '[' -z 230842 ']' 00:18:51.416 23:11:17 -- common/autotest_common.sh@940 -- # kill -0 230842 00:18:51.416 23:11:17 -- common/autotest_common.sh@941 -- # uname 00:18:51.416 23:11:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:51.416 23:11:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 230842 00:18:51.416 23:11:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:51.416 23:11:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:51.416 23:11:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 230842' 00:18:51.416 killing process with pid 230842 00:18:51.416 23:11:17 -- common/autotest_common.sh@955 -- # kill 230842 00:18:51.416 23:11:17 -- common/autotest_common.sh@960 -- # wait 230842 00:18:51.675 23:11:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:51.675 23:11:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:51.675 23:11:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:51.675 23:11:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:51.675 23:11:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:51.675 23:11:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:51.675 23:11:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:51.675 23:11:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:54.301 23:11:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:54.301 23:11:20 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:54.301 00:18:54.301 real 0m18.343s 00:18:54.301 user 0m24.363s 00:18:54.301 sys 0m5.519s 00:18:54.301 23:11:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:54.301 23:11:20 -- common/autotest_common.sh@10 -- # set +x 00:18:54.301 ************************************ 00:18:54.301 END TEST nvmf_fips 00:18:54.301 ************************************ 00:18:54.301 23:11:20 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:54.301 23:11:20 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:54.301 23:11:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:54.301 23:11:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:54.301 23:11:20 -- common/autotest_common.sh@10 -- # set +x 00:18:54.301 ************************************ 00:18:54.301 START TEST nvmf_fuzz 00:18:54.301 ************************************ 00:18:54.301 23:11:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:54.301 * Looking for test storage... 00:18:54.301 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:54.301 23:11:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:54.301 23:11:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:54.301 23:11:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:54.301 23:11:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:54.301 23:11:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:54.301 23:11:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:54.301 23:11:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:54.301 23:11:20 -- scripts/common.sh@335 -- # IFS=.-: 00:18:54.301 23:11:20 -- scripts/common.sh@335 -- # read -ra ver1 00:18:54.301 23:11:20 -- scripts/common.sh@336 -- # IFS=.-: 00:18:54.301 23:11:20 -- scripts/common.sh@336 -- # read -ra ver2 00:18:54.301 23:11:20 -- scripts/common.sh@337 -- # local 'op=<' 00:18:54.301 23:11:20 -- scripts/common.sh@339 -- # ver1_l=2 00:18:54.301 23:11:20 -- scripts/common.sh@340 -- # ver2_l=1 00:18:54.301 23:11:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:54.301 23:11:20 -- scripts/common.sh@343 -- # case "$op" in 00:18:54.301 23:11:20 -- scripts/common.sh@344 -- # : 1 00:18:54.301 23:11:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:54.301 23:11:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:54.301 23:11:20 -- scripts/common.sh@364 -- # decimal 1 00:18:54.301 23:11:20 -- scripts/common.sh@352 -- # local d=1 00:18:54.301 23:11:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:54.301 23:11:20 -- scripts/common.sh@354 -- # echo 1 00:18:54.301 23:11:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:54.301 23:11:20 -- scripts/common.sh@365 -- # decimal 2 00:18:54.301 23:11:20 -- scripts/common.sh@352 -- # local d=2 00:18:54.301 23:11:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:54.301 23:11:20 -- scripts/common.sh@354 -- # echo 2 00:18:54.301 23:11:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:54.301 23:11:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:54.301 23:11:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:54.301 23:11:20 -- scripts/common.sh@367 -- # return 0 00:18:54.301 23:11:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:54.301 23:11:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:54.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:54.301 --rc genhtml_branch_coverage=1 00:18:54.301 --rc genhtml_function_coverage=1 00:18:54.301 --rc genhtml_legend=1 00:18:54.301 --rc geninfo_all_blocks=1 00:18:54.301 --rc geninfo_unexecuted_blocks=1 00:18:54.301 00:18:54.301 ' 00:18:54.301 23:11:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:54.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:54.301 --rc genhtml_branch_coverage=1 00:18:54.302 --rc genhtml_function_coverage=1 00:18:54.302 --rc genhtml_legend=1 00:18:54.302 --rc geninfo_all_blocks=1 00:18:54.302 --rc geninfo_unexecuted_blocks=1 00:18:54.302 00:18:54.302 ' 00:18:54.302 23:11:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:54.302 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:54.302 --rc genhtml_branch_coverage=1 00:18:54.302 --rc genhtml_function_coverage=1 00:18:54.302 --rc genhtml_legend=1 00:18:54.302 --rc geninfo_all_blocks=1 00:18:54.302 --rc geninfo_unexecuted_blocks=1 00:18:54.302 00:18:54.302 ' 00:18:54.302 23:11:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:54.302 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:54.302 --rc genhtml_branch_coverage=1 00:18:54.302 --rc genhtml_function_coverage=1 00:18:54.302 --rc genhtml_legend=1 00:18:54.302 --rc geninfo_all_blocks=1 00:18:54.302 --rc geninfo_unexecuted_blocks=1 00:18:54.302 00:18:54.302 ' 00:18:54.302 23:11:20 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:54.302 23:11:20 -- nvmf/common.sh@7 -- # uname -s 00:18:54.302 23:11:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:54.302 23:11:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:54.302 23:11:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:54.302 23:11:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:54.302 23:11:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:54.302 23:11:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:54.302 23:11:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:54.302 23:11:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:54.302 23:11:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:54.302 23:11:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:54.302 23:11:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:54.302 23:11:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:54.302 23:11:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:54.302 23:11:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:54.302 23:11:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:54.302 23:11:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:54.302 23:11:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:54.302 23:11:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:54.302 23:11:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:54.302 23:11:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.302 23:11:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.302 23:11:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.302 23:11:20 -- paths/export.sh@5 -- # export PATH 00:18:54.302 23:11:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.302 23:11:20 -- nvmf/common.sh@46 -- # : 0 00:18:54.302 23:11:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:54.302 23:11:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:54.302 23:11:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:54.302 23:11:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:54.302 23:11:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:54.302 23:11:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:54.302 23:11:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:54.302 23:11:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:54.302 23:11:20 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:54.302 23:11:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:54.302 23:11:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:54.302 23:11:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:54.302 23:11:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:54.302 23:11:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:54.302 23:11:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:54.302 23:11:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:54.302 23:11:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:54.302 23:11:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:54.302 23:11:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:54.302 23:11:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:54.302 23:11:20 -- common/autotest_common.sh@10 -- # set +x 00:18:56.307 23:11:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:56.307 23:11:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:56.307 23:11:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:56.307 23:11:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:56.307 23:11:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:56.307 23:11:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:56.307 23:11:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:56.307 23:11:22 -- nvmf/common.sh@294 -- # net_devs=() 00:18:56.307 23:11:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:56.307 23:11:22 -- nvmf/common.sh@295 -- # e810=() 00:18:56.307 23:11:22 -- nvmf/common.sh@295 -- # local -ga e810 00:18:56.307 23:11:22 -- nvmf/common.sh@296 -- # x722=() 00:18:56.307 23:11:22 -- nvmf/common.sh@296 -- # local -ga x722 00:18:56.307 23:11:22 -- nvmf/common.sh@297 -- # mlx=() 00:18:56.307 23:11:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:56.307 23:11:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:56.307 23:11:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:56.307 23:11:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:56.307 23:11:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:56.307 23:11:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:56.307 23:11:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:56.307 23:11:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:56.307 23:11:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:56.308 23:11:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:56.308 23:11:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:56.308 23:11:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:56.308 23:11:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:56.308 23:11:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:56.308 23:11:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:56.308 23:11:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.308 23:11:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:56.308 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:56.308 23:11:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.308 23:11:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:56.308 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:56.308 23:11:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:56.308 23:11:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.308 23:11:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.308 23:11:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.308 23:11:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.308 23:11:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:56.308 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:56.308 23:11:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.308 23:11:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.308 23:11:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.308 23:11:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.308 23:11:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.308 23:11:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:56.308 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:56.308 23:11:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.308 23:11:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:56.308 23:11:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:56.308 23:11:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:56.308 23:11:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:56.308 23:11:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:56.308 23:11:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:56.308 23:11:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:56.308 23:11:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:56.308 23:11:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:56.308 23:11:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:56.308 23:11:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:56.308 23:11:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:56.308 23:11:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:56.308 23:11:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:56.308 23:11:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:56.308 23:11:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:56.308 23:11:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:56.308 23:11:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:56.308 23:11:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:56.308 23:11:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:56.308 23:11:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:56.308 23:11:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:56.308 23:11:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:56.308 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:56.308 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.295 ms 00:18:56.308 00:18:56.308 --- 10.0.0.2 ping statistics --- 00:18:56.308 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.308 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:18:56.308 23:11:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:56.308 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:56.308 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:18:56.308 00:18:56.308 --- 10.0.0.1 ping statistics --- 00:18:56.308 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.308 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:18:56.308 23:11:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:56.308 23:11:22 -- nvmf/common.sh@410 -- # return 0 00:18:56.308 23:11:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:56.308 23:11:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:56.308 23:11:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:56.308 23:11:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:56.308 23:11:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:56.308 23:11:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:56.308 23:11:22 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=234459 00:18:56.308 23:11:22 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:56.308 23:11:22 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:56.308 23:11:22 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 234459 00:18:56.308 23:11:22 -- common/autotest_common.sh@829 -- # '[' -z 234459 ']' 00:18:56.308 23:11:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:56.308 23:11:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:56.308 23:11:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:56.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:56.308 23:11:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:56.308 23:11:22 -- common/autotest_common.sh@10 -- # set +x 00:18:57.243 23:11:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:57.243 23:11:23 -- common/autotest_common.sh@862 -- # return 0 00:18:57.243 23:11:23 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:57.243 23:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.243 23:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:57.243 23:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.243 23:11:23 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:57.243 23:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.243 23:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:57.243 Malloc0 00:18:57.243 23:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.243 23:11:23 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:57.243 23:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.243 23:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:57.243 23:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.243 23:11:23 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:57.243 23:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.243 23:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:57.243 23:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.243 23:11:23 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:57.243 23:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.243 23:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:57.243 23:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.243 23:11:23 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:57.243 23:11:23 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:29.306 Fuzzing completed. Shutting down the fuzz application 00:19:29.306 00:19:29.306 Dumping successful admin opcodes: 00:19:29.306 8, 9, 10, 24, 00:19:29.306 Dumping successful io opcodes: 00:19:29.306 0, 9, 00:19:29.306 NS: 0x200003aeff00 I/O qp, Total commands completed: 467754, total successful commands: 2700, random_seed: 1020225728 00:19:29.306 NS: 0x200003aeff00 admin qp, Total commands completed: 58736, total successful commands: 466, random_seed: 2873134720 00:19:29.306 23:11:54 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:29.564 Fuzzing completed. Shutting down the fuzz application 00:19:29.564 00:19:29.564 Dumping successful admin opcodes: 00:19:29.564 24, 00:19:29.564 Dumping successful io opcodes: 00:19:29.564 00:19:29.564 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 4042919790 00:19:29.564 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 4043131087 00:19:29.564 23:11:55 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:29.564 23:11:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.564 23:11:55 -- common/autotest_common.sh@10 -- # set +x 00:19:29.564 23:11:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.564 23:11:55 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:29.564 23:11:55 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:29.564 23:11:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:29.564 23:11:55 -- nvmf/common.sh@116 -- # sync 00:19:29.564 23:11:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:29.564 23:11:55 -- nvmf/common.sh@119 -- # set +e 00:19:29.564 23:11:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:29.564 23:11:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:29.564 rmmod nvme_tcp 00:19:29.564 rmmod nvme_fabrics 00:19:29.564 rmmod nvme_keyring 00:19:29.564 23:11:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:29.564 23:11:55 -- nvmf/common.sh@123 -- # set -e 00:19:29.564 23:11:55 -- nvmf/common.sh@124 -- # return 0 00:19:29.564 23:11:55 -- nvmf/common.sh@477 -- # '[' -n 234459 ']' 00:19:29.564 23:11:55 -- nvmf/common.sh@478 -- # killprocess 234459 00:19:29.564 23:11:55 -- common/autotest_common.sh@936 -- # '[' -z 234459 ']' 00:19:29.564 23:11:55 -- common/autotest_common.sh@940 -- # kill -0 234459 00:19:29.564 23:11:55 -- common/autotest_common.sh@941 -- # uname 00:19:29.564 23:11:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:29.564 23:11:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 234459 00:19:29.564 23:11:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:29.564 23:11:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:29.564 23:11:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 234459' 00:19:29.564 killing process with pid 234459 00:19:29.564 23:11:55 -- common/autotest_common.sh@955 -- # kill 234459 00:19:29.564 23:11:55 -- common/autotest_common.sh@960 -- # wait 234459 00:19:29.823 23:11:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:29.823 23:11:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:29.823 23:11:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:29.823 23:11:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:29.823 23:11:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:29.823 23:11:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:29.823 23:11:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:29.823 23:11:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.363 23:11:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:32.363 23:11:58 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:32.363 00:19:32.363 real 0m38.143s 00:19:32.363 user 0m52.550s 00:19:32.363 sys 0m14.915s 00:19:32.363 23:11:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:32.363 23:11:58 -- common/autotest_common.sh@10 -- # set +x 00:19:32.363 ************************************ 00:19:32.363 END TEST nvmf_fuzz 00:19:32.363 ************************************ 00:19:32.363 23:11:58 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:32.363 23:11:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:32.363 23:11:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:32.363 23:11:58 -- common/autotest_common.sh@10 -- # set +x 00:19:32.363 ************************************ 00:19:32.363 START TEST nvmf_multiconnection 00:19:32.363 ************************************ 00:19:32.363 23:11:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:32.363 * Looking for test storage... 00:19:32.363 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:32.363 23:11:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:32.363 23:11:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:32.363 23:11:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:32.363 23:11:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:32.363 23:11:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:32.363 23:11:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:32.363 23:11:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:32.363 23:11:58 -- scripts/common.sh@335 -- # IFS=.-: 00:19:32.363 23:11:58 -- scripts/common.sh@335 -- # read -ra ver1 00:19:32.363 23:11:58 -- scripts/common.sh@336 -- # IFS=.-: 00:19:32.363 23:11:58 -- scripts/common.sh@336 -- # read -ra ver2 00:19:32.363 23:11:58 -- scripts/common.sh@337 -- # local 'op=<' 00:19:32.363 23:11:58 -- scripts/common.sh@339 -- # ver1_l=2 00:19:32.363 23:11:58 -- scripts/common.sh@340 -- # ver2_l=1 00:19:32.363 23:11:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:32.363 23:11:58 -- scripts/common.sh@343 -- # case "$op" in 00:19:32.363 23:11:58 -- scripts/common.sh@344 -- # : 1 00:19:32.363 23:11:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:32.363 23:11:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:32.363 23:11:58 -- scripts/common.sh@364 -- # decimal 1 00:19:32.363 23:11:58 -- scripts/common.sh@352 -- # local d=1 00:19:32.363 23:11:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:32.363 23:11:58 -- scripts/common.sh@354 -- # echo 1 00:19:32.363 23:11:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:32.363 23:11:58 -- scripts/common.sh@365 -- # decimal 2 00:19:32.363 23:11:58 -- scripts/common.sh@352 -- # local d=2 00:19:32.363 23:11:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:32.363 23:11:58 -- scripts/common.sh@354 -- # echo 2 00:19:32.363 23:11:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:32.363 23:11:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:32.363 23:11:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:32.363 23:11:58 -- scripts/common.sh@367 -- # return 0 00:19:32.364 23:11:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:32.364 23:11:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:32.364 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.364 --rc genhtml_branch_coverage=1 00:19:32.364 --rc genhtml_function_coverage=1 00:19:32.364 --rc genhtml_legend=1 00:19:32.364 --rc geninfo_all_blocks=1 00:19:32.364 --rc geninfo_unexecuted_blocks=1 00:19:32.364 00:19:32.364 ' 00:19:32.364 23:11:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:32.364 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.364 --rc genhtml_branch_coverage=1 00:19:32.364 --rc genhtml_function_coverage=1 00:19:32.364 --rc genhtml_legend=1 00:19:32.364 --rc geninfo_all_blocks=1 00:19:32.364 --rc geninfo_unexecuted_blocks=1 00:19:32.364 00:19:32.364 ' 00:19:32.364 23:11:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:32.364 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.364 --rc genhtml_branch_coverage=1 00:19:32.364 --rc genhtml_function_coverage=1 00:19:32.364 --rc genhtml_legend=1 00:19:32.364 --rc geninfo_all_blocks=1 00:19:32.364 --rc geninfo_unexecuted_blocks=1 00:19:32.364 00:19:32.364 ' 00:19:32.364 23:11:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:32.364 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.364 --rc genhtml_branch_coverage=1 00:19:32.364 --rc genhtml_function_coverage=1 00:19:32.364 --rc genhtml_legend=1 00:19:32.364 --rc geninfo_all_blocks=1 00:19:32.364 --rc geninfo_unexecuted_blocks=1 00:19:32.364 00:19:32.364 ' 00:19:32.364 23:11:58 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:32.364 23:11:58 -- nvmf/common.sh@7 -- # uname -s 00:19:32.364 23:11:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:32.364 23:11:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:32.364 23:11:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:32.364 23:11:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:32.364 23:11:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:32.364 23:11:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:32.364 23:11:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:32.364 23:11:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:32.364 23:11:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:32.364 23:11:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:32.364 23:11:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.364 23:11:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.364 23:11:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:32.364 23:11:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:32.364 23:11:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:32.364 23:11:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:32.364 23:11:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:32.364 23:11:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:32.364 23:11:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:32.364 23:11:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.364 23:11:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.364 23:11:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.364 23:11:58 -- paths/export.sh@5 -- # export PATH 00:19:32.364 23:11:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.364 23:11:58 -- nvmf/common.sh@46 -- # : 0 00:19:32.364 23:11:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:32.364 23:11:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:32.364 23:11:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:32.364 23:11:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:32.364 23:11:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:32.364 23:11:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:32.364 23:11:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:32.364 23:11:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:32.364 23:11:58 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:32.364 23:11:58 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:32.364 23:11:58 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:32.364 23:11:58 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:32.364 23:11:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:32.364 23:11:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:32.364 23:11:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:32.364 23:11:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:32.364 23:11:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:32.364 23:11:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.364 23:11:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:32.364 23:11:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.364 23:11:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:32.364 23:11:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:32.364 23:11:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:32.364 23:11:58 -- common/autotest_common.sh@10 -- # set +x 00:19:34.266 23:12:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:34.266 23:12:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:34.266 23:12:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:34.266 23:12:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:34.266 23:12:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:34.266 23:12:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:34.266 23:12:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:34.266 23:12:00 -- nvmf/common.sh@294 -- # net_devs=() 00:19:34.266 23:12:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:34.266 23:12:00 -- nvmf/common.sh@295 -- # e810=() 00:19:34.266 23:12:00 -- nvmf/common.sh@295 -- # local -ga e810 00:19:34.266 23:12:00 -- nvmf/common.sh@296 -- # x722=() 00:19:34.266 23:12:00 -- nvmf/common.sh@296 -- # local -ga x722 00:19:34.266 23:12:00 -- nvmf/common.sh@297 -- # mlx=() 00:19:34.266 23:12:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:34.266 23:12:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:34.266 23:12:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:34.266 23:12:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:34.266 23:12:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:34.266 23:12:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.266 23:12:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:34.266 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:34.266 23:12:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.266 23:12:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:34.266 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:34.266 23:12:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:34.266 23:12:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.266 23:12:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.266 23:12:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.266 23:12:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.266 23:12:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:34.266 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:34.266 23:12:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.266 23:12:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.266 23:12:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.266 23:12:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.266 23:12:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.266 23:12:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:34.266 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:34.266 23:12:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.266 23:12:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:34.266 23:12:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:34.266 23:12:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:34.266 23:12:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:34.266 23:12:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:34.266 23:12:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:34.266 23:12:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:34.266 23:12:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:34.266 23:12:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:34.266 23:12:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:34.266 23:12:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:34.266 23:12:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:34.266 23:12:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:34.267 23:12:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:34.267 23:12:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:34.267 23:12:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:34.267 23:12:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:34.267 23:12:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:34.267 23:12:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:34.267 23:12:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:34.267 23:12:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:34.267 23:12:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:34.267 23:12:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:34.267 23:12:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:34.267 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:34.267 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:19:34.267 00:19:34.267 --- 10.0.0.2 ping statistics --- 00:19:34.267 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.267 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:19:34.267 23:12:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:34.267 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:34.267 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:19:34.267 00:19:34.267 --- 10.0.0.1 ping statistics --- 00:19:34.267 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.267 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:19:34.267 23:12:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:34.267 23:12:00 -- nvmf/common.sh@410 -- # return 0 00:19:34.267 23:12:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:34.267 23:12:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:34.267 23:12:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:34.267 23:12:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:34.267 23:12:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:34.267 23:12:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:34.267 23:12:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:34.267 23:12:00 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:34.267 23:12:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:34.267 23:12:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:34.267 23:12:00 -- common/autotest_common.sh@10 -- # set +x 00:19:34.267 23:12:00 -- nvmf/common.sh@469 -- # nvmfpid=240416 00:19:34.267 23:12:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:34.267 23:12:00 -- nvmf/common.sh@470 -- # waitforlisten 240416 00:19:34.267 23:12:00 -- common/autotest_common.sh@829 -- # '[' -z 240416 ']' 00:19:34.267 23:12:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:34.267 23:12:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:34.267 23:12:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:34.267 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:34.267 23:12:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:34.267 23:12:00 -- common/autotest_common.sh@10 -- # set +x 00:19:34.267 [2024-11-26 23:12:00.588631] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:34.267 [2024-11-26 23:12:00.588707] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:34.267 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.525 [2024-11-26 23:12:00.658789] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:34.525 [2024-11-26 23:12:00.774035] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:34.525 [2024-11-26 23:12:00.774187] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:34.525 [2024-11-26 23:12:00.774204] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:34.525 [2024-11-26 23:12:00.774216] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:34.525 [2024-11-26 23:12:00.774267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:34.525 [2024-11-26 23:12:00.774355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:34.525 [2024-11-26 23:12:00.774299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:34.525 [2024-11-26 23:12:00.774358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:35.457 23:12:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:35.458 23:12:01 -- common/autotest_common.sh@862 -- # return 0 00:19:35.458 23:12:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:35.458 23:12:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:35.458 23:12:01 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 [2024-11-26 23:12:01.596154] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:35.458 23:12:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.458 23:12:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 Malloc1 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 [2024-11-26 23:12:01.651840] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.458 23:12:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 Malloc2 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.458 23:12:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 Malloc3 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.458 23:12:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 Malloc4 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.458 23:12:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 Malloc5 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.458 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.458 23:12:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.458 23:12:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:35.458 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.458 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 Malloc6 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.717 23:12:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 Malloc7 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.717 23:12:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 Malloc8 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:35.717 23:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:01 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.717 23:12:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:35.717 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 Malloc9 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:35.717 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:35.717 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:35.717 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.717 23:12:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:35.717 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 Malloc10 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:35.717 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:35.717 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:35.717 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.717 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.717 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.717 23:12:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.718 23:12:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:35.718 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.718 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.975 Malloc11 00:19:35.975 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.975 23:12:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:35.975 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.975 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.975 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.975 23:12:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:35.975 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.975 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.975 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.975 23:12:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:35.975 23:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.975 23:12:02 -- common/autotest_common.sh@10 -- # set +x 00:19:35.975 23:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.975 23:12:02 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:35.975 23:12:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.975 23:12:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:36.540 23:12:02 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:36.540 23:12:02 -- common/autotest_common.sh@1187 -- # local i=0 00:19:36.540 23:12:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:36.540 23:12:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:36.540 23:12:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:39.065 23:12:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:39.065 23:12:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:39.065 23:12:04 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:39.065 23:12:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:39.065 23:12:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:39.065 23:12:04 -- common/autotest_common.sh@1197 -- # return 0 00:19:39.065 23:12:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:39.065 23:12:04 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:39.323 23:12:05 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:39.323 23:12:05 -- common/autotest_common.sh@1187 -- # local i=0 00:19:39.323 23:12:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:39.323 23:12:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:39.323 23:12:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:41.220 23:12:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:41.220 23:12:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:41.220 23:12:07 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:41.220 23:12:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:41.220 23:12:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:41.220 23:12:07 -- common/autotest_common.sh@1197 -- # return 0 00:19:41.220 23:12:07 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:41.220 23:12:07 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:42.152 23:12:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:42.152 23:12:08 -- common/autotest_common.sh@1187 -- # local i=0 00:19:42.152 23:12:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:42.152 23:12:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:42.152 23:12:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:44.050 23:12:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:44.050 23:12:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:44.050 23:12:10 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:44.050 23:12:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:44.050 23:12:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:44.050 23:12:10 -- common/autotest_common.sh@1197 -- # return 0 00:19:44.050 23:12:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:44.050 23:12:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:44.983 23:12:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:44.983 23:12:11 -- common/autotest_common.sh@1187 -- # local i=0 00:19:44.983 23:12:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:44.983 23:12:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:44.983 23:12:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:46.881 23:12:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:46.881 23:12:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:46.881 23:12:13 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:46.881 23:12:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:46.881 23:12:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:46.881 23:12:13 -- common/autotest_common.sh@1197 -- # return 0 00:19:46.881 23:12:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:46.881 23:12:13 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:47.814 23:12:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:47.814 23:12:14 -- common/autotest_common.sh@1187 -- # local i=0 00:19:47.814 23:12:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:47.814 23:12:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:47.814 23:12:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:49.711 23:12:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:49.711 23:12:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:49.711 23:12:16 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:49.711 23:12:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:49.711 23:12:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:49.711 23:12:16 -- common/autotest_common.sh@1197 -- # return 0 00:19:49.711 23:12:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:49.711 23:12:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:50.644 23:12:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:50.644 23:12:16 -- common/autotest_common.sh@1187 -- # local i=0 00:19:50.644 23:12:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:50.644 23:12:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:50.644 23:12:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:52.539 23:12:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:52.539 23:12:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:52.539 23:12:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:52.539 23:12:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:52.539 23:12:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:52.539 23:12:18 -- common/autotest_common.sh@1197 -- # return 0 00:19:52.539 23:12:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.540 23:12:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:53.471 23:12:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:53.471 23:12:19 -- common/autotest_common.sh@1187 -- # local i=0 00:19:53.471 23:12:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:53.471 23:12:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:53.471 23:12:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:55.367 23:12:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:55.367 23:12:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:55.367 23:12:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:55.367 23:12:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:55.367 23:12:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:55.367 23:12:21 -- common/autotest_common.sh@1197 -- # return 0 00:19:55.367 23:12:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:55.367 23:12:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:56.300 23:12:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:56.301 23:12:22 -- common/autotest_common.sh@1187 -- # local i=0 00:19:56.301 23:12:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:56.301 23:12:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:56.301 23:12:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:58.198 23:12:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:58.198 23:12:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:58.198 23:12:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:58.198 23:12:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:58.198 23:12:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:58.198 23:12:24 -- common/autotest_common.sh@1197 -- # return 0 00:19:58.198 23:12:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:58.198 23:12:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:59.132 23:12:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:59.132 23:12:25 -- common/autotest_common.sh@1187 -- # local i=0 00:19:59.132 23:12:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:59.132 23:12:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:59.132 23:12:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:01.030 23:12:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:01.030 23:12:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:01.030 23:12:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:20:01.030 23:12:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:01.030 23:12:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:01.030 23:12:27 -- common/autotest_common.sh@1197 -- # return 0 00:20:01.030 23:12:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:01.030 23:12:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:20:01.964 23:12:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:01.964 23:12:28 -- common/autotest_common.sh@1187 -- # local i=0 00:20:01.964 23:12:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:01.964 23:12:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:01.964 23:12:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:03.878 23:12:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:03.878 23:12:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:03.878 23:12:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:20:03.878 23:12:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:03.878 23:12:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:03.878 23:12:30 -- common/autotest_common.sh@1197 -- # return 0 00:20:03.878 23:12:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:03.878 23:12:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:04.811 23:12:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:04.811 23:12:31 -- common/autotest_common.sh@1187 -- # local i=0 00:20:04.811 23:12:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:04.811 23:12:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:04.811 23:12:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:06.709 23:12:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:06.709 23:12:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:06.709 23:12:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:20:06.709 23:12:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:06.709 23:12:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:06.709 23:12:33 -- common/autotest_common.sh@1197 -- # return 0 00:20:06.709 23:12:33 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:06.709 [global] 00:20:06.709 thread=1 00:20:06.709 invalidate=1 00:20:06.709 rw=read 00:20:06.709 time_based=1 00:20:06.709 runtime=10 00:20:06.709 ioengine=libaio 00:20:06.709 direct=1 00:20:06.709 bs=262144 00:20:06.709 iodepth=64 00:20:06.709 norandommap=1 00:20:06.709 numjobs=1 00:20:06.709 00:20:06.709 [job0] 00:20:06.709 filename=/dev/nvme0n1 00:20:06.709 [job1] 00:20:06.709 filename=/dev/nvme10n1 00:20:06.709 [job2] 00:20:06.709 filename=/dev/nvme1n1 00:20:06.709 [job3] 00:20:06.709 filename=/dev/nvme2n1 00:20:06.709 [job4] 00:20:06.709 filename=/dev/nvme3n1 00:20:06.709 [job5] 00:20:06.709 filename=/dev/nvme4n1 00:20:06.709 [job6] 00:20:06.709 filename=/dev/nvme5n1 00:20:06.709 [job7] 00:20:06.709 filename=/dev/nvme6n1 00:20:06.709 [job8] 00:20:06.709 filename=/dev/nvme7n1 00:20:06.709 [job9] 00:20:06.709 filename=/dev/nvme8n1 00:20:06.709 [job10] 00:20:06.709 filename=/dev/nvme9n1 00:20:06.966 Could not set queue depth (nvme0n1) 00:20:06.966 Could not set queue depth (nvme10n1) 00:20:06.966 Could not set queue depth (nvme1n1) 00:20:06.966 Could not set queue depth (nvme2n1) 00:20:06.966 Could not set queue depth (nvme3n1) 00:20:06.966 Could not set queue depth (nvme4n1) 00:20:06.966 Could not set queue depth (nvme5n1) 00:20:06.966 Could not set queue depth (nvme6n1) 00:20:06.966 Could not set queue depth (nvme7n1) 00:20:06.966 Could not set queue depth (nvme8n1) 00:20:06.966 Could not set queue depth (nvme9n1) 00:20:06.966 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.966 fio-3.35 00:20:06.966 Starting 11 threads 00:20:19.166 00:20:19.166 job0: (groupid=0, jobs=1): err= 0: pid=245554: Tue Nov 26 23:12:43 2024 00:20:19.166 read: IOPS=622, BW=156MiB/s (163MB/s)(1570MiB/10082msec) 00:20:19.166 slat (usec): min=9, max=170339, avg=1303.79, stdev=5569.37 00:20:19.166 clat (msec): min=2, max=364, avg=101.41, stdev=55.47 00:20:19.166 lat (msec): min=2, max=364, avg=102.71, stdev=56.33 00:20:19.166 clat percentiles (msec): 00:20:19.166 | 1.00th=[ 7], 5.00th=[ 25], 10.00th=[ 47], 20.00th=[ 56], 00:20:19.166 | 30.00th=[ 64], 40.00th=[ 75], 50.00th=[ 91], 60.00th=[ 109], 00:20:19.166 | 70.00th=[ 125], 80.00th=[ 144], 90.00th=[ 182], 95.00th=[ 215], 00:20:19.166 | 99.00th=[ 255], 99.50th=[ 262], 99.90th=[ 305], 99.95th=[ 313], 00:20:19.166 | 99.99th=[ 363] 00:20:19.166 bw ( KiB/s): min=66560, max=312832, per=7.81%, avg=159042.95, stdev=69914.17, samples=20 00:20:19.166 iops : min= 260, max= 1222, avg=621.25, stdev=273.09, samples=20 00:20:19.166 lat (msec) : 4=0.19%, 10=1.75%, 20=2.18%, 50=8.65%, 100=43.13% 00:20:19.166 lat (msec) : 250=42.98%, 500=1.12% 00:20:19.166 cpu : usr=0.35%, sys=2.11%, ctx=1213, majf=0, minf=3722 00:20:19.166 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:19.166 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.166 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.166 issued rwts: total=6278,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.166 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.166 job1: (groupid=0, jobs=1): err= 0: pid=245584: Tue Nov 26 23:12:43 2024 00:20:19.166 read: IOPS=557, BW=139MiB/s (146MB/s)(1405MiB/10078msec) 00:20:19.166 slat (usec): min=13, max=90066, avg=1528.79, stdev=4943.95 00:20:19.166 clat (msec): min=32, max=275, avg=113.15, stdev=39.64 00:20:19.166 lat (msec): min=32, max=275, avg=114.68, stdev=40.21 00:20:19.166 clat percentiles (msec): 00:20:19.166 | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 71], 20.00th=[ 80], 00:20:19.166 | 30.00th=[ 85], 40.00th=[ 93], 50.00th=[ 104], 60.00th=[ 118], 00:20:19.166 | 70.00th=[ 132], 80.00th=[ 148], 90.00th=[ 163], 95.00th=[ 199], 00:20:19.166 | 99.00th=[ 222], 99.50th=[ 230], 99.90th=[ 241], 99.95th=[ 257], 00:20:19.166 | 99.99th=[ 275] 00:20:19.166 bw ( KiB/s): min=76646, max=222720, per=6.98%, avg=142243.10, stdev=43571.75, samples=20 00:20:19.166 iops : min= 299, max= 870, avg=555.55, stdev=170.25, samples=20 00:20:19.166 lat (msec) : 50=1.05%, 100=46.10%, 250=52.78%, 500=0.07% 00:20:19.166 cpu : usr=0.36%, sys=1.93%, ctx=1164, majf=0, minf=4097 00:20:19.166 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:19.166 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.166 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.166 issued rwts: total=5620,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.166 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.166 job2: (groupid=0, jobs=1): err= 0: pid=245613: Tue Nov 26 23:12:43 2024 00:20:19.166 read: IOPS=509, BW=127MiB/s (134MB/s)(1284MiB/10080msec) 00:20:19.166 slat (usec): min=13, max=108899, avg=1629.72, stdev=5555.94 00:20:19.166 clat (msec): min=4, max=298, avg=123.94, stdev=45.90 00:20:19.166 lat (msec): min=4, max=309, avg=125.57, stdev=46.66 00:20:19.166 clat percentiles (msec): 00:20:19.166 | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 85], 00:20:19.166 | 30.00th=[ 95], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 129], 00:20:19.167 | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 197], 95.00th=[ 218], 00:20:19.167 | 99.00th=[ 249], 99.50th=[ 257], 99.90th=[ 275], 99.95th=[ 296], 00:20:19.167 | 99.99th=[ 300] 00:20:19.167 bw ( KiB/s): min=68608, max=221764, per=6.37%, avg=129796.25, stdev=40954.89, samples=20 00:20:19.167 iops : min= 268, max= 866, avg=506.95, stdev=160.00, samples=20 00:20:19.167 lat (msec) : 10=0.19%, 20=0.39%, 50=0.39%, 100=33.37%, 250=64.78% 00:20:19.167 lat (msec) : 500=0.88% 00:20:19.167 cpu : usr=0.29%, sys=1.81%, ctx=995, majf=0, minf=4097 00:20:19.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:19.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.167 issued rwts: total=5134,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.167 job3: (groupid=0, jobs=1): err= 0: pid=245614: Tue Nov 26 23:12:43 2024 00:20:19.167 read: IOPS=487, BW=122MiB/s (128MB/s)(1229MiB/10076msec) 00:20:19.167 slat (usec): min=9, max=107998, avg=1739.27, stdev=6239.36 00:20:19.167 clat (msec): min=7, max=300, avg=129.39, stdev=55.05 00:20:19.167 lat (msec): min=7, max=316, avg=131.13, stdev=56.04 00:20:19.167 clat percentiles (msec): 00:20:19.167 | 1.00th=[ 31], 5.00th=[ 58], 10.00th=[ 63], 20.00th=[ 71], 00:20:19.167 | 30.00th=[ 97], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 142], 00:20:19.167 | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 211], 95.00th=[ 228], 00:20:19.167 | 99.00th=[ 268], 99.50th=[ 275], 99.90th=[ 292], 99.95th=[ 292], 00:20:19.167 | 99.99th=[ 300] 00:20:19.167 bw ( KiB/s): min=67072, max=248320, per=6.10%, avg=124168.70, stdev=49372.70, samples=20 00:20:19.167 iops : min= 262, max= 970, avg=485.00, stdev=192.89, samples=20 00:20:19.167 lat (msec) : 10=0.20%, 20=0.35%, 50=2.75%, 100=27.90%, 250=67.24% 00:20:19.167 lat (msec) : 500=1.57% 00:20:19.167 cpu : usr=0.37%, sys=1.53%, ctx=986, majf=0, minf=4097 00:20:19.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:19.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.167 issued rwts: total=4914,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.167 job4: (groupid=0, jobs=1): err= 0: pid=245615: Tue Nov 26 23:12:43 2024 00:20:19.167 read: IOPS=481, BW=120MiB/s (126MB/s)(1215MiB/10084msec) 00:20:19.167 slat (usec): min=9, max=88582, avg=1628.39, stdev=5594.19 00:20:19.167 clat (msec): min=7, max=314, avg=131.07, stdev=55.72 00:20:19.167 lat (msec): min=8, max=314, avg=132.69, stdev=56.51 00:20:19.167 clat percentiles (msec): 00:20:19.167 | 1.00th=[ 21], 5.00th=[ 47], 10.00th=[ 55], 20.00th=[ 75], 00:20:19.167 | 30.00th=[ 103], 40.00th=[ 122], 50.00th=[ 132], 60.00th=[ 142], 00:20:19.167 | 70.00th=[ 153], 80.00th=[ 182], 90.00th=[ 213], 95.00th=[ 228], 00:20:19.167 | 99.00th=[ 255], 99.50th=[ 262], 99.90th=[ 292], 99.95th=[ 305], 00:20:19.167 | 99.99th=[ 313] 00:20:19.167 bw ( KiB/s): min=70656, max=236032, per=6.03%, avg=122760.90, stdev=44584.59, samples=20 00:20:19.167 iops : min= 276, max= 922, avg=479.50, stdev=174.19, samples=20 00:20:19.167 lat (msec) : 10=0.04%, 20=0.86%, 50=6.77%, 100=21.11%, 250=69.77% 00:20:19.167 lat (msec) : 500=1.44% 00:20:19.167 cpu : usr=0.28%, sys=1.58%, ctx=1089, majf=0, minf=4097 00:20:19.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:19.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.167 issued rwts: total=4860,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.167 job5: (groupid=0, jobs=1): err= 0: pid=245617: Tue Nov 26 23:12:43 2024 00:20:19.167 read: IOPS=735, BW=184MiB/s (193MB/s)(1862MiB/10122msec) 00:20:19.167 slat (usec): min=13, max=109387, avg=1266.61, stdev=5104.99 00:20:19.167 clat (msec): min=8, max=322, avg=85.65, stdev=60.31 00:20:19.167 lat (msec): min=8, max=334, avg=86.92, stdev=61.31 00:20:19.167 clat percentiles (msec): 00:20:19.167 | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 31], 00:20:19.167 | 30.00th=[ 40], 40.00th=[ 50], 50.00th=[ 66], 60.00th=[ 93], 00:20:19.167 | 70.00th=[ 107], 80.00th=[ 131], 90.00th=[ 174], 95.00th=[ 215], 00:20:19.167 | 99.00th=[ 264], 99.50th=[ 279], 99.90th=[ 317], 99.95th=[ 317], 00:20:19.167 | 99.99th=[ 321] 00:20:19.167 bw ( KiB/s): min=69632, max=550400, per=9.28%, avg=188984.10, stdev=132275.87, samples=20 00:20:19.167 iops : min= 272, max= 2150, avg=738.15, stdev=516.63, samples=20 00:20:19.167 lat (msec) : 10=0.04%, 20=0.87%, 50=39.29%, 100=24.92%, 250=33.21% 00:20:19.167 lat (msec) : 500=1.67% 00:20:19.167 cpu : usr=0.28%, sys=2.66%, ctx=1299, majf=0, minf=4097 00:20:19.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:19.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.167 issued rwts: total=7447,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.167 job6: (groupid=0, jobs=1): err= 0: pid=245618: Tue Nov 26 23:12:43 2024 00:20:19.167 read: IOPS=915, BW=229MiB/s (240MB/s)(2307MiB/10082msec) 00:20:19.167 slat (usec): min=9, max=122197, avg=930.30, stdev=3391.35 00:20:19.167 clat (msec): min=4, max=247, avg=68.93, stdev=38.59 00:20:19.167 lat (msec): min=4, max=247, avg=69.86, stdev=39.15 00:20:19.167 clat percentiles (msec): 00:20:19.167 | 1.00th=[ 12], 5.00th=[ 23], 10.00th=[ 31], 20.00th=[ 36], 00:20:19.167 | 30.00th=[ 43], 40.00th=[ 53], 50.00th=[ 64], 60.00th=[ 71], 00:20:19.167 | 70.00th=[ 80], 80.00th=[ 96], 90.00th=[ 130], 95.00th=[ 153], 00:20:19.167 | 99.00th=[ 182], 99.50th=[ 199], 99.90th=[ 211], 99.95th=[ 224], 00:20:19.167 | 99.99th=[ 247] 00:20:19.167 bw ( KiB/s): min=107520, max=380928, per=11.52%, avg=234591.30, stdev=88093.40, samples=20 00:20:19.167 iops : min= 420, max= 1488, avg=916.35, stdev=344.11, samples=20 00:20:19.167 lat (msec) : 10=0.62%, 20=3.60%, 50=32.91%, 100=45.36%, 250=17.52% 00:20:19.167 cpu : usr=0.51%, sys=2.79%, ctx=1662, majf=0, minf=4097 00:20:19.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:19.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.167 issued rwts: total=9229,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.167 job7: (groupid=0, jobs=1): err= 0: pid=245619: Tue Nov 26 23:12:43 2024 00:20:19.167 read: IOPS=758, BW=190MiB/s (199MB/s)(1912MiB/10081msec) 00:20:19.167 slat (usec): min=9, max=69242, avg=1014.84, stdev=3700.08 00:20:19.167 clat (msec): min=3, max=263, avg=83.27, stdev=44.19 00:20:19.167 lat (msec): min=3, max=268, avg=84.29, stdev=44.67 00:20:19.167 clat percentiles (msec): 00:20:19.167 | 1.00th=[ 11], 5.00th=[ 22], 10.00th=[ 37], 20.00th=[ 54], 00:20:19.167 | 30.00th=[ 62], 40.00th=[ 66], 50.00th=[ 71], 60.00th=[ 82], 00:20:19.167 | 70.00th=[ 94], 80.00th=[ 112], 90.00th=[ 150], 95.00th=[ 171], 00:20:19.167 | 99.00th=[ 211], 99.50th=[ 220], 99.90th=[ 243], 99.95th=[ 245], 00:20:19.167 | 99.99th=[ 264] 00:20:19.167 bw ( KiB/s): min=84992, max=291328, per=9.53%, avg=194176.45, stdev=72217.97, samples=20 00:20:19.167 iops : min= 332, max= 1138, avg=758.45, stdev=282.15, samples=20 00:20:19.167 lat (msec) : 4=0.01%, 10=0.82%, 20=3.69%, 50=13.34%, 100=57.71% 00:20:19.167 lat (msec) : 250=24.40%, 500=0.04% 00:20:19.167 cpu : usr=0.41%, sys=2.40%, ctx=1457, majf=0, minf=4097 00:20:19.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:19.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.168 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.168 issued rwts: total=7649,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.168 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.168 job8: (groupid=0, jobs=1): err= 0: pid=245621: Tue Nov 26 23:12:43 2024 00:20:19.168 read: IOPS=1599, BW=400MiB/s (419MB/s)(4001MiB/10008msec) 00:20:19.168 slat (usec): min=13, max=42665, avg=619.88, stdev=1751.29 00:20:19.168 clat (msec): min=6, max=111, avg=39.38, stdev=17.61 00:20:19.168 lat (msec): min=8, max=111, avg=40.00, stdev=17.84 00:20:19.168 clat percentiles (msec): 00:20:19.168 | 1.00th=[ 25], 5.00th=[ 27], 10.00th=[ 27], 20.00th=[ 28], 00:20:19.168 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 31], 60.00th=[ 32], 00:20:19.168 | 70.00th=[ 36], 80.00th=[ 55], 90.00th=[ 69], 95.00th=[ 79], 00:20:19.168 | 99.00th=[ 93], 99.50th=[ 96], 99.90th=[ 106], 99.95th=[ 108], 00:20:19.168 | 99.99th=[ 112] 00:20:19.168 bw ( KiB/s): min=216064, max=571904, per=19.72%, avg=401673.26, stdev=116893.92, samples=19 00:20:19.168 iops : min= 844, max= 2234, avg=1569.00, stdev=456.64, samples=19 00:20:19.168 lat (msec) : 10=0.03%, 20=0.13%, 50=76.45%, 100=23.13%, 250=0.25% 00:20:19.168 cpu : usr=0.87%, sys=4.99%, ctx=2834, majf=0, minf=4097 00:20:19.168 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:20:19.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.168 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.168 issued rwts: total=16003,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.168 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.168 job9: (groupid=0, jobs=1): err= 0: pid=245627: Tue Nov 26 23:12:43 2024 00:20:19.168 read: IOPS=588, BW=147MiB/s (154MB/s)(1483MiB/10076msec) 00:20:19.168 slat (usec): min=13, max=70323, avg=1521.26, stdev=4656.33 00:20:19.168 clat (msec): min=7, max=248, avg=107.12, stdev=41.43 00:20:19.168 lat (msec): min=8, max=273, avg=108.64, stdev=42.18 00:20:19.168 clat percentiles (msec): 00:20:19.168 | 1.00th=[ 21], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 75], 00:20:19.168 | 30.00th=[ 82], 40.00th=[ 90], 50.00th=[ 100], 60.00th=[ 110], 00:20:19.168 | 70.00th=[ 122], 80.00th=[ 144], 90.00th=[ 163], 95.00th=[ 190], 00:20:19.168 | 99.00th=[ 224], 99.50th=[ 230], 99.90th=[ 247], 99.95th=[ 247], 00:20:19.168 | 99.99th=[ 249] 00:20:19.168 bw ( KiB/s): min=71025, max=228352, per=7.37%, avg=150191.20, stdev=48729.19, samples=20 00:20:19.168 iops : min= 277, max= 892, avg=586.65, stdev=190.37, samples=20 00:20:19.168 lat (msec) : 10=0.02%, 20=0.99%, 50=3.02%, 100=46.86%, 250=49.11% 00:20:19.168 cpu : usr=0.28%, sys=2.15%, ctx=1170, majf=0, minf=4097 00:20:19.168 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:19.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.168 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.168 issued rwts: total=5931,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.168 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.168 job10: (groupid=0, jobs=1): err= 0: pid=245628: Tue Nov 26 23:12:43 2024 00:20:19.168 read: IOPS=742, BW=186MiB/s (195MB/s)(1870MiB/10077msec) 00:20:19.168 slat (usec): min=13, max=87008, avg=1300.70, stdev=3993.06 00:20:19.168 clat (usec): min=1369, max=281104, avg=84871.49, stdev=37118.15 00:20:19.168 lat (usec): min=1392, max=281144, avg=86172.19, stdev=37694.15 00:20:19.168 clat percentiles (msec): 00:20:19.168 | 1.00th=[ 24], 5.00th=[ 34], 10.00th=[ 50], 20.00th=[ 61], 00:20:19.168 | 30.00th=[ 67], 40.00th=[ 72], 50.00th=[ 79], 60.00th=[ 84], 00:20:19.168 | 70.00th=[ 91], 80.00th=[ 105], 90.00th=[ 127], 95.00th=[ 176], 00:20:19.168 | 99.00th=[ 215], 99.50th=[ 224], 99.90th=[ 236], 99.95th=[ 251], 00:20:19.168 | 99.99th=[ 284] 00:20:19.168 bw ( KiB/s): min=74240, max=316928, per=9.32%, avg=189768.40, stdev=60244.71, samples=20 00:20:19.168 iops : min= 290, max= 1238, avg=741.25, stdev=235.36, samples=20 00:20:19.168 lat (msec) : 2=0.01%, 10=0.09%, 20=0.62%, 50=9.39%, 100=66.27% 00:20:19.168 lat (msec) : 250=23.56%, 500=0.05% 00:20:19.168 cpu : usr=0.46%, sys=2.66%, ctx=1337, majf=0, minf=4097 00:20:19.168 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:19.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.168 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.168 issued rwts: total=7478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.168 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.168 00:20:19.168 Run status group 0 (all jobs): 00:20:19.168 READ: bw=1989MiB/s (2086MB/s), 120MiB/s-400MiB/s (126MB/s-419MB/s), io=19.7GiB (21.1GB), run=10008-10122msec 00:20:19.168 00:20:19.168 Disk stats (read/write): 00:20:19.168 nvme0n1: ios=12360/0, merge=0/0, ticks=1227734/0, in_queue=1227734, util=97.16% 00:20:19.168 nvme10n1: ios=11004/0, merge=0/0, ticks=1235953/0, in_queue=1235953, util=97.38% 00:20:19.168 nvme1n1: ios=10060/0, merge=0/0, ticks=1232750/0, in_queue=1232750, util=97.69% 00:20:19.168 nvme2n1: ios=9621/0, merge=0/0, ticks=1229786/0, in_queue=1229786, util=97.86% 00:20:19.168 nvme3n1: ios=9569/0, merge=0/0, ticks=1230919/0, in_queue=1230919, util=97.94% 00:20:19.168 nvme4n1: ios=14717/0, merge=0/0, ticks=1223773/0, in_queue=1223773, util=98.28% 00:20:19.168 nvme5n1: ios=18241/0, merge=0/0, ticks=1236457/0, in_queue=1236457, util=98.43% 00:20:19.168 nvme6n1: ios=15095/0, merge=0/0, ticks=1236313/0, in_queue=1236313, util=98.54% 00:20:19.168 nvme7n1: ios=31573/0, merge=0/0, ticks=1236010/0, in_queue=1236010, util=98.93% 00:20:19.168 nvme8n1: ios=11645/0, merge=0/0, ticks=1234286/0, in_queue=1234286, util=99.12% 00:20:19.168 nvme9n1: ios=14731/0, merge=0/0, ticks=1234506/0, in_queue=1234506, util=99.25% 00:20:19.168 23:12:43 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:19.168 [global] 00:20:19.168 thread=1 00:20:19.168 invalidate=1 00:20:19.168 rw=randwrite 00:20:19.168 time_based=1 00:20:19.168 runtime=10 00:20:19.168 ioengine=libaio 00:20:19.168 direct=1 00:20:19.168 bs=262144 00:20:19.168 iodepth=64 00:20:19.168 norandommap=1 00:20:19.168 numjobs=1 00:20:19.168 00:20:19.168 [job0] 00:20:19.168 filename=/dev/nvme0n1 00:20:19.168 [job1] 00:20:19.168 filename=/dev/nvme10n1 00:20:19.168 [job2] 00:20:19.168 filename=/dev/nvme1n1 00:20:19.168 [job3] 00:20:19.168 filename=/dev/nvme2n1 00:20:19.168 [job4] 00:20:19.168 filename=/dev/nvme3n1 00:20:19.168 [job5] 00:20:19.168 filename=/dev/nvme4n1 00:20:19.168 [job6] 00:20:19.168 filename=/dev/nvme5n1 00:20:19.168 [job7] 00:20:19.168 filename=/dev/nvme6n1 00:20:19.168 [job8] 00:20:19.168 filename=/dev/nvme7n1 00:20:19.168 [job9] 00:20:19.168 filename=/dev/nvme8n1 00:20:19.168 [job10] 00:20:19.168 filename=/dev/nvme9n1 00:20:19.168 Could not set queue depth (nvme0n1) 00:20:19.168 Could not set queue depth (nvme10n1) 00:20:19.168 Could not set queue depth (nvme1n1) 00:20:19.168 Could not set queue depth (nvme2n1) 00:20:19.168 Could not set queue depth (nvme3n1) 00:20:19.168 Could not set queue depth (nvme4n1) 00:20:19.168 Could not set queue depth (nvme5n1) 00:20:19.168 Could not set queue depth (nvme6n1) 00:20:19.168 Could not set queue depth (nvme7n1) 00:20:19.168 Could not set queue depth (nvme8n1) 00:20:19.168 Could not set queue depth (nvme9n1) 00:20:19.168 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.168 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.168 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.168 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.168 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.169 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.169 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.169 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.169 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.169 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.169 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:19.169 fio-3.35 00:20:19.169 Starting 11 threads 00:20:29.137 00:20:29.137 job0: (groupid=0, jobs=1): err= 0: pid=246667: Tue Nov 26 23:12:54 2024 00:20:29.137 write: IOPS=531, BW=133MiB/s (139MB/s)(1344MiB/10109msec); 0 zone resets 00:20:29.137 slat (usec): min=16, max=46904, avg=1548.67, stdev=3486.68 00:20:29.137 clat (usec): min=1078, max=258776, avg=118740.35, stdev=51021.81 00:20:29.137 lat (usec): min=1123, max=258844, avg=120289.03, stdev=51703.43 00:20:29.137 clat percentiles (msec): 00:20:29.137 | 1.00th=[ 6], 5.00th=[ 24], 10.00th=[ 51], 20.00th=[ 77], 00:20:29.137 | 30.00th=[ 90], 40.00th=[ 113], 50.00th=[ 122], 60.00th=[ 136], 00:20:29.137 | 70.00th=[ 144], 80.00th=[ 155], 90.00th=[ 186], 95.00th=[ 209], 00:20:29.137 | 99.00th=[ 236], 99.50th=[ 245], 99.90th=[ 257], 99.95th=[ 259], 00:20:29.137 | 99.99th=[ 259] 00:20:29.137 bw ( KiB/s): min=71680, max=227840, per=9.56%, avg=136026.30, stdev=40179.70, samples=20 00:20:29.138 iops : min= 280, max= 890, avg=531.35, stdev=156.95, samples=20 00:20:29.138 lat (msec) : 2=0.13%, 4=0.43%, 10=1.97%, 20=1.67%, 50=5.82% 00:20:29.138 lat (msec) : 100=25.33%, 250=64.36%, 500=0.28% 00:20:29.138 cpu : usr=1.63%, sys=1.81%, ctx=2312, majf=0, minf=1 00:20:29.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:29.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.138 issued rwts: total=0,5376,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.138 job1: (groupid=0, jobs=1): err= 0: pid=246679: Tue Nov 26 23:12:54 2024 00:20:29.138 write: IOPS=446, BW=112MiB/s (117MB/s)(1129MiB/10108msec); 0 zone resets 00:20:29.138 slat (usec): min=22, max=90257, avg=1772.49, stdev=4620.86 00:20:29.138 clat (usec): min=891, max=288159, avg=141444.12, stdev=67974.87 00:20:29.138 lat (usec): min=934, max=288195, avg=143216.61, stdev=68849.65 00:20:29.138 clat percentiles (msec): 00:20:29.138 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 23], 20.00th=[ 89], 00:20:29.138 | 30.00th=[ 118], 40.00th=[ 127], 50.00th=[ 157], 60.00th=[ 178], 00:20:29.138 | 70.00th=[ 190], 80.00th=[ 201], 90.00th=[ 215], 95.00th=[ 226], 00:20:29.138 | 99.00th=[ 257], 99.50th=[ 271], 99.90th=[ 288], 99.95th=[ 288], 00:20:29.138 | 99.99th=[ 288] 00:20:29.138 bw ( KiB/s): min=74752, max=160768, per=8.01%, avg=113981.90, stdev=26839.12, samples=20 00:20:29.138 iops : min= 292, max= 628, avg=445.20, stdev=104.85, samples=20 00:20:29.138 lat (usec) : 1000=0.07% 00:20:29.138 lat (msec) : 2=0.58%, 4=1.90%, 10=3.77%, 20=2.79%, 50=6.22% 00:20:29.138 lat (msec) : 100=8.55%, 250=74.51%, 500=1.62% 00:20:29.138 cpu : usr=1.27%, sys=1.60%, ctx=2172, majf=0, minf=1 00:20:29.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:29.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.138 issued rwts: total=0,4515,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.138 job2: (groupid=0, jobs=1): err= 0: pid=246681: Tue Nov 26 23:12:54 2024 00:20:29.138 write: IOPS=477, BW=119MiB/s (125MB/s)(1214MiB/10159msec); 0 zone resets 00:20:29.138 slat (usec): min=22, max=126053, avg=1755.89, stdev=4635.21 00:20:29.138 clat (msec): min=3, max=331, avg=132.06, stdev=49.87 00:20:29.138 lat (msec): min=4, max=331, avg=133.82, stdev=50.58 00:20:29.138 clat percentiles (msec): 00:20:29.138 | 1.00th=[ 15], 5.00th=[ 43], 10.00th=[ 77], 20.00th=[ 96], 00:20:29.138 | 30.00th=[ 112], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 144], 00:20:29.138 | 70.00th=[ 150], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 218], 00:20:29.138 | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 305], 99.95th=[ 334], 00:20:29.138 | 99.99th=[ 334] 00:20:29.138 bw ( KiB/s): min=59392, max=207872, per=8.62%, avg=122635.95, stdev=33787.74, samples=20 00:20:29.138 iops : min= 232, max= 812, avg=479.00, stdev=131.99, samples=20 00:20:29.138 lat (msec) : 4=0.04%, 10=0.54%, 20=1.05%, 50=4.70%, 100=16.07% 00:20:29.138 lat (msec) : 250=75.83%, 500=1.77% 00:20:29.138 cpu : usr=1.42%, sys=1.70%, ctx=1985, majf=0, minf=1 00:20:29.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:29.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.138 issued rwts: total=0,4854,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.138 job3: (groupid=0, jobs=1): err= 0: pid=246682: Tue Nov 26 23:12:54 2024 00:20:29.138 write: IOPS=503, BW=126MiB/s (132MB/s)(1272MiB/10108msec); 0 zone resets 00:20:29.138 slat (usec): min=25, max=89311, avg=1600.24, stdev=3925.27 00:20:29.138 clat (msec): min=3, max=250, avg=125.49, stdev=52.47 00:20:29.138 lat (msec): min=4, max=250, avg=127.09, stdev=53.24 00:20:29.138 clat percentiles (msec): 00:20:29.138 | 1.00th=[ 16], 5.00th=[ 36], 10.00th=[ 55], 20.00th=[ 77], 00:20:29.138 | 30.00th=[ 86], 40.00th=[ 117], 50.00th=[ 131], 60.00th=[ 144], 00:20:29.138 | 70.00th=[ 157], 80.00th=[ 176], 90.00th=[ 192], 95.00th=[ 209], 00:20:29.138 | 99.00th=[ 239], 99.50th=[ 247], 99.90th=[ 251], 99.95th=[ 251], 00:20:29.138 | 99.99th=[ 251] 00:20:29.138 bw ( KiB/s): min=74240, max=218112, per=9.04%, avg=128598.05, stdev=38842.44, samples=20 00:20:29.138 iops : min= 290, max= 852, avg=502.30, stdev=151.76, samples=20 00:20:29.138 lat (msec) : 4=0.02%, 10=0.37%, 20=1.16%, 50=7.26%, 100=25.54% 00:20:29.138 lat (msec) : 250=65.59%, 500=0.06% 00:20:29.138 cpu : usr=1.71%, sys=1.57%, ctx=2173, majf=0, minf=1 00:20:29.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:29.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.138 issued rwts: total=0,5086,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.138 job4: (groupid=0, jobs=1): err= 0: pid=246683: Tue Nov 26 23:12:54 2024 00:20:29.138 write: IOPS=398, BW=99.6MiB/s (104MB/s)(1007MiB/10109msec); 0 zone resets 00:20:29.138 slat (usec): min=24, max=40171, avg=2357.15, stdev=4550.29 00:20:29.138 clat (msec): min=5, max=276, avg=158.27, stdev=44.63 00:20:29.138 lat (msec): min=6, max=276, avg=160.63, stdev=45.16 00:20:29.138 clat percentiles (msec): 00:20:29.138 | 1.00th=[ 36], 5.00th=[ 107], 10.00th=[ 114], 20.00th=[ 117], 00:20:29.138 | 30.00th=[ 127], 40.00th=[ 150], 50.00th=[ 161], 60.00th=[ 169], 00:20:29.138 | 70.00th=[ 182], 80.00th=[ 192], 90.00th=[ 218], 95.00th=[ 236], 00:20:29.138 | 99.00th=[ 264], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], 00:20:29.138 | 99.99th=[ 275] 00:20:29.138 bw ( KiB/s): min=69632, max=143360, per=7.13%, avg=101465.80, stdev=25223.07, samples=20 00:20:29.138 iops : min= 272, max= 560, avg=396.35, stdev=98.53, samples=20 00:20:29.138 lat (msec) : 10=0.02%, 20=0.27%, 50=1.89%, 100=1.69%, 250=93.91% 00:20:29.138 lat (msec) : 500=2.21% 00:20:29.138 cpu : usr=1.10%, sys=1.37%, ctx=1194, majf=0, minf=1 00:20:29.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:20:29.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.138 issued rwts: total=0,4026,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.138 job5: (groupid=0, jobs=1): err= 0: pid=246684: Tue Nov 26 23:12:54 2024 00:20:29.138 write: IOPS=700, BW=175MiB/s (184MB/s)(1778MiB/10156msec); 0 zone resets 00:20:29.138 slat (usec): min=18, max=48824, avg=1173.51, stdev=3036.14 00:20:29.138 clat (usec): min=779, max=309454, avg=89912.11, stdev=59421.12 00:20:29.138 lat (usec): min=826, max=309484, avg=91085.61, stdev=60112.90 00:20:29.138 clat percentiles (msec): 00:20:29.138 | 1.00th=[ 6], 5.00th=[ 18], 10.00th=[ 39], 20.00th=[ 42], 00:20:29.138 | 30.00th=[ 46], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 105], 00:20:29.138 | 70.00th=[ 120], 80.00th=[ 150], 90.00th=[ 184], 95.00th=[ 201], 00:20:29.138 | 99.00th=[ 224], 99.50th=[ 247], 99.90th=[ 292], 99.95th=[ 300], 00:20:29.138 | 99.99th=[ 309] 00:20:29.138 bw ( KiB/s): min=82432, max=384000, per=12.69%, avg=180500.90, stdev=95711.52, samples=20 00:20:29.138 iops : min= 322, max= 1500, avg=705.05, stdev=373.86, samples=20 00:20:29.138 lat (usec) : 1000=0.15% 00:20:29.138 lat (msec) : 2=0.24%, 4=0.20%, 10=2.49%, 20=2.26%, 50=40.05% 00:20:29.138 lat (msec) : 100=13.79%, 250=40.38%, 500=0.44% 00:20:29.138 cpu : usr=2.05%, sys=2.44%, ctx=2918, majf=0, minf=1 00:20:29.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:29.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.138 issued rwts: total=0,7113,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.138 job6: (groupid=0, jobs=1): err= 0: pid=246685: Tue Nov 26 23:12:54 2024 00:20:29.138 write: IOPS=417, BW=104MiB/s (109MB/s)(1060MiB/10155msec); 0 zone resets 00:20:29.138 slat (usec): min=19, max=94668, avg=2194.50, stdev=4714.60 00:20:29.138 clat (msec): min=4, max=328, avg=151.04, stdev=59.39 00:20:29.139 lat (msec): min=4, max=328, avg=153.24, stdev=60.14 00:20:29.139 clat percentiles (msec): 00:20:29.139 | 1.00th=[ 17], 5.00th=[ 49], 10.00th=[ 51], 20.00th=[ 113], 00:20:29.139 | 30.00th=[ 118], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 169], 00:20:29.139 | 70.00th=[ 182], 80.00th=[ 192], 90.00th=[ 228], 95.00th=[ 247], 00:20:29.139 | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 309], 99.95th=[ 313], 00:20:29.139 | 99.99th=[ 330] 00:20:29.139 bw ( KiB/s): min=67584, max=266773, per=7.52%, avg=106932.25, stdev=43587.34, samples=20 00:20:29.139 iops : min= 264, max= 1042, avg=417.70, stdev=170.25, samples=20 00:20:29.139 lat (msec) : 10=0.31%, 20=1.01%, 50=7.74%, 100=6.65%, 250=79.92% 00:20:29.139 lat (msec) : 500=4.36% 00:20:29.139 cpu : usr=1.45%, sys=1.15%, ctx=1359, majf=0, minf=1 00:20:29.139 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:29.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.139 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.139 issued rwts: total=0,4239,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.139 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.139 job7: (groupid=0, jobs=1): err= 0: pid=246686: Tue Nov 26 23:12:54 2024 00:20:29.139 write: IOPS=483, BW=121MiB/s (127MB/s)(1229MiB/10157msec); 0 zone resets 00:20:29.139 slat (usec): min=19, max=66762, avg=1601.32, stdev=3854.74 00:20:29.139 clat (usec): min=1008, max=308348, avg=130614.83, stdev=61383.41 00:20:29.139 lat (usec): min=1046, max=308380, avg=132216.14, stdev=62171.13 00:20:29.139 clat percentiles (msec): 00:20:29.139 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 33], 20.00th=[ 88], 00:20:29.139 | 30.00th=[ 109], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 144], 00:20:29.139 | 70.00th=[ 153], 80.00th=[ 182], 90.00th=[ 211], 95.00th=[ 236], 00:20:29.139 | 99.00th=[ 266], 99.50th=[ 279], 99.90th=[ 300], 99.95th=[ 300], 00:20:29.139 | 99.99th=[ 309] 00:20:29.139 bw ( KiB/s): min=76800, max=262656, per=8.73%, avg=124195.55, stdev=43433.42, samples=20 00:20:29.139 iops : min= 300, max= 1026, avg=485.10, stdev=169.69, samples=20 00:20:29.139 lat (msec) : 2=0.37%, 4=1.02%, 10=2.56%, 20=3.03%, 50=5.80% 00:20:29.139 lat (msec) : 100=11.54%, 250=73.24%, 500=2.44% 00:20:29.139 cpu : usr=1.46%, sys=1.67%, ctx=2385, majf=0, minf=1 00:20:29.139 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:29.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.139 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.139 issued rwts: total=0,4914,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.139 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.139 job8: (groupid=0, jobs=1): err= 0: pid=246687: Tue Nov 26 23:12:54 2024 00:20:29.139 write: IOPS=691, BW=173MiB/s (181MB/s)(1736MiB/10043msec); 0 zone resets 00:20:29.139 slat (usec): min=16, max=134219, avg=1220.52, stdev=3748.07 00:20:29.139 clat (usec): min=864, max=347817, avg=91276.62, stdev=62449.80 00:20:29.139 lat (usec): min=907, max=348392, avg=92497.14, stdev=63212.71 00:20:29.139 clat percentiles (msec): 00:20:29.139 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 30], 20.00th=[ 46], 00:20:29.139 | 30.00th=[ 48], 40.00th=[ 50], 50.00th=[ 61], 60.00th=[ 96], 00:20:29.139 | 70.00th=[ 126], 80.00th=[ 146], 90.00th=[ 184], 95.00th=[ 213], 00:20:29.139 | 99.00th=[ 271], 99.50th=[ 292], 99.90th=[ 330], 99.95th=[ 338], 00:20:29.139 | 99.99th=[ 347] 00:20:29.139 bw ( KiB/s): min=77824, max=361472, per=12.39%, avg=176162.95, stdev=93425.58, samples=20 00:20:29.139 iops : min= 304, max= 1412, avg=688.10, stdev=364.98, samples=20 00:20:29.139 lat (usec) : 1000=0.01% 00:20:29.139 lat (msec) : 2=0.19%, 4=0.58%, 10=2.10%, 20=3.02%, 50=37.95% 00:20:29.139 lat (msec) : 100=17.68%, 250=37.08%, 500=1.38% 00:20:29.139 cpu : usr=1.87%, sys=2.42%, ctx=2750, majf=0, minf=1 00:20:29.139 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:29.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.139 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.139 issued rwts: total=0,6944,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.139 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.139 job9: (groupid=0, jobs=1): err= 0: pid=246688: Tue Nov 26 23:12:54 2024 00:20:29.139 write: IOPS=412, BW=103MiB/s (108MB/s)(1042MiB/10108msec); 0 zone resets 00:20:29.139 slat (usec): min=20, max=36471, avg=1848.55, stdev=4002.10 00:20:29.139 clat (msec): min=2, max=272, avg=153.25, stdev=44.47 00:20:29.139 lat (msec): min=2, max=272, avg=155.10, stdev=44.76 00:20:29.139 clat percentiles (msec): 00:20:29.139 | 1.00th=[ 12], 5.00th=[ 93], 10.00th=[ 111], 20.00th=[ 116], 00:20:29.139 | 30.00th=[ 126], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 167], 00:20:29.139 | 70.00th=[ 178], 80.00th=[ 186], 90.00th=[ 203], 95.00th=[ 226], 00:20:29.139 | 99.00th=[ 257], 99.50th=[ 264], 99.90th=[ 271], 99.95th=[ 271], 00:20:29.139 | 99.99th=[ 271] 00:20:29.139 bw ( KiB/s): min=73728, max=143360, per=7.39%, avg=105074.75, stdev=22002.51, samples=20 00:20:29.139 iops : min= 288, max= 560, avg=410.40, stdev=85.90, samples=20 00:20:29.139 lat (msec) : 4=0.19%, 10=0.60%, 20=1.08%, 50=1.27%, 100=2.35% 00:20:29.139 lat (msec) : 250=93.04%, 500=1.46% 00:20:29.139 cpu : usr=1.36%, sys=1.31%, ctx=1689, majf=0, minf=1 00:20:29.139 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:29.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.139 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.139 issued rwts: total=0,4167,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.139 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.139 job10: (groupid=0, jobs=1): err= 0: pid=246689: Tue Nov 26 23:12:54 2024 00:20:29.139 write: IOPS=515, BW=129MiB/s (135MB/s)(1302MiB/10100msec); 0 zone resets 00:20:29.139 slat (usec): min=15, max=53899, avg=1443.44, stdev=3759.63 00:20:29.139 clat (usec): min=860, max=281007, avg=122667.91, stdev=67179.32 00:20:29.139 lat (usec): min=905, max=281042, avg=124111.35, stdev=68028.49 00:20:29.139 clat percentiles (msec): 00:20:29.139 | 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 16], 20.00th=[ 51], 00:20:29.139 | 30.00th=[ 84], 40.00th=[ 115], 50.00th=[ 127], 60.00th=[ 150], 00:20:29.139 | 70.00th=[ 171], 80.00th=[ 186], 90.00th=[ 207], 95.00th=[ 222], 00:20:29.139 | 99.00th=[ 245], 99.50th=[ 251], 99.90th=[ 262], 99.95th=[ 264], 00:20:29.139 | 99.99th=[ 279] 00:20:29.139 bw ( KiB/s): min=77824, max=253952, per=9.26%, avg=131660.80, stdev=47427.51, samples=20 00:20:29.139 iops : min= 304, max= 992, avg=514.30, stdev=185.26, samples=20 00:20:29.139 lat (usec) : 1000=0.06% 00:20:29.139 lat (msec) : 2=0.23%, 4=0.86%, 10=5.28%, 20=5.34%, 50=8.18% 00:20:29.139 lat (msec) : 100=13.39%, 250=66.02%, 500=0.63% 00:20:29.139 cpu : usr=1.73%, sys=1.32%, ctx=2712, majf=0, minf=1 00:20:29.139 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:29.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.139 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:29.139 issued rwts: total=0,5206,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.139 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:29.139 00:20:29.139 Run status group 0 (all jobs): 00:20:29.139 WRITE: bw=1389MiB/s (1456MB/s), 99.6MiB/s-175MiB/s (104MB/s-184MB/s), io=13.8GiB (14.8GB), run=10043-10159msec 00:20:29.139 00:20:29.139 Disk stats (read/write): 00:20:29.139 nvme0n1: ios=49/10566, merge=0/0, ticks=114/1214405, in_queue=1214519, util=98.17% 00:20:29.139 nvme10n1: ios=42/8845, merge=0/0, ticks=33/1215628, in_queue=1215661, util=97.58% 00:20:29.139 nvme1n1: ios=47/9529, merge=0/0, ticks=1666/1201111, in_queue=1202777, util=100.00% 00:20:29.140 nvme2n1: ios=49/9985, merge=0/0, ticks=956/1212801, in_queue=1213757, util=100.00% 00:20:29.140 nvme3n1: ios=46/7863, merge=0/0, ticks=68/1209494, in_queue=1209562, util=98.31% 00:20:29.140 nvme4n1: ios=44/14053, merge=0/0, ticks=1150/1207635, in_queue=1208785, util=100.00% 00:20:29.140 nvme5n1: ios=0/8307, merge=0/0, ticks=0/1208535, in_queue=1208535, util=98.34% 00:20:29.140 nvme6n1: ios=0/9655, merge=0/0, ticks=0/1216056, in_queue=1216056, util=98.45% 00:20:29.140 nvme7n1: ios=48/13582, merge=0/0, ticks=3396/1197963, in_queue=1201359, util=100.00% 00:20:29.140 nvme8n1: ios=38/8147, merge=0/0, ticks=1055/1217510, in_queue=1218565, util=100.00% 00:20:29.140 nvme9n1: ios=0/10219, merge=0/0, ticks=0/1218347, in_queue=1218347, util=99.12% 00:20:29.140 23:12:54 -- target/multiconnection.sh@36 -- # sync 00:20:29.140 23:12:54 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:29.140 23:12:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.140 23:12:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:29.140 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:29.140 23:12:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:29.140 23:12:54 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.140 23:12:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.140 23:12:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:29.140 23:12:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.140 23:12:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:29.140 23:12:54 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.140 23:12:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:29.140 23:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.140 23:12:54 -- common/autotest_common.sh@10 -- # set +x 00:20:29.140 23:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.140 23:12:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.140 23:12:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:29.140 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:29.140 23:12:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:29.140 23:12:55 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.140 23:12:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.140 23:12:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:29.140 23:12:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.140 23:12:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:29.140 23:12:55 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.140 23:12:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:29.140 23:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.140 23:12:55 -- common/autotest_common.sh@10 -- # set +x 00:20:29.140 23:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.140 23:12:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.140 23:12:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:29.398 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:29.398 23:12:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:29.398 23:12:55 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.398 23:12:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.398 23:12:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:29.398 23:12:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.398 23:12:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:29.398 23:12:55 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.398 23:12:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:29.398 23:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.398 23:12:55 -- common/autotest_common.sh@10 -- # set +x 00:20:29.398 23:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.398 23:12:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.398 23:12:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:29.656 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:29.656 23:12:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:29.656 23:12:55 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.656 23:12:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.656 23:12:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:29.656 23:12:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.656 23:12:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:29.656 23:12:55 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.656 23:12:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:29.656 23:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.656 23:12:55 -- common/autotest_common.sh@10 -- # set +x 00:20:29.656 23:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.656 23:12:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.656 23:12:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:29.656 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:29.656 23:12:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:29.656 23:12:55 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.656 23:12:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.656 23:12:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:29.656 23:12:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.656 23:12:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:29.656 23:12:55 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.656 23:12:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:29.656 23:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.656 23:12:55 -- common/autotest_common.sh@10 -- # set +x 00:20:29.656 23:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.656 23:12:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.656 23:12:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:29.914 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:29.914 23:12:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:29.914 23:12:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.914 23:12:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.914 23:12:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:29.914 23:12:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.914 23:12:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:29.914 23:12:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.914 23:12:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:29.914 23:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.914 23:12:56 -- common/autotest_common.sh@10 -- # set +x 00:20:29.914 23:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.914 23:12:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.914 23:12:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:30.172 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:30.172 23:12:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:30.172 23:12:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.172 23:12:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.172 23:12:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:30.172 23:12:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.172 23:12:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:30.172 23:12:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.172 23:12:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:30.172 23:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.172 23:12:56 -- common/autotest_common.sh@10 -- # set +x 00:20:30.172 23:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.172 23:12:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.172 23:12:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:30.430 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:30.430 23:12:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:30.430 23:12:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.430 23:12:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.430 23:12:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:30.430 23:12:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.430 23:12:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:30.430 23:12:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.430 23:12:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:30.430 23:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.430 23:12:56 -- common/autotest_common.sh@10 -- # set +x 00:20:30.430 23:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.430 23:12:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.430 23:12:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:30.430 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:30.430 23:12:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:30.430 23:12:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.430 23:12:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.430 23:12:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:30.430 23:12:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.430 23:12:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:30.430 23:12:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.430 23:12:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:30.430 23:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.430 23:12:56 -- common/autotest_common.sh@10 -- # set +x 00:20:30.430 23:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.430 23:12:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.430 23:12:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:30.430 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:30.688 23:12:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:30.688 23:12:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.688 23:12:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.688 23:12:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:30.688 23:12:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.688 23:12:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:30.688 23:12:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.688 23:12:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:30.688 23:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.688 23:12:56 -- common/autotest_common.sh@10 -- # set +x 00:20:30.688 23:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.688 23:12:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.688 23:12:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:30.688 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:30.688 23:12:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:30.688 23:12:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.688 23:12:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.688 23:12:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:30.688 23:12:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.688 23:12:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:30.688 23:12:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.688 23:12:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:30.688 23:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.688 23:12:56 -- common/autotest_common.sh@10 -- # set +x 00:20:30.688 23:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.688 23:12:56 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:30.688 23:12:56 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:30.688 23:12:56 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:30.688 23:12:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:30.688 23:12:56 -- nvmf/common.sh@116 -- # sync 00:20:30.688 23:12:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:30.688 23:12:56 -- nvmf/common.sh@119 -- # set +e 00:20:30.688 23:12:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:30.688 23:12:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:30.688 rmmod nvme_tcp 00:20:30.688 rmmod nvme_fabrics 00:20:30.688 rmmod nvme_keyring 00:20:30.688 23:12:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:30.688 23:12:56 -- nvmf/common.sh@123 -- # set -e 00:20:30.688 23:12:56 -- nvmf/common.sh@124 -- # return 0 00:20:30.688 23:12:56 -- nvmf/common.sh@477 -- # '[' -n 240416 ']' 00:20:30.688 23:12:56 -- nvmf/common.sh@478 -- # killprocess 240416 00:20:30.688 23:12:56 -- common/autotest_common.sh@936 -- # '[' -z 240416 ']' 00:20:30.688 23:12:56 -- common/autotest_common.sh@940 -- # kill -0 240416 00:20:30.688 23:12:56 -- common/autotest_common.sh@941 -- # uname 00:20:30.688 23:12:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.688 23:12:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 240416 00:20:30.689 23:12:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:30.689 23:12:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:30.689 23:12:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 240416' 00:20:30.689 killing process with pid 240416 00:20:30.689 23:12:57 -- common/autotest_common.sh@955 -- # kill 240416 00:20:30.689 23:12:57 -- common/autotest_common.sh@960 -- # wait 240416 00:20:31.255 23:12:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:31.255 23:12:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:31.255 23:12:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:31.255 23:12:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:31.255 23:12:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:31.255 23:12:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:31.255 23:12:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:31.255 23:12:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:33.790 23:12:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:33.790 00:20:33.790 real 1m1.348s 00:20:33.790 user 3m24.495s 00:20:33.790 sys 0m25.987s 00:20:33.790 23:12:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:33.790 23:12:59 -- common/autotest_common.sh@10 -- # set +x 00:20:33.790 ************************************ 00:20:33.791 END TEST nvmf_multiconnection 00:20:33.791 ************************************ 00:20:33.791 23:12:59 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:33.791 23:12:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:33.791 23:12:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:33.791 23:12:59 -- common/autotest_common.sh@10 -- # set +x 00:20:33.791 ************************************ 00:20:33.791 START TEST nvmf_initiator_timeout 00:20:33.791 ************************************ 00:20:33.791 23:12:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:33.791 * Looking for test storage... 00:20:33.791 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:33.791 23:12:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:33.791 23:12:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:33.791 23:12:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:33.791 23:12:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:33.791 23:12:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:33.791 23:12:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:33.791 23:12:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:33.791 23:12:59 -- scripts/common.sh@335 -- # IFS=.-: 00:20:33.791 23:12:59 -- scripts/common.sh@335 -- # read -ra ver1 00:20:33.791 23:12:59 -- scripts/common.sh@336 -- # IFS=.-: 00:20:33.791 23:12:59 -- scripts/common.sh@336 -- # read -ra ver2 00:20:33.791 23:12:59 -- scripts/common.sh@337 -- # local 'op=<' 00:20:33.791 23:12:59 -- scripts/common.sh@339 -- # ver1_l=2 00:20:33.791 23:12:59 -- scripts/common.sh@340 -- # ver2_l=1 00:20:33.791 23:12:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:33.791 23:12:59 -- scripts/common.sh@343 -- # case "$op" in 00:20:33.791 23:12:59 -- scripts/common.sh@344 -- # : 1 00:20:33.791 23:12:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:33.791 23:12:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:33.791 23:12:59 -- scripts/common.sh@364 -- # decimal 1 00:20:33.791 23:12:59 -- scripts/common.sh@352 -- # local d=1 00:20:33.791 23:12:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:33.791 23:12:59 -- scripts/common.sh@354 -- # echo 1 00:20:33.791 23:12:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:33.791 23:12:59 -- scripts/common.sh@365 -- # decimal 2 00:20:33.791 23:12:59 -- scripts/common.sh@352 -- # local d=2 00:20:33.791 23:12:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:33.791 23:12:59 -- scripts/common.sh@354 -- # echo 2 00:20:33.791 23:12:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:33.791 23:12:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:33.791 23:12:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:33.791 23:12:59 -- scripts/common.sh@367 -- # return 0 00:20:33.791 23:12:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:33.791 23:12:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:33.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:33.791 --rc genhtml_branch_coverage=1 00:20:33.791 --rc genhtml_function_coverage=1 00:20:33.791 --rc genhtml_legend=1 00:20:33.791 --rc geninfo_all_blocks=1 00:20:33.791 --rc geninfo_unexecuted_blocks=1 00:20:33.791 00:20:33.791 ' 00:20:33.791 23:12:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:33.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:33.791 --rc genhtml_branch_coverage=1 00:20:33.791 --rc genhtml_function_coverage=1 00:20:33.791 --rc genhtml_legend=1 00:20:33.791 --rc geninfo_all_blocks=1 00:20:33.791 --rc geninfo_unexecuted_blocks=1 00:20:33.791 00:20:33.791 ' 00:20:33.791 23:12:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:33.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:33.791 --rc genhtml_branch_coverage=1 00:20:33.791 --rc genhtml_function_coverage=1 00:20:33.791 --rc genhtml_legend=1 00:20:33.791 --rc geninfo_all_blocks=1 00:20:33.791 --rc geninfo_unexecuted_blocks=1 00:20:33.791 00:20:33.791 ' 00:20:33.791 23:12:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:33.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:33.791 --rc genhtml_branch_coverage=1 00:20:33.791 --rc genhtml_function_coverage=1 00:20:33.791 --rc genhtml_legend=1 00:20:33.791 --rc geninfo_all_blocks=1 00:20:33.791 --rc geninfo_unexecuted_blocks=1 00:20:33.791 00:20:33.791 ' 00:20:33.791 23:12:59 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:33.791 23:12:59 -- nvmf/common.sh@7 -- # uname -s 00:20:33.791 23:12:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:33.791 23:12:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:33.791 23:12:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:33.791 23:12:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:33.791 23:12:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:33.791 23:12:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:33.791 23:12:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:33.791 23:12:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:33.791 23:12:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:33.791 23:12:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:33.791 23:12:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:33.791 23:12:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:33.791 23:12:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:33.791 23:12:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:33.791 23:12:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:33.791 23:12:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:33.791 23:12:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:33.791 23:12:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:33.791 23:12:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:33.791 23:12:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:33.791 23:12:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:33.792 23:12:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:33.792 23:12:59 -- paths/export.sh@5 -- # export PATH 00:20:33.792 23:12:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:33.792 23:12:59 -- nvmf/common.sh@46 -- # : 0 00:20:33.792 23:12:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:33.792 23:12:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:33.792 23:12:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:33.792 23:12:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:33.792 23:12:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:33.792 23:12:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:33.792 23:12:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:33.792 23:12:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:33.792 23:12:59 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:33.792 23:12:59 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:33.792 23:12:59 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:33.792 23:12:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:33.792 23:12:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:33.792 23:12:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:33.792 23:12:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:33.792 23:12:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:33.792 23:12:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:33.792 23:12:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:33.792 23:12:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:33.792 23:12:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:33.792 23:12:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:33.792 23:12:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:33.792 23:12:59 -- common/autotest_common.sh@10 -- # set +x 00:20:35.695 23:13:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:35.695 23:13:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:35.695 23:13:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:35.695 23:13:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:35.695 23:13:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:35.695 23:13:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:35.695 23:13:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:35.695 23:13:01 -- nvmf/common.sh@294 -- # net_devs=() 00:20:35.695 23:13:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:35.695 23:13:01 -- nvmf/common.sh@295 -- # e810=() 00:20:35.695 23:13:01 -- nvmf/common.sh@295 -- # local -ga e810 00:20:35.695 23:13:01 -- nvmf/common.sh@296 -- # x722=() 00:20:35.695 23:13:01 -- nvmf/common.sh@296 -- # local -ga x722 00:20:35.695 23:13:01 -- nvmf/common.sh@297 -- # mlx=() 00:20:35.695 23:13:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:35.695 23:13:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:35.695 23:13:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:35.695 23:13:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:35.695 23:13:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:35.695 23:13:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:35.695 23:13:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:35.695 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:35.695 23:13:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:35.695 23:13:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:35.695 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:35.695 23:13:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:35.695 23:13:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:35.695 23:13:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:35.695 23:13:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:35.695 23:13:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:35.695 23:13:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:35.695 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:35.695 23:13:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:35.695 23:13:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:35.695 23:13:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:35.695 23:13:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:35.695 23:13:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:35.695 23:13:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:35.695 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:35.695 23:13:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:35.695 23:13:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:35.695 23:13:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:35.695 23:13:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:35.695 23:13:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:35.695 23:13:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:35.695 23:13:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:35.695 23:13:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:35.695 23:13:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:35.695 23:13:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:35.695 23:13:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:35.695 23:13:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:35.695 23:13:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:35.695 23:13:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:35.695 23:13:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:35.695 23:13:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:35.695 23:13:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:35.695 23:13:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:35.695 23:13:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:35.695 23:13:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:35.695 23:13:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:35.695 23:13:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:35.695 23:13:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:35.695 23:13:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:35.695 23:13:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:35.695 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:35.695 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:20:35.695 00:20:35.695 --- 10.0.0.2 ping statistics --- 00:20:35.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:35.695 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:20:35.695 23:13:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:35.695 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:35.695 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:20:35.695 00:20:35.695 --- 10.0.0.1 ping statistics --- 00:20:35.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:35.696 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:20:35.696 23:13:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:35.696 23:13:01 -- nvmf/common.sh@410 -- # return 0 00:20:35.696 23:13:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:35.696 23:13:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:35.696 23:13:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:35.696 23:13:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:35.696 23:13:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:35.696 23:13:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:35.696 23:13:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:35.696 23:13:01 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:35.696 23:13:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:35.696 23:13:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:35.696 23:13:01 -- common/autotest_common.sh@10 -- # set +x 00:20:35.696 23:13:01 -- nvmf/common.sh@469 -- # nvmfpid=250100 00:20:35.696 23:13:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:35.696 23:13:01 -- nvmf/common.sh@470 -- # waitforlisten 250100 00:20:35.696 23:13:01 -- common/autotest_common.sh@829 -- # '[' -z 250100 ']' 00:20:35.696 23:13:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:35.696 23:13:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:35.696 23:13:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:35.696 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:35.696 23:13:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:35.696 23:13:01 -- common/autotest_common.sh@10 -- # set +x 00:20:35.696 [2024-11-26 23:13:02.023178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:35.696 [2024-11-26 23:13:02.023262] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:35.696 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.954 [2024-11-26 23:13:02.104780] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:35.954 [2024-11-26 23:13:02.223029] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:35.954 [2024-11-26 23:13:02.223198] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:35.954 [2024-11-26 23:13:02.223217] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:35.954 [2024-11-26 23:13:02.223229] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:35.954 [2024-11-26 23:13:02.223297] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:35.954 [2024-11-26 23:13:02.223347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:35.954 [2024-11-26 23:13:02.223445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:35.954 [2024-11-26 23:13:02.223442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:36.889 23:13:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:36.889 23:13:02 -- common/autotest_common.sh@862 -- # return 0 00:20:36.889 23:13:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:36.889 23:13:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:36.889 23:13:02 -- common/autotest_common.sh@10 -- # set +x 00:20:36.889 23:13:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:36.889 23:13:03 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:36.889 23:13:03 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:36.889 23:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.889 23:13:03 -- common/autotest_common.sh@10 -- # set +x 00:20:36.889 Malloc0 00:20:36.889 23:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.889 23:13:03 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:36.889 23:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.889 23:13:03 -- common/autotest_common.sh@10 -- # set +x 00:20:36.889 Delay0 00:20:36.889 23:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.889 23:13:03 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:36.889 23:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.889 23:13:03 -- common/autotest_common.sh@10 -- # set +x 00:20:36.889 [2024-11-26 23:13:03.045101] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:36.889 23:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.889 23:13:03 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:36.889 23:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.889 23:13:03 -- common/autotest_common.sh@10 -- # set +x 00:20:36.889 23:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.889 23:13:03 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:36.889 23:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.889 23:13:03 -- common/autotest_common.sh@10 -- # set +x 00:20:36.889 23:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.889 23:13:03 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:36.889 23:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.889 23:13:03 -- common/autotest_common.sh@10 -- # set +x 00:20:36.889 [2024-11-26 23:13:03.073402] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:36.889 23:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.889 23:13:03 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:37.455 23:13:03 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:37.455 23:13:03 -- common/autotest_common.sh@1187 -- # local i=0 00:20:37.455 23:13:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:37.455 23:13:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:37.455 23:13:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:39.982 23:13:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:39.982 23:13:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:39.982 23:13:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:39.982 23:13:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:39.982 23:13:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:39.982 23:13:05 -- common/autotest_common.sh@1197 -- # return 0 00:20:39.982 23:13:05 -- target/initiator_timeout.sh@35 -- # fio_pid=250649 00:20:39.982 23:13:05 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:39.982 23:13:05 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:39.982 [global] 00:20:39.982 thread=1 00:20:39.982 invalidate=1 00:20:39.982 rw=write 00:20:39.982 time_based=1 00:20:39.982 runtime=60 00:20:39.982 ioengine=libaio 00:20:39.982 direct=1 00:20:39.982 bs=4096 00:20:39.982 iodepth=1 00:20:39.982 norandommap=0 00:20:39.982 numjobs=1 00:20:39.982 00:20:39.982 verify_dump=1 00:20:39.982 verify_backlog=512 00:20:39.982 verify_state_save=0 00:20:39.982 do_verify=1 00:20:39.982 verify=crc32c-intel 00:20:39.982 [job0] 00:20:39.982 filename=/dev/nvme0n1 00:20:39.982 Could not set queue depth (nvme0n1) 00:20:39.982 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:39.982 fio-3.35 00:20:39.982 Starting 1 thread 00:20:42.505 23:13:08 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:42.505 23:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:42.505 23:13:08 -- common/autotest_common.sh@10 -- # set +x 00:20:42.505 true 00:20:42.505 23:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:42.505 23:13:08 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:42.505 23:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:42.505 23:13:08 -- common/autotest_common.sh@10 -- # set +x 00:20:42.505 true 00:20:42.505 23:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:42.505 23:13:08 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:42.505 23:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:42.505 23:13:08 -- common/autotest_common.sh@10 -- # set +x 00:20:42.505 true 00:20:42.505 23:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:42.505 23:13:08 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:42.505 23:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:42.505 23:13:08 -- common/autotest_common.sh@10 -- # set +x 00:20:42.505 true 00:20:42.505 23:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:42.505 23:13:08 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:45.785 23:13:11 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:45.785 23:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:45.785 23:13:11 -- common/autotest_common.sh@10 -- # set +x 00:20:45.785 true 00:20:45.785 23:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:45.785 23:13:11 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:45.785 23:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:45.785 23:13:11 -- common/autotest_common.sh@10 -- # set +x 00:20:45.785 true 00:20:45.785 23:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:45.785 23:13:11 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:45.785 23:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:45.785 23:13:11 -- common/autotest_common.sh@10 -- # set +x 00:20:45.785 true 00:20:45.785 23:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:45.785 23:13:11 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:45.785 23:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:45.785 23:13:11 -- common/autotest_common.sh@10 -- # set +x 00:20:45.785 true 00:20:45.785 23:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:45.785 23:13:11 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:45.785 23:13:11 -- target/initiator_timeout.sh@54 -- # wait 250649 00:21:41.999 00:21:41.999 job0: (groupid=0, jobs=1): err= 0: pid=250724: Tue Nov 26 23:14:06 2024 00:21:41.999 read: IOPS=139, BW=556KiB/s (569kB/s)(32.6MiB/60018msec) 00:21:41.999 slat (nsec): min=5517, max=63385, avg=12188.88, stdev=6695.71 00:21:41.999 clat (usec): min=224, max=40837k, avg=6911.71, stdev=447147.24 00:21:41.999 lat (usec): min=230, max=40837k, avg=6923.90, stdev=447147.31 00:21:41.999 clat percentiles (usec): 00:21:41.999 | 1.00th=[ 237], 5.00th=[ 245], 10.00th=[ 249], 00:21:41.999 | 20.00th=[ 258], 30.00th=[ 265], 40.00th=[ 269], 00:21:41.999 | 50.00th=[ 277], 60.00th=[ 281], 70.00th=[ 289], 00:21:41.999 | 80.00th=[ 297], 90.00th=[ 318], 95.00th=[ 474], 00:21:41.999 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:21:41.999 | 99.95th=[ 42206], 99.99th=[17112761] 00:21:41.999 write: IOPS=145, BW=580KiB/s (594kB/s)(34.0MiB/60018msec); 0 zone resets 00:21:41.999 slat (usec): min=7, max=28387, avg=22.06, stdev=348.54 00:21:41.999 clat (usec): min=164, max=461, avg=228.63, stdev=42.72 00:21:41.999 lat (usec): min=173, max=28720, avg=250.69, stdev=353.39 00:21:41.999 clat percentiles (usec): 00:21:41.999 | 1.00th=[ 182], 5.00th=[ 188], 10.00th=[ 194], 20.00th=[ 200], 00:21:41.999 | 30.00th=[ 206], 40.00th=[ 212], 50.00th=[ 219], 60.00th=[ 227], 00:21:41.999 | 70.00th=[ 233], 80.00th=[ 245], 90.00th=[ 269], 95.00th=[ 326], 00:21:41.999 | 99.00th=[ 416], 99.50th=[ 429], 99.90th=[ 445], 99.95th=[ 449], 00:21:41.999 | 99.99th=[ 461] 00:21:41.999 bw ( KiB/s): min= 1568, max= 8536, per=100.00%, avg=5802.67, stdev=2369.56, samples=12 00:21:41.999 iops : min= 392, max= 2134, avg=1450.67, stdev=592.39, samples=12 00:21:41.999 lat (usec) : 250=47.61%, 500=50.15%, 750=0.16%, 1000=0.01% 00:21:41.999 lat (msec) : 50=2.07%, >=2000=0.01% 00:21:41.999 cpu : usr=0.29%, sys=0.55%, ctx=17051, majf=0, minf=1 00:21:41.999 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:41.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:41.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:41.999 issued rwts: total=8343,8704,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:41.999 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:41.999 00:21:41.999 Run status group 0 (all jobs): 00:21:41.999 READ: bw=556KiB/s (569kB/s), 556KiB/s-556KiB/s (569kB/s-569kB/s), io=32.6MiB (34.2MB), run=60018-60018msec 00:21:41.999 WRITE: bw=580KiB/s (594kB/s), 580KiB/s-580KiB/s (594kB/s-594kB/s), io=34.0MiB (35.7MB), run=60018-60018msec 00:21:41.999 00:21:41.999 Disk stats (read/write): 00:21:41.999 nvme0n1: ios=8392/8704, merge=0/0, ticks=17838/1894, in_queue=19732, util=99.76% 00:21:41.999 23:14:06 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:41.999 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:41.999 23:14:06 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:41.999 23:14:06 -- common/autotest_common.sh@1208 -- # local i=0 00:21:41.999 23:14:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:41.999 23:14:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:41.999 23:14:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:41.999 23:14:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:41.999 23:14:06 -- common/autotest_common.sh@1220 -- # return 0 00:21:41.999 23:14:06 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:41.999 23:14:06 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:41.999 nvmf hotplug test: fio successful as expected 00:21:41.999 23:14:06 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:41.999 23:14:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.999 23:14:06 -- common/autotest_common.sh@10 -- # set +x 00:21:41.999 23:14:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.999 23:14:06 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:41.999 23:14:06 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:41.999 23:14:06 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:41.999 23:14:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:41.999 23:14:06 -- nvmf/common.sh@116 -- # sync 00:21:41.999 23:14:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:41.999 23:14:06 -- nvmf/common.sh@119 -- # set +e 00:21:41.999 23:14:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:41.999 23:14:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:41.999 rmmod nvme_tcp 00:21:41.999 rmmod nvme_fabrics 00:21:41.999 rmmod nvme_keyring 00:21:41.999 23:14:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:41.999 23:14:06 -- nvmf/common.sh@123 -- # set -e 00:21:41.999 23:14:06 -- nvmf/common.sh@124 -- # return 0 00:21:41.999 23:14:06 -- nvmf/common.sh@477 -- # '[' -n 250100 ']' 00:21:41.999 23:14:06 -- nvmf/common.sh@478 -- # killprocess 250100 00:21:41.999 23:14:06 -- common/autotest_common.sh@936 -- # '[' -z 250100 ']' 00:21:41.999 23:14:06 -- common/autotest_common.sh@940 -- # kill -0 250100 00:21:41.999 23:14:06 -- common/autotest_common.sh@941 -- # uname 00:21:41.999 23:14:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:41.999 23:14:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 250100 00:21:41.999 23:14:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:41.999 23:14:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:41.999 23:14:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 250100' 00:21:41.999 killing process with pid 250100 00:21:41.999 23:14:06 -- common/autotest_common.sh@955 -- # kill 250100 00:21:41.999 23:14:06 -- common/autotest_common.sh@960 -- # wait 250100 00:21:41.999 23:14:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:41.999 23:14:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:41.999 23:14:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:41.999 23:14:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:41.999 23:14:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:41.999 23:14:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.999 23:14:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:41.999 23:14:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:42.566 23:14:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:42.566 00:21:42.566 real 1m9.107s 00:21:42.566 user 4m13.144s 00:21:42.566 sys 0m7.553s 00:21:42.566 23:14:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:42.566 23:14:08 -- common/autotest_common.sh@10 -- # set +x 00:21:42.566 ************************************ 00:21:42.566 END TEST nvmf_initiator_timeout 00:21:42.566 ************************************ 00:21:42.566 23:14:08 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:42.566 23:14:08 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:42.566 23:14:08 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:42.566 23:14:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:42.566 23:14:08 -- common/autotest_common.sh@10 -- # set +x 00:21:44.468 23:14:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:44.468 23:14:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:44.468 23:14:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:44.468 23:14:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:44.468 23:14:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:44.468 23:14:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:44.468 23:14:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:44.468 23:14:10 -- nvmf/common.sh@294 -- # net_devs=() 00:21:44.468 23:14:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:44.468 23:14:10 -- nvmf/common.sh@295 -- # e810=() 00:21:44.468 23:14:10 -- nvmf/common.sh@295 -- # local -ga e810 00:21:44.468 23:14:10 -- nvmf/common.sh@296 -- # x722=() 00:21:44.468 23:14:10 -- nvmf/common.sh@296 -- # local -ga x722 00:21:44.468 23:14:10 -- nvmf/common.sh@297 -- # mlx=() 00:21:44.468 23:14:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:44.468 23:14:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:44.468 23:14:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:44.468 23:14:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:44.468 23:14:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:44.468 23:14:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:44.468 23:14:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:44.468 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:44.468 23:14:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:44.468 23:14:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:44.468 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:44.468 23:14:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:44.468 23:14:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:44.468 23:14:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:44.468 23:14:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:44.468 23:14:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:44.468 23:14:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:44.468 23:14:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:44.468 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:44.468 23:14:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:44.468 23:14:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:44.468 23:14:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:44.468 23:14:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:44.468 23:14:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:44.468 23:14:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:44.468 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:44.468 23:14:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:44.468 23:14:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:44.468 23:14:10 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:44.468 23:14:10 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:44.468 23:14:10 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:44.468 23:14:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:44.468 23:14:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:44.468 23:14:10 -- common/autotest_common.sh@10 -- # set +x 00:21:44.468 ************************************ 00:21:44.468 START TEST nvmf_perf_adq 00:21:44.468 ************************************ 00:21:44.468 23:14:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:44.468 * Looking for test storage... 00:21:44.468 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:44.468 23:14:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:44.468 23:14:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:44.468 23:14:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:44.728 23:14:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:44.728 23:14:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:44.728 23:14:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:44.728 23:14:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:44.728 23:14:10 -- scripts/common.sh@335 -- # IFS=.-: 00:21:44.728 23:14:10 -- scripts/common.sh@335 -- # read -ra ver1 00:21:44.728 23:14:10 -- scripts/common.sh@336 -- # IFS=.-: 00:21:44.728 23:14:10 -- scripts/common.sh@336 -- # read -ra ver2 00:21:44.728 23:14:10 -- scripts/common.sh@337 -- # local 'op=<' 00:21:44.728 23:14:10 -- scripts/common.sh@339 -- # ver1_l=2 00:21:44.728 23:14:10 -- scripts/common.sh@340 -- # ver2_l=1 00:21:44.728 23:14:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:44.728 23:14:10 -- scripts/common.sh@343 -- # case "$op" in 00:21:44.728 23:14:10 -- scripts/common.sh@344 -- # : 1 00:21:44.728 23:14:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:44.728 23:14:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:44.728 23:14:10 -- scripts/common.sh@364 -- # decimal 1 00:21:44.728 23:14:10 -- scripts/common.sh@352 -- # local d=1 00:21:44.728 23:14:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:44.728 23:14:10 -- scripts/common.sh@354 -- # echo 1 00:21:44.728 23:14:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:44.728 23:14:10 -- scripts/common.sh@365 -- # decimal 2 00:21:44.728 23:14:10 -- scripts/common.sh@352 -- # local d=2 00:21:44.728 23:14:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:44.728 23:14:10 -- scripts/common.sh@354 -- # echo 2 00:21:44.728 23:14:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:44.728 23:14:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:44.728 23:14:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:44.728 23:14:10 -- scripts/common.sh@367 -- # return 0 00:21:44.728 23:14:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:44.728 23:14:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:44.728 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.728 --rc genhtml_branch_coverage=1 00:21:44.728 --rc genhtml_function_coverage=1 00:21:44.728 --rc genhtml_legend=1 00:21:44.728 --rc geninfo_all_blocks=1 00:21:44.728 --rc geninfo_unexecuted_blocks=1 00:21:44.728 00:21:44.728 ' 00:21:44.728 23:14:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:44.728 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.728 --rc genhtml_branch_coverage=1 00:21:44.728 --rc genhtml_function_coverage=1 00:21:44.728 --rc genhtml_legend=1 00:21:44.728 --rc geninfo_all_blocks=1 00:21:44.728 --rc geninfo_unexecuted_blocks=1 00:21:44.728 00:21:44.728 ' 00:21:44.728 23:14:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:44.728 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.728 --rc genhtml_branch_coverage=1 00:21:44.728 --rc genhtml_function_coverage=1 00:21:44.728 --rc genhtml_legend=1 00:21:44.728 --rc geninfo_all_blocks=1 00:21:44.728 --rc geninfo_unexecuted_blocks=1 00:21:44.728 00:21:44.728 ' 00:21:44.728 23:14:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:44.728 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.728 --rc genhtml_branch_coverage=1 00:21:44.728 --rc genhtml_function_coverage=1 00:21:44.728 --rc genhtml_legend=1 00:21:44.728 --rc geninfo_all_blocks=1 00:21:44.728 --rc geninfo_unexecuted_blocks=1 00:21:44.728 00:21:44.728 ' 00:21:44.728 23:14:10 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:44.728 23:14:10 -- nvmf/common.sh@7 -- # uname -s 00:21:44.728 23:14:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:44.728 23:14:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:44.728 23:14:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:44.728 23:14:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:44.728 23:14:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:44.728 23:14:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:44.728 23:14:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:44.728 23:14:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:44.729 23:14:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:44.729 23:14:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:44.729 23:14:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:44.729 23:14:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:44.729 23:14:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:44.729 23:14:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:44.729 23:14:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:44.729 23:14:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:44.729 23:14:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:44.729 23:14:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:44.729 23:14:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:44.729 23:14:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.729 23:14:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.729 23:14:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.729 23:14:10 -- paths/export.sh@5 -- # export PATH 00:21:44.729 23:14:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.729 23:14:10 -- nvmf/common.sh@46 -- # : 0 00:21:44.729 23:14:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:44.729 23:14:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:44.729 23:14:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:44.729 23:14:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:44.729 23:14:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:44.729 23:14:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:44.729 23:14:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:44.729 23:14:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:44.729 23:14:10 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:44.729 23:14:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:44.729 23:14:10 -- common/autotest_common.sh@10 -- # set +x 00:21:46.632 23:14:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:46.632 23:14:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:46.632 23:14:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:46.632 23:14:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:46.632 23:14:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:46.632 23:14:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:46.632 23:14:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:46.632 23:14:12 -- nvmf/common.sh@294 -- # net_devs=() 00:21:46.632 23:14:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:46.632 23:14:12 -- nvmf/common.sh@295 -- # e810=() 00:21:46.632 23:14:12 -- nvmf/common.sh@295 -- # local -ga e810 00:21:46.632 23:14:12 -- nvmf/common.sh@296 -- # x722=() 00:21:46.632 23:14:12 -- nvmf/common.sh@296 -- # local -ga x722 00:21:46.632 23:14:12 -- nvmf/common.sh@297 -- # mlx=() 00:21:46.632 23:14:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:46.632 23:14:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:46.632 23:14:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:46.632 23:14:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:46.632 23:14:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:46.632 23:14:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:46.632 23:14:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:46.632 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:46.632 23:14:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:46.632 23:14:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:46.632 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:46.632 23:14:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:46.632 23:14:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:46.632 23:14:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:46.632 23:14:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.632 23:14:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:46.632 23:14:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.632 23:14:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:46.632 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:46.632 23:14:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.632 23:14:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:46.632 23:14:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.632 23:14:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:46.632 23:14:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.632 23:14:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:46.632 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:46.632 23:14:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.632 23:14:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:46.632 23:14:12 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:46.632 23:14:12 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:46.632 23:14:12 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:46.632 23:14:12 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:46.632 23:14:12 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:47.569 23:14:13 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:51.753 23:14:17 -- target/perf_adq.sh@54 -- # sleep 5 00:21:55.944 23:14:22 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:55.944 23:14:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:55.944 23:14:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:55.944 23:14:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:55.944 23:14:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:55.944 23:14:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:55.944 23:14:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:55.944 23:14:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:55.944 23:14:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:55.944 23:14:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:55.944 23:14:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:55.944 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:55.944 23:14:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:55.944 23:14:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:55.944 23:14:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:55.944 23:14:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:55.944 23:14:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:55.944 23:14:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:55.944 23:14:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:55.944 23:14:22 -- nvmf/common.sh@294 -- # net_devs=() 00:21:55.944 23:14:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:55.944 23:14:22 -- nvmf/common.sh@295 -- # e810=() 00:21:55.944 23:14:22 -- nvmf/common.sh@295 -- # local -ga e810 00:21:55.944 23:14:22 -- nvmf/common.sh@296 -- # x722=() 00:21:55.944 23:14:22 -- nvmf/common.sh@296 -- # local -ga x722 00:21:55.944 23:14:22 -- nvmf/common.sh@297 -- # mlx=() 00:21:55.944 23:14:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:55.944 23:14:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:55.944 23:14:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:55.944 23:14:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:55.944 23:14:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:55.944 23:14:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.944 23:14:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:55.944 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:55.944 23:14:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.944 23:14:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:55.944 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:55.944 23:14:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:55.944 23:14:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:55.944 23:14:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.944 23:14:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.944 23:14:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.944 23:14:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.944 23:14:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:55.944 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:55.944 23:14:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.944 23:14:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.944 23:14:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.944 23:14:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.945 23:14:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.945 23:14:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:55.945 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:55.945 23:14:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.945 23:14:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:55.945 23:14:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:55.945 23:14:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:55.945 23:14:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:55.945 23:14:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:55.945 23:14:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:55.945 23:14:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:55.945 23:14:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:55.945 23:14:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:55.945 23:14:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:55.945 23:14:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:55.945 23:14:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:55.945 23:14:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:55.945 23:14:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:55.945 23:14:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:55.945 23:14:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:55.945 23:14:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:55.945 23:14:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:56.203 23:14:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:56.203 23:14:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:56.203 23:14:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:56.203 23:14:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:56.203 23:14:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:56.203 23:14:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:56.203 23:14:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:56.203 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:56.203 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:21:56.203 00:21:56.203 --- 10.0.0.2 ping statistics --- 00:21:56.203 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:56.203 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:21:56.203 23:14:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:56.203 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:56.203 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:21:56.203 00:21:56.203 --- 10.0.0.1 ping statistics --- 00:21:56.203 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:56.203 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:21:56.203 23:14:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:56.203 23:14:22 -- nvmf/common.sh@410 -- # return 0 00:21:56.203 23:14:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:56.203 23:14:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:56.203 23:14:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:56.203 23:14:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:56.203 23:14:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:56.203 23:14:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:56.203 23:14:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:56.203 23:14:22 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:56.203 23:14:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:56.203 23:14:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:56.203 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.203 23:14:22 -- nvmf/common.sh@469 -- # nvmfpid=262806 00:21:56.203 23:14:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:56.203 23:14:22 -- nvmf/common.sh@470 -- # waitforlisten 262806 00:21:56.203 23:14:22 -- common/autotest_common.sh@829 -- # '[' -z 262806 ']' 00:21:56.203 23:14:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:56.203 23:14:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:56.204 23:14:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:56.204 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:56.204 23:14:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:56.204 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.204 [2024-11-26 23:14:22.500368] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:56.204 [2024-11-26 23:14:22.500437] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:56.204 EAL: No free 2048 kB hugepages reported on node 1 00:21:56.204 [2024-11-26 23:14:22.568438] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:56.462 [2024-11-26 23:14:22.688294] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:56.462 [2024-11-26 23:14:22.688475] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:56.462 [2024-11-26 23:14:22.688495] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:56.462 [2024-11-26 23:14:22.688509] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:56.462 [2024-11-26 23:14:22.688574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:56.462 [2024-11-26 23:14:22.688634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:56.462 [2024-11-26 23:14:22.688729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:56.462 [2024-11-26 23:14:22.688733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:56.462 23:14:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:56.462 23:14:22 -- common/autotest_common.sh@862 -- # return 0 00:21:56.462 23:14:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:56.462 23:14:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:56.462 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.462 23:14:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:56.462 23:14:22 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:56.462 23:14:22 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:56.462 23:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.462 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.462 23:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.462 23:14:22 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:56.462 23:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.462 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.721 23:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.721 23:14:22 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:56.721 23:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.721 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.721 [2024-11-26 23:14:22.906554] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:56.721 23:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.721 23:14:22 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:56.721 23:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.721 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.721 Malloc1 00:21:56.721 23:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.721 23:14:22 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:56.721 23:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.721 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.721 23:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.721 23:14:22 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:56.721 23:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.721 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.721 23:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.721 23:14:22 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:56.721 23:14:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.721 23:14:22 -- common/autotest_common.sh@10 -- # set +x 00:21:56.721 [2024-11-26 23:14:22.959855] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:56.721 23:14:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.721 23:14:22 -- target/perf_adq.sh@73 -- # perfpid=262834 00:21:56.721 23:14:22 -- target/perf_adq.sh@74 -- # sleep 2 00:21:56.721 23:14:22 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:56.721 EAL: No free 2048 kB hugepages reported on node 1 00:21:58.622 23:14:24 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:58.622 23:14:24 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:58.622 23:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:58.622 23:14:24 -- target/perf_adq.sh@76 -- # wc -l 00:21:58.622 23:14:24 -- common/autotest_common.sh@10 -- # set +x 00:21:58.622 23:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:58.623 23:14:25 -- target/perf_adq.sh@76 -- # count=4 00:21:58.623 23:14:25 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:58.623 23:14:25 -- target/perf_adq.sh@81 -- # wait 262834 00:22:06.736 Initializing NVMe Controllers 00:22:06.736 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:06.736 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:06.736 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:06.736 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:06.736 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:06.736 Initialization complete. Launching workers. 00:22:06.736 ======================================================== 00:22:06.736 Latency(us) 00:22:06.736 Device Information : IOPS MiB/s Average min max 00:22:06.736 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10413.74 40.68 6146.80 1728.47 9977.88 00:22:06.736 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11317.38 44.21 5655.33 1624.06 8645.92 00:22:06.736 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11533.17 45.05 5549.95 1728.53 10106.33 00:22:06.736 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11229.28 43.86 5699.33 1552.63 9803.58 00:22:06.736 ======================================================== 00:22:06.736 Total : 44493.57 173.80 5754.15 1552.63 10106.33 00:22:06.736 00:22:06.736 23:14:33 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:06.736 23:14:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:06.736 23:14:33 -- nvmf/common.sh@116 -- # sync 00:22:06.736 23:14:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:06.736 23:14:33 -- nvmf/common.sh@119 -- # set +e 00:22:06.736 23:14:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:06.736 23:14:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:06.736 rmmod nvme_tcp 00:22:06.736 rmmod nvme_fabrics 00:22:06.995 rmmod nvme_keyring 00:22:06.995 23:14:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:06.995 23:14:33 -- nvmf/common.sh@123 -- # set -e 00:22:06.995 23:14:33 -- nvmf/common.sh@124 -- # return 0 00:22:06.995 23:14:33 -- nvmf/common.sh@477 -- # '[' -n 262806 ']' 00:22:06.995 23:14:33 -- nvmf/common.sh@478 -- # killprocess 262806 00:22:06.995 23:14:33 -- common/autotest_common.sh@936 -- # '[' -z 262806 ']' 00:22:06.995 23:14:33 -- common/autotest_common.sh@940 -- # kill -0 262806 00:22:06.995 23:14:33 -- common/autotest_common.sh@941 -- # uname 00:22:06.995 23:14:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:06.995 23:14:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 262806 00:22:06.995 23:14:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:06.995 23:14:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:06.995 23:14:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 262806' 00:22:06.995 killing process with pid 262806 00:22:06.995 23:14:33 -- common/autotest_common.sh@955 -- # kill 262806 00:22:06.995 23:14:33 -- common/autotest_common.sh@960 -- # wait 262806 00:22:07.254 23:14:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:07.254 23:14:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:07.254 23:14:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:07.254 23:14:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:07.254 23:14:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:07.254 23:14:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:07.254 23:14:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:07.254 23:14:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.154 23:14:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:09.154 23:14:35 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:09.154 23:14:35 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:10.091 23:14:36 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:12.622 23:14:38 -- target/perf_adq.sh@54 -- # sleep 5 00:22:17.914 23:14:43 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:17.914 23:14:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:17.914 23:14:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:17.914 23:14:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:17.914 23:14:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:17.914 23:14:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:17.914 23:14:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:17.914 23:14:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:17.914 23:14:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.914 23:14:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:17.914 23:14:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:17.914 23:14:43 -- common/autotest_common.sh@10 -- # set +x 00:22:17.914 23:14:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:17.914 23:14:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:17.914 23:14:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:17.914 23:14:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:17.914 23:14:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:17.914 23:14:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:17.914 23:14:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:17.914 23:14:43 -- nvmf/common.sh@294 -- # net_devs=() 00:22:17.914 23:14:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:17.914 23:14:43 -- nvmf/common.sh@295 -- # e810=() 00:22:17.914 23:14:43 -- nvmf/common.sh@295 -- # local -ga e810 00:22:17.914 23:14:43 -- nvmf/common.sh@296 -- # x722=() 00:22:17.914 23:14:43 -- nvmf/common.sh@296 -- # local -ga x722 00:22:17.914 23:14:43 -- nvmf/common.sh@297 -- # mlx=() 00:22:17.914 23:14:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:17.914 23:14:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:17.914 23:14:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:17.914 23:14:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:17.914 23:14:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:17.914 23:14:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.914 23:14:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:17.914 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:17.914 23:14:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.914 23:14:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:17.914 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:17.914 23:14:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:17.914 23:14:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.914 23:14:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.914 23:14:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.914 23:14:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.914 23:14:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:17.914 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:17.914 23:14:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.914 23:14:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.914 23:14:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.914 23:14:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.914 23:14:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.914 23:14:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:17.914 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:17.914 23:14:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.914 23:14:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:17.914 23:14:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:17.914 23:14:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:17.914 23:14:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:17.914 23:14:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:17.914 23:14:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:17.914 23:14:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:17.914 23:14:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:17.914 23:14:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:17.914 23:14:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:17.914 23:14:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:17.914 23:14:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:17.914 23:14:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:17.914 23:14:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:17.915 23:14:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:17.915 23:14:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:17.915 23:14:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:17.915 23:14:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:17.915 23:14:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:17.915 23:14:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:17.915 23:14:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:17.915 23:14:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:17.915 23:14:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:17.915 23:14:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:17.915 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:17.915 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.320 ms 00:22:17.915 00:22:17.915 --- 10.0.0.2 ping statistics --- 00:22:17.915 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.915 rtt min/avg/max/mdev = 0.320/0.320/0.320/0.000 ms 00:22:17.915 23:14:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:17.915 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:17.915 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:22:17.915 00:22:17.915 --- 10.0.0.1 ping statistics --- 00:22:17.915 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.915 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:22:17.915 23:14:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:17.915 23:14:43 -- nvmf/common.sh@410 -- # return 0 00:22:17.915 23:14:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:17.915 23:14:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:17.915 23:14:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:17.915 23:14:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:17.915 23:14:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:17.915 23:14:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:17.915 23:14:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:17.915 23:14:43 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:17.915 23:14:43 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:17.915 23:14:44 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:17.915 23:14:44 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:17.915 net.core.busy_poll = 1 00:22:17.915 23:14:44 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:17.915 net.core.busy_read = 1 00:22:17.915 23:14:44 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:17.915 23:14:44 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:17.915 23:14:44 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:17.915 23:14:44 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:17.915 23:14:44 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:17.915 23:14:44 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:17.915 23:14:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:17.915 23:14:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:17.915 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:17.915 23:14:44 -- nvmf/common.sh@469 -- # nvmfpid=265649 00:22:17.915 23:14:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:17.915 23:14:44 -- nvmf/common.sh@470 -- # waitforlisten 265649 00:22:17.915 23:14:44 -- common/autotest_common.sh@829 -- # '[' -z 265649 ']' 00:22:17.915 23:14:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:17.915 23:14:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:17.915 23:14:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:17.915 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:17.915 23:14:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:17.915 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:17.915 [2024-11-26 23:14:44.208294] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:17.915 [2024-11-26 23:14:44.208369] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:17.915 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.915 [2024-11-26 23:14:44.280021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:18.173 [2024-11-26 23:14:44.397161] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:18.173 [2024-11-26 23:14:44.397327] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:18.173 [2024-11-26 23:14:44.397347] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:18.173 [2024-11-26 23:14:44.397360] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:18.173 [2024-11-26 23:14:44.397511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:18.173 [2024-11-26 23:14:44.397580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:18.173 [2024-11-26 23:14:44.397685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:18.173 [2024-11-26 23:14:44.397688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:18.173 23:14:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:18.173 23:14:44 -- common/autotest_common.sh@862 -- # return 0 00:22:18.173 23:14:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:18.173 23:14:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:18.173 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:18.173 23:14:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:18.173 23:14:44 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:18.173 23:14:44 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:18.173 23:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.173 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:18.173 23:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.173 23:14:44 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:18.173 23:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.173 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:18.431 23:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.431 23:14:44 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:18.431 23:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.431 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:18.431 [2024-11-26 23:14:44.590250] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:18.431 23:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.431 23:14:44 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:18.431 23:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.431 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:18.431 Malloc1 00:22:18.431 23:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.431 23:14:44 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:18.431 23:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.431 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:18.431 23:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.431 23:14:44 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:18.431 23:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.431 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:18.431 23:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.431 23:14:44 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:18.431 23:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.432 23:14:44 -- common/autotest_common.sh@10 -- # set +x 00:22:18.432 [2024-11-26 23:14:44.641241] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:18.432 23:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.432 23:14:44 -- target/perf_adq.sh@94 -- # perfpid=265683 00:22:18.432 23:14:44 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:18.432 23:14:44 -- target/perf_adq.sh@95 -- # sleep 2 00:22:18.432 EAL: No free 2048 kB hugepages reported on node 1 00:22:20.332 23:14:46 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:20.332 23:14:46 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:20.332 23:14:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.332 23:14:46 -- target/perf_adq.sh@97 -- # wc -l 00:22:20.332 23:14:46 -- common/autotest_common.sh@10 -- # set +x 00:22:20.332 23:14:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.332 23:14:46 -- target/perf_adq.sh@97 -- # count=2 00:22:20.332 23:14:46 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:20.332 23:14:46 -- target/perf_adq.sh@103 -- # wait 265683 00:22:30.303 Initializing NVMe Controllers 00:22:30.303 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:30.303 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:30.303 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:30.303 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:30.303 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:30.303 Initialization complete. Launching workers. 00:22:30.303 ======================================================== 00:22:30.303 Latency(us) 00:22:30.303 Device Information : IOPS MiB/s Average min max 00:22:30.303 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7058.30 27.57 9067.80 1372.75 52469.22 00:22:30.303 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 7198.50 28.12 8899.95 1289.03 54019.83 00:22:30.303 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7336.00 28.66 8724.59 1000.35 53714.10 00:22:30.303 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 6765.30 26.43 9459.55 1227.85 52850.46 00:22:30.303 ======================================================== 00:22:30.303 Total : 28358.10 110.77 9029.86 1000.35 54019.83 00:22:30.303 00:22:30.303 23:14:54 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:30.303 23:14:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:30.303 23:14:54 -- nvmf/common.sh@116 -- # sync 00:22:30.303 23:14:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:30.303 23:14:54 -- nvmf/common.sh@119 -- # set +e 00:22:30.303 23:14:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:30.303 23:14:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:30.303 rmmod nvme_tcp 00:22:30.303 rmmod nvme_fabrics 00:22:30.303 rmmod nvme_keyring 00:22:30.303 23:14:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:30.303 23:14:54 -- nvmf/common.sh@123 -- # set -e 00:22:30.303 23:14:54 -- nvmf/common.sh@124 -- # return 0 00:22:30.303 23:14:54 -- nvmf/common.sh@477 -- # '[' -n 265649 ']' 00:22:30.303 23:14:54 -- nvmf/common.sh@478 -- # killprocess 265649 00:22:30.303 23:14:54 -- common/autotest_common.sh@936 -- # '[' -z 265649 ']' 00:22:30.303 23:14:54 -- common/autotest_common.sh@940 -- # kill -0 265649 00:22:30.303 23:14:54 -- common/autotest_common.sh@941 -- # uname 00:22:30.303 23:14:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:30.303 23:14:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 265649 00:22:30.303 23:14:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:30.303 23:14:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:30.303 23:14:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 265649' 00:22:30.303 killing process with pid 265649 00:22:30.303 23:14:54 -- common/autotest_common.sh@955 -- # kill 265649 00:22:30.303 23:14:54 -- common/autotest_common.sh@960 -- # wait 265649 00:22:30.303 23:14:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:30.303 23:14:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:30.303 23:14:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:30.303 23:14:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:30.303 23:14:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:30.303 23:14:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:30.303 23:14:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:30.303 23:14:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:31.240 23:14:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:31.240 23:14:57 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:31.240 00:22:31.240 real 0m46.527s 00:22:31.240 user 2m37.559s 00:22:31.240 sys 0m11.861s 00:22:31.240 23:14:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:31.240 23:14:57 -- common/autotest_common.sh@10 -- # set +x 00:22:31.240 ************************************ 00:22:31.240 END TEST nvmf_perf_adq 00:22:31.240 ************************************ 00:22:31.240 23:14:57 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:31.240 23:14:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:31.240 23:14:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:31.240 23:14:57 -- common/autotest_common.sh@10 -- # set +x 00:22:31.240 ************************************ 00:22:31.240 START TEST nvmf_shutdown 00:22:31.240 ************************************ 00:22:31.240 23:14:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:31.240 * Looking for test storage... 00:22:31.240 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:31.240 23:14:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:31.240 23:14:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:31.240 23:14:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:31.240 23:14:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:31.240 23:14:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:31.240 23:14:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:31.240 23:14:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:31.240 23:14:57 -- scripts/common.sh@335 -- # IFS=.-: 00:22:31.240 23:14:57 -- scripts/common.sh@335 -- # read -ra ver1 00:22:31.240 23:14:57 -- scripts/common.sh@336 -- # IFS=.-: 00:22:31.240 23:14:57 -- scripts/common.sh@336 -- # read -ra ver2 00:22:31.240 23:14:57 -- scripts/common.sh@337 -- # local 'op=<' 00:22:31.240 23:14:57 -- scripts/common.sh@339 -- # ver1_l=2 00:22:31.240 23:14:57 -- scripts/common.sh@340 -- # ver2_l=1 00:22:31.240 23:14:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:31.240 23:14:57 -- scripts/common.sh@343 -- # case "$op" in 00:22:31.240 23:14:57 -- scripts/common.sh@344 -- # : 1 00:22:31.240 23:14:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:31.240 23:14:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:31.240 23:14:57 -- scripts/common.sh@364 -- # decimal 1 00:22:31.240 23:14:57 -- scripts/common.sh@352 -- # local d=1 00:22:31.240 23:14:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:31.240 23:14:57 -- scripts/common.sh@354 -- # echo 1 00:22:31.240 23:14:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:31.240 23:14:57 -- scripts/common.sh@365 -- # decimal 2 00:22:31.240 23:14:57 -- scripts/common.sh@352 -- # local d=2 00:22:31.240 23:14:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:31.240 23:14:57 -- scripts/common.sh@354 -- # echo 2 00:22:31.240 23:14:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:31.240 23:14:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:31.240 23:14:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:31.240 23:14:57 -- scripts/common.sh@367 -- # return 0 00:22:31.240 23:14:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:31.240 23:14:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:31.240 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:31.240 --rc genhtml_branch_coverage=1 00:22:31.240 --rc genhtml_function_coverage=1 00:22:31.240 --rc genhtml_legend=1 00:22:31.240 --rc geninfo_all_blocks=1 00:22:31.240 --rc geninfo_unexecuted_blocks=1 00:22:31.240 00:22:31.240 ' 00:22:31.240 23:14:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:31.240 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:31.240 --rc genhtml_branch_coverage=1 00:22:31.240 --rc genhtml_function_coverage=1 00:22:31.240 --rc genhtml_legend=1 00:22:31.240 --rc geninfo_all_blocks=1 00:22:31.240 --rc geninfo_unexecuted_blocks=1 00:22:31.240 00:22:31.240 ' 00:22:31.240 23:14:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:31.240 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:31.240 --rc genhtml_branch_coverage=1 00:22:31.240 --rc genhtml_function_coverage=1 00:22:31.240 --rc genhtml_legend=1 00:22:31.240 --rc geninfo_all_blocks=1 00:22:31.240 --rc geninfo_unexecuted_blocks=1 00:22:31.240 00:22:31.240 ' 00:22:31.240 23:14:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:31.240 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:31.240 --rc genhtml_branch_coverage=1 00:22:31.240 --rc genhtml_function_coverage=1 00:22:31.240 --rc genhtml_legend=1 00:22:31.240 --rc geninfo_all_blocks=1 00:22:31.240 --rc geninfo_unexecuted_blocks=1 00:22:31.240 00:22:31.240 ' 00:22:31.240 23:14:57 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:31.240 23:14:57 -- nvmf/common.sh@7 -- # uname -s 00:22:31.240 23:14:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:31.240 23:14:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:31.240 23:14:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:31.240 23:14:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:31.240 23:14:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:31.240 23:14:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:31.240 23:14:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:31.240 23:14:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:31.240 23:14:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:31.240 23:14:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:31.240 23:14:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:31.240 23:14:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:31.240 23:14:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:31.240 23:14:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:31.240 23:14:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:31.240 23:14:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:31.240 23:14:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:31.240 23:14:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:31.240 23:14:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:31.241 23:14:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.241 23:14:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.241 23:14:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.241 23:14:57 -- paths/export.sh@5 -- # export PATH 00:22:31.241 23:14:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.241 23:14:57 -- nvmf/common.sh@46 -- # : 0 00:22:31.241 23:14:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:31.241 23:14:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:31.241 23:14:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:31.241 23:14:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:31.241 23:14:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:31.241 23:14:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:31.241 23:14:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:31.241 23:14:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:31.241 23:14:57 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:31.241 23:14:57 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:31.241 23:14:57 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:31.241 23:14:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:31.241 23:14:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:31.241 23:14:57 -- common/autotest_common.sh@10 -- # set +x 00:22:31.241 ************************************ 00:22:31.241 START TEST nvmf_shutdown_tc1 00:22:31.241 ************************************ 00:22:31.241 23:14:57 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:31.241 23:14:57 -- target/shutdown.sh@74 -- # starttarget 00:22:31.241 23:14:57 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:31.241 23:14:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:31.241 23:14:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:31.241 23:14:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:31.241 23:14:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:31.241 23:14:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:31.241 23:14:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:31.241 23:14:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:31.241 23:14:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:31.241 23:14:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:31.241 23:14:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:31.241 23:14:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:31.241 23:14:57 -- common/autotest_common.sh@10 -- # set +x 00:22:33.771 23:14:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:33.771 23:14:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:33.771 23:14:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:33.771 23:14:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:33.771 23:14:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:33.771 23:14:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:33.771 23:14:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:33.771 23:14:59 -- nvmf/common.sh@294 -- # net_devs=() 00:22:33.771 23:14:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:33.771 23:14:59 -- nvmf/common.sh@295 -- # e810=() 00:22:33.771 23:14:59 -- nvmf/common.sh@295 -- # local -ga e810 00:22:33.771 23:14:59 -- nvmf/common.sh@296 -- # x722=() 00:22:33.771 23:14:59 -- nvmf/common.sh@296 -- # local -ga x722 00:22:33.771 23:14:59 -- nvmf/common.sh@297 -- # mlx=() 00:22:33.771 23:14:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:33.771 23:14:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:33.771 23:14:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:33.771 23:14:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:33.771 23:14:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:33.771 23:14:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:33.771 23:14:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:33.771 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:33.771 23:14:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:33.771 23:14:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:33.771 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:33.771 23:14:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:33.771 23:14:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:33.771 23:14:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:33.771 23:14:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:33.771 23:14:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:33.771 23:14:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:33.771 23:14:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:33.771 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:33.771 23:14:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:33.771 23:14:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:33.771 23:14:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:33.772 23:14:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:33.772 23:14:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:33.772 23:14:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:33.772 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:33.772 23:14:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:33.772 23:14:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:33.772 23:14:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:33.772 23:14:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:33.772 23:14:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:33.772 23:14:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:33.772 23:14:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:33.772 23:14:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:33.772 23:14:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:33.772 23:14:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:33.772 23:14:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:33.772 23:14:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:33.772 23:14:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:33.772 23:14:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:33.772 23:14:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:33.772 23:14:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:33.772 23:14:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:33.772 23:14:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:33.772 23:14:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:33.772 23:14:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:33.772 23:14:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:33.772 23:14:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:33.772 23:14:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:33.772 23:14:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:33.772 23:14:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:33.772 23:14:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:33.772 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:33.772 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:22:33.772 00:22:33.772 --- 10.0.0.2 ping statistics --- 00:22:33.772 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:33.772 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:22:33.772 23:14:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:33.772 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:33.772 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.042 ms 00:22:33.772 00:22:33.772 --- 10.0.0.1 ping statistics --- 00:22:33.772 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:33.772 rtt min/avg/max/mdev = 0.042/0.042/0.042/0.000 ms 00:22:33.772 23:14:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:33.772 23:14:59 -- nvmf/common.sh@410 -- # return 0 00:22:33.772 23:14:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:33.772 23:14:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:33.772 23:14:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:33.772 23:14:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:33.772 23:14:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:33.772 23:14:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:33.772 23:14:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:33.772 23:14:59 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:33.772 23:14:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:33.772 23:14:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:33.772 23:14:59 -- common/autotest_common.sh@10 -- # set +x 00:22:33.772 23:14:59 -- nvmf/common.sh@469 -- # nvmfpid=269016 00:22:33.772 23:14:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:33.772 23:14:59 -- nvmf/common.sh@470 -- # waitforlisten 269016 00:22:33.772 23:14:59 -- common/autotest_common.sh@829 -- # '[' -z 269016 ']' 00:22:33.772 23:14:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:33.772 23:14:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:33.772 23:14:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:33.772 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:33.772 23:14:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:33.772 23:14:59 -- common/autotest_common.sh@10 -- # set +x 00:22:33.772 [2024-11-26 23:14:59.888756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:33.772 [2024-11-26 23:14:59.888827] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:33.772 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.772 [2024-11-26 23:14:59.951584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:33.772 [2024-11-26 23:15:00.067481] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:33.772 [2024-11-26 23:15:00.067650] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:33.772 [2024-11-26 23:15:00.067671] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:33.772 [2024-11-26 23:15:00.067683] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:33.772 [2024-11-26 23:15:00.067758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:33.772 [2024-11-26 23:15:00.067821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:33.772 [2024-11-26 23:15:00.067865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:33.772 [2024-11-26 23:15:00.067868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:34.705 23:15:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:34.705 23:15:00 -- common/autotest_common.sh@862 -- # return 0 00:22:34.705 23:15:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:34.705 23:15:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:34.705 23:15:00 -- common/autotest_common.sh@10 -- # set +x 00:22:34.705 23:15:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:34.705 23:15:00 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:34.705 23:15:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.705 23:15:00 -- common/autotest_common.sh@10 -- # set +x 00:22:34.705 [2024-11-26 23:15:00.899154] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:34.705 23:15:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.705 23:15:00 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:34.705 23:15:00 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:34.705 23:15:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:34.705 23:15:00 -- common/autotest_common.sh@10 -- # set +x 00:22:34.705 23:15:00 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:34.705 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.705 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.705 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.705 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.705 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.705 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.705 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.705 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.705 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.705 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.705 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.705 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.705 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.705 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.705 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.706 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.706 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.706 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.706 23:15:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.706 23:15:00 -- target/shutdown.sh@28 -- # cat 00:22:34.706 23:15:00 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:34.706 23:15:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.706 23:15:00 -- common/autotest_common.sh@10 -- # set +x 00:22:34.706 Malloc1 00:22:34.706 [2024-11-26 23:15:00.984262] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:34.706 Malloc2 00:22:34.706 Malloc3 00:22:34.964 Malloc4 00:22:34.964 Malloc5 00:22:34.964 Malloc6 00:22:34.964 Malloc7 00:22:34.964 Malloc8 00:22:34.964 Malloc9 00:22:35.222 Malloc10 00:22:35.222 23:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:35.222 23:15:01 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:35.222 23:15:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:35.222 23:15:01 -- common/autotest_common.sh@10 -- # set +x 00:22:35.222 23:15:01 -- target/shutdown.sh@78 -- # perfpid=269295 00:22:35.222 23:15:01 -- target/shutdown.sh@79 -- # waitforlisten 269295 /var/tmp/bdevperf.sock 00:22:35.222 23:15:01 -- common/autotest_common.sh@829 -- # '[' -z 269295 ']' 00:22:35.222 23:15:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:35.222 23:15:01 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:35.222 23:15:01 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:35.222 23:15:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:35.222 23:15:01 -- nvmf/common.sh@520 -- # config=() 00:22:35.222 23:15:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:35.222 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:35.222 23:15:01 -- nvmf/common.sh@520 -- # local subsystem config 00:22:35.222 23:15:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:35.222 23:15:01 -- common/autotest_common.sh@10 -- # set +x 00:22:35.222 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.222 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.222 { 00:22:35.222 "params": { 00:22:35.222 "name": "Nvme$subsystem", 00:22:35.222 "trtype": "$TEST_TRANSPORT", 00:22:35.222 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.222 "adrfam": "ipv4", 00:22:35.222 "trsvcid": "$NVMF_PORT", 00:22:35.222 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.222 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.222 "hdgst": ${hdgst:-false}, 00:22:35.222 "ddgst": ${ddgst:-false} 00:22:35.222 }, 00:22:35.222 "method": "bdev_nvme_attach_controller" 00:22:35.222 } 00:22:35.222 EOF 00:22:35.222 )") 00:22:35.222 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.222 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.222 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.222 { 00:22:35.222 "params": { 00:22:35.222 "name": "Nvme$subsystem", 00:22:35.222 "trtype": "$TEST_TRANSPORT", 00:22:35.222 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.222 "adrfam": "ipv4", 00:22:35.222 "trsvcid": "$NVMF_PORT", 00:22:35.222 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.222 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.222 "hdgst": ${hdgst:-false}, 00:22:35.222 "ddgst": ${ddgst:-false} 00:22:35.222 }, 00:22:35.222 "method": "bdev_nvme_attach_controller" 00:22:35.222 } 00:22:35.222 EOF 00:22:35.222 )") 00:22:35.222 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.222 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.222 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.222 { 00:22:35.222 "params": { 00:22:35.222 "name": "Nvme$subsystem", 00:22:35.222 "trtype": "$TEST_TRANSPORT", 00:22:35.222 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.222 "adrfam": "ipv4", 00:22:35.222 "trsvcid": "$NVMF_PORT", 00:22:35.222 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.222 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.222 "hdgst": ${hdgst:-false}, 00:22:35.222 "ddgst": ${ddgst:-false} 00:22:35.222 }, 00:22:35.222 "method": "bdev_nvme_attach_controller" 00:22:35.222 } 00:22:35.222 EOF 00:22:35.222 )") 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.223 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.223 { 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme$subsystem", 00:22:35.223 "trtype": "$TEST_TRANSPORT", 00:22:35.223 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "$NVMF_PORT", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.223 "hdgst": ${hdgst:-false}, 00:22:35.223 "ddgst": ${ddgst:-false} 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 } 00:22:35.223 EOF 00:22:35.223 )") 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.223 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.223 { 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme$subsystem", 00:22:35.223 "trtype": "$TEST_TRANSPORT", 00:22:35.223 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "$NVMF_PORT", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.223 "hdgst": ${hdgst:-false}, 00:22:35.223 "ddgst": ${ddgst:-false} 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 } 00:22:35.223 EOF 00:22:35.223 )") 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.223 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.223 { 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme$subsystem", 00:22:35.223 "trtype": "$TEST_TRANSPORT", 00:22:35.223 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "$NVMF_PORT", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.223 "hdgst": ${hdgst:-false}, 00:22:35.223 "ddgst": ${ddgst:-false} 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 } 00:22:35.223 EOF 00:22:35.223 )") 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.223 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.223 { 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme$subsystem", 00:22:35.223 "trtype": "$TEST_TRANSPORT", 00:22:35.223 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "$NVMF_PORT", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.223 "hdgst": ${hdgst:-false}, 00:22:35.223 "ddgst": ${ddgst:-false} 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 } 00:22:35.223 EOF 00:22:35.223 )") 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.223 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.223 { 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme$subsystem", 00:22:35.223 "trtype": "$TEST_TRANSPORT", 00:22:35.223 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "$NVMF_PORT", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.223 "hdgst": ${hdgst:-false}, 00:22:35.223 "ddgst": ${ddgst:-false} 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 } 00:22:35.223 EOF 00:22:35.223 )") 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.223 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.223 { 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme$subsystem", 00:22:35.223 "trtype": "$TEST_TRANSPORT", 00:22:35.223 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "$NVMF_PORT", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.223 "hdgst": ${hdgst:-false}, 00:22:35.223 "ddgst": ${ddgst:-false} 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 } 00:22:35.223 EOF 00:22:35.223 )") 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.223 23:15:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.223 { 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme$subsystem", 00:22:35.223 "trtype": "$TEST_TRANSPORT", 00:22:35.223 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "$NVMF_PORT", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.223 "hdgst": ${hdgst:-false}, 00:22:35.223 "ddgst": ${ddgst:-false} 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 } 00:22:35.223 EOF 00:22:35.223 )") 00:22:35.223 23:15:01 -- nvmf/common.sh@542 -- # cat 00:22:35.223 23:15:01 -- nvmf/common.sh@544 -- # jq . 00:22:35.223 23:15:01 -- nvmf/common.sh@545 -- # IFS=, 00:22:35.223 23:15:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme1", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:35.223 "hdgst": false, 00:22:35.223 "ddgst": false 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 },{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme2", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:35.223 "hdgst": false, 00:22:35.223 "ddgst": false 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 },{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme3", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:35.223 "hdgst": false, 00:22:35.223 "ddgst": false 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 },{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme4", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:35.223 "hdgst": false, 00:22:35.223 "ddgst": false 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 },{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme5", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:35.223 "hdgst": false, 00:22:35.223 "ddgst": false 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 },{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme6", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:35.223 "hdgst": false, 00:22:35.223 "ddgst": false 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 },{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme7", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:35.223 "hdgst": false, 00:22:35.223 "ddgst": false 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 },{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme8", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:35.223 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:35.223 "hdgst": false, 00:22:35.223 "ddgst": false 00:22:35.223 }, 00:22:35.223 "method": "bdev_nvme_attach_controller" 00:22:35.223 },{ 00:22:35.223 "params": { 00:22:35.223 "name": "Nvme9", 00:22:35.223 "trtype": "tcp", 00:22:35.223 "traddr": "10.0.0.2", 00:22:35.223 "adrfam": "ipv4", 00:22:35.223 "trsvcid": "4420", 00:22:35.223 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:35.224 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:35.224 "hdgst": false, 00:22:35.224 "ddgst": false 00:22:35.224 }, 00:22:35.224 "method": "bdev_nvme_attach_controller" 00:22:35.224 },{ 00:22:35.224 "params": { 00:22:35.224 "name": "Nvme10", 00:22:35.224 "trtype": "tcp", 00:22:35.224 "traddr": "10.0.0.2", 00:22:35.224 "adrfam": "ipv4", 00:22:35.224 "trsvcid": "4420", 00:22:35.224 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:35.224 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:35.224 "hdgst": false, 00:22:35.224 "ddgst": false 00:22:35.224 }, 00:22:35.224 "method": "bdev_nvme_attach_controller" 00:22:35.224 }' 00:22:35.224 [2024-11-26 23:15:01.474263] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:35.224 [2024-11-26 23:15:01.474350] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:35.224 EAL: No free 2048 kB hugepages reported on node 1 00:22:35.224 [2024-11-26 23:15:01.538583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:35.482 [2024-11-26 23:15:01.649458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:36.854 23:15:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:36.854 23:15:03 -- common/autotest_common.sh@862 -- # return 0 00:22:36.854 23:15:03 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:36.854 23:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.854 23:15:03 -- common/autotest_common.sh@10 -- # set +x 00:22:36.854 23:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.854 23:15:03 -- target/shutdown.sh@83 -- # kill -9 269295 00:22:36.854 23:15:03 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:36.854 23:15:03 -- target/shutdown.sh@87 -- # sleep 1 00:22:38.227 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 269295 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:38.227 23:15:04 -- target/shutdown.sh@88 -- # kill -0 269016 00:22:38.227 23:15:04 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:38.227 23:15:04 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:38.227 23:15:04 -- nvmf/common.sh@520 -- # config=() 00:22:38.227 23:15:04 -- nvmf/common.sh@520 -- # local subsystem config 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.227 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.227 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.227 { 00:22:38.227 "params": { 00:22:38.227 "name": "Nvme$subsystem", 00:22:38.227 "trtype": "$TEST_TRANSPORT", 00:22:38.227 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.227 "adrfam": "ipv4", 00:22:38.227 "trsvcid": "$NVMF_PORT", 00:22:38.227 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.227 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.227 "hdgst": ${hdgst:-false}, 00:22:38.227 "ddgst": ${ddgst:-false} 00:22:38.227 }, 00:22:38.227 "method": "bdev_nvme_attach_controller" 00:22:38.227 } 00:22:38.227 EOF 00:22:38.227 )") 00:22:38.228 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.228 23:15:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.228 23:15:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.228 { 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme$subsystem", 00:22:38.228 "trtype": "$TEST_TRANSPORT", 00:22:38.228 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "$NVMF_PORT", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.228 "hdgst": ${hdgst:-false}, 00:22:38.228 "ddgst": ${ddgst:-false} 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 } 00:22:38.228 EOF 00:22:38.228 )") 00:22:38.228 23:15:04 -- nvmf/common.sh@542 -- # cat 00:22:38.228 23:15:04 -- nvmf/common.sh@544 -- # jq . 00:22:38.228 23:15:04 -- nvmf/common.sh@545 -- # IFS=, 00:22:38.228 23:15:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme1", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme2", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme3", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme4", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme5", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme6", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme7", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme8", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme9", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 },{ 00:22:38.228 "params": { 00:22:38.228 "name": "Nvme10", 00:22:38.228 "trtype": "tcp", 00:22:38.228 "traddr": "10.0.0.2", 00:22:38.228 "adrfam": "ipv4", 00:22:38.228 "trsvcid": "4420", 00:22:38.228 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:38.228 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:38.228 "hdgst": false, 00:22:38.228 "ddgst": false 00:22:38.228 }, 00:22:38.228 "method": "bdev_nvme_attach_controller" 00:22:38.228 }' 00:22:38.228 [2024-11-26 23:15:04.267128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:38.228 [2024-11-26 23:15:04.267215] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid269751 ] 00:22:38.228 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.228 [2024-11-26 23:15:04.333710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:38.228 [2024-11-26 23:15:04.441901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:40.124 Running I/O for 1 seconds... 00:22:41.057 00:22:41.057 Latency(us) 00:22:41.057 [2024-11-26T22:15:07.451Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme1n1 : 1.07 372.82 23.30 0.00 0.00 164864.82 64079.64 122722.23 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme2n1 : 1.08 369.11 23.07 0.00 0.00 167928.29 36700.16 160004.93 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme3n1 : 1.10 394.02 24.63 0.00 0.00 157493.89 17670.45 118061.89 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme4n1 : 1.11 392.51 24.53 0.00 0.00 156740.43 20000.62 118838.61 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme5n1 : 1.11 391.56 24.47 0.00 0.00 156010.69 19515.16 119615.34 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme6n1 : 1.11 390.75 24.42 0.00 0.00 155257.68 19515.16 121945.51 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme7n1 : 1.11 389.99 24.37 0.00 0.00 154551.65 19612.25 125052.40 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme8n1 : 1.12 389.18 24.32 0.00 0.00 154280.51 15340.28 127382.57 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme9n1 : 1.12 388.60 24.29 0.00 0.00 153382.65 8107.05 128159.29 00:22:41.057 [2024-11-26T22:15:07.451Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.057 Verification LBA range: start 0x0 length 0x400 00:22:41.057 Nvme10n1 : 1.10 366.32 22.90 0.00 0.00 160704.76 5267.15 131266.18 00:22:41.057 [2024-11-26T22:15:07.451Z] =================================================================================================================== 00:22:41.057 [2024-11-26T22:15:07.451Z] Total : 3844.84 240.30 0.00 0.00 157961.37 5267.15 160004.93 00:22:41.315 23:15:07 -- target/shutdown.sh@93 -- # stoptarget 00:22:41.315 23:15:07 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:41.315 23:15:07 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:41.315 23:15:07 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:41.315 23:15:07 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:41.315 23:15:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:41.315 23:15:07 -- nvmf/common.sh@116 -- # sync 00:22:41.315 23:15:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:41.315 23:15:07 -- nvmf/common.sh@119 -- # set +e 00:22:41.315 23:15:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:41.315 23:15:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:41.315 rmmod nvme_tcp 00:22:41.315 rmmod nvme_fabrics 00:22:41.315 rmmod nvme_keyring 00:22:41.315 23:15:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:41.315 23:15:07 -- nvmf/common.sh@123 -- # set -e 00:22:41.315 23:15:07 -- nvmf/common.sh@124 -- # return 0 00:22:41.315 23:15:07 -- nvmf/common.sh@477 -- # '[' -n 269016 ']' 00:22:41.315 23:15:07 -- nvmf/common.sh@478 -- # killprocess 269016 00:22:41.315 23:15:07 -- common/autotest_common.sh@936 -- # '[' -z 269016 ']' 00:22:41.315 23:15:07 -- common/autotest_common.sh@940 -- # kill -0 269016 00:22:41.315 23:15:07 -- common/autotest_common.sh@941 -- # uname 00:22:41.315 23:15:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:41.315 23:15:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 269016 00:22:41.315 23:15:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:41.315 23:15:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:41.315 23:15:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 269016' 00:22:41.315 killing process with pid 269016 00:22:41.315 23:15:07 -- common/autotest_common.sh@955 -- # kill 269016 00:22:41.315 23:15:07 -- common/autotest_common.sh@960 -- # wait 269016 00:22:41.881 23:15:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:41.881 23:15:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:41.881 23:15:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:41.881 23:15:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:41.881 23:15:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:41.881 23:15:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:41.881 23:15:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:41.881 23:15:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:43.783 23:15:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:43.783 00:22:43.783 real 0m12.637s 00:22:43.783 user 0m37.101s 00:22:43.783 sys 0m3.272s 00:22:43.783 23:15:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:43.783 23:15:10 -- common/autotest_common.sh@10 -- # set +x 00:22:43.783 ************************************ 00:22:43.783 END TEST nvmf_shutdown_tc1 00:22:43.783 ************************************ 00:22:43.783 23:15:10 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:43.783 23:15:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:43.783 23:15:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:43.783 23:15:10 -- common/autotest_common.sh@10 -- # set +x 00:22:43.783 ************************************ 00:22:43.783 START TEST nvmf_shutdown_tc2 00:22:43.783 ************************************ 00:22:43.783 23:15:10 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:43.783 23:15:10 -- target/shutdown.sh@98 -- # starttarget 00:22:43.783 23:15:10 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:43.783 23:15:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:43.783 23:15:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:43.783 23:15:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:43.783 23:15:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:43.783 23:15:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:43.783 23:15:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.783 23:15:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.783 23:15:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.042 23:15:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:44.042 23:15:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:44.042 23:15:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:44.042 23:15:10 -- common/autotest_common.sh@10 -- # set +x 00:22:44.042 23:15:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:44.043 23:15:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:44.043 23:15:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:44.043 23:15:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:44.043 23:15:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:44.043 23:15:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:44.043 23:15:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:44.043 23:15:10 -- nvmf/common.sh@294 -- # net_devs=() 00:22:44.043 23:15:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:44.043 23:15:10 -- nvmf/common.sh@295 -- # e810=() 00:22:44.043 23:15:10 -- nvmf/common.sh@295 -- # local -ga e810 00:22:44.043 23:15:10 -- nvmf/common.sh@296 -- # x722=() 00:22:44.043 23:15:10 -- nvmf/common.sh@296 -- # local -ga x722 00:22:44.043 23:15:10 -- nvmf/common.sh@297 -- # mlx=() 00:22:44.043 23:15:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:44.043 23:15:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:44.043 23:15:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:44.043 23:15:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:44.043 23:15:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:44.043 23:15:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:44.043 23:15:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:44.043 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:44.043 23:15:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:44.043 23:15:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:44.043 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:44.043 23:15:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:44.043 23:15:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:44.043 23:15:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:44.043 23:15:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:44.043 23:15:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:44.043 23:15:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:44.043 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:44.043 23:15:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:44.043 23:15:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:44.043 23:15:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:44.043 23:15:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:44.043 23:15:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:44.043 23:15:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:44.043 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:44.043 23:15:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:44.043 23:15:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:44.043 23:15:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:44.043 23:15:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:44.043 23:15:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:44.043 23:15:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:44.043 23:15:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:44.043 23:15:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:44.043 23:15:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:44.043 23:15:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:44.043 23:15:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:44.043 23:15:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:44.043 23:15:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:44.043 23:15:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:44.043 23:15:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:44.043 23:15:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:44.043 23:15:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:44.043 23:15:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:44.043 23:15:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:44.043 23:15:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:44.043 23:15:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:44.043 23:15:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:44.043 23:15:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:44.043 23:15:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:44.043 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:44.043 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:22:44.043 00:22:44.043 --- 10.0.0.2 ping statistics --- 00:22:44.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:44.043 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:22:44.043 23:15:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:44.043 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:44.043 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:22:44.043 00:22:44.043 --- 10.0.0.1 ping statistics --- 00:22:44.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:44.043 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:22:44.043 23:15:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:44.043 23:15:10 -- nvmf/common.sh@410 -- # return 0 00:22:44.043 23:15:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:44.043 23:15:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:44.043 23:15:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:44.043 23:15:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:44.043 23:15:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:44.043 23:15:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:44.043 23:15:10 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:44.043 23:15:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:44.043 23:15:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:44.043 23:15:10 -- common/autotest_common.sh@10 -- # set +x 00:22:44.043 23:15:10 -- nvmf/common.sh@469 -- # nvmfpid=271041 00:22:44.043 23:15:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:44.043 23:15:10 -- nvmf/common.sh@470 -- # waitforlisten 271041 00:22:44.043 23:15:10 -- common/autotest_common.sh@829 -- # '[' -z 271041 ']' 00:22:44.043 23:15:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:44.043 23:15:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:44.043 23:15:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:44.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:44.043 23:15:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:44.043 23:15:10 -- common/autotest_common.sh@10 -- # set +x 00:22:44.043 [2024-11-26 23:15:10.387161] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:44.043 [2024-11-26 23:15:10.387243] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:44.043 EAL: No free 2048 kB hugepages reported on node 1 00:22:44.301 [2024-11-26 23:15:10.461990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:44.301 [2024-11-26 23:15:10.580078] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:44.301 [2024-11-26 23:15:10.580235] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:44.301 [2024-11-26 23:15:10.580253] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:44.301 [2024-11-26 23:15:10.580266] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:44.301 [2024-11-26 23:15:10.580390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:44.301 [2024-11-26 23:15:10.580454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:44.301 [2024-11-26 23:15:10.580506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:44.301 [2024-11-26 23:15:10.580508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:45.235 23:15:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:45.235 23:15:11 -- common/autotest_common.sh@862 -- # return 0 00:22:45.235 23:15:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:45.235 23:15:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:45.235 23:15:11 -- common/autotest_common.sh@10 -- # set +x 00:22:45.235 23:15:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:45.235 23:15:11 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:45.235 23:15:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.235 23:15:11 -- common/autotest_common.sh@10 -- # set +x 00:22:45.235 [2024-11-26 23:15:11.386998] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:45.235 23:15:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.235 23:15:11 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:45.235 23:15:11 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:45.235 23:15:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:45.235 23:15:11 -- common/autotest_common.sh@10 -- # set +x 00:22:45.235 23:15:11 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:45.235 23:15:11 -- target/shutdown.sh@28 -- # cat 00:22:45.235 23:15:11 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:45.235 23:15:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.235 23:15:11 -- common/autotest_common.sh@10 -- # set +x 00:22:45.235 Malloc1 00:22:45.235 [2024-11-26 23:15:11.462410] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:45.235 Malloc2 00:22:45.235 Malloc3 00:22:45.235 Malloc4 00:22:45.235 Malloc5 00:22:45.493 Malloc6 00:22:45.493 Malloc7 00:22:45.493 Malloc8 00:22:45.493 Malloc9 00:22:45.493 Malloc10 00:22:45.752 23:15:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.752 23:15:11 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:45.752 23:15:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:45.752 23:15:11 -- common/autotest_common.sh@10 -- # set +x 00:22:45.752 23:15:11 -- target/shutdown.sh@102 -- # perfpid=271235 00:22:45.752 23:15:11 -- target/shutdown.sh@103 -- # waitforlisten 271235 /var/tmp/bdevperf.sock 00:22:45.752 23:15:11 -- common/autotest_common.sh@829 -- # '[' -z 271235 ']' 00:22:45.752 23:15:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:45.752 23:15:11 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:45.752 23:15:11 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:45.752 23:15:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:45.752 23:15:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:45.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:45.752 23:15:11 -- nvmf/common.sh@520 -- # config=() 00:22:45.752 23:15:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:45.752 23:15:11 -- nvmf/common.sh@520 -- # local subsystem config 00:22:45.752 23:15:11 -- common/autotest_common.sh@10 -- # set +x 00:22:45.752 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.752 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.752 { 00:22:45.752 "params": { 00:22:45.752 "name": "Nvme$subsystem", 00:22:45.752 "trtype": "$TEST_TRANSPORT", 00:22:45.752 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.752 "adrfam": "ipv4", 00:22:45.752 "trsvcid": "$NVMF_PORT", 00:22:45.752 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.752 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.752 "hdgst": ${hdgst:-false}, 00:22:45.752 "ddgst": ${ddgst:-false} 00:22:45.752 }, 00:22:45.752 "method": "bdev_nvme_attach_controller" 00:22:45.752 } 00:22:45.752 EOF 00:22:45.752 )") 00:22:45.752 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.752 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.752 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.752 { 00:22:45.752 "params": { 00:22:45.752 "name": "Nvme$subsystem", 00:22:45.752 "trtype": "$TEST_TRANSPORT", 00:22:45.752 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.752 "adrfam": "ipv4", 00:22:45.752 "trsvcid": "$NVMF_PORT", 00:22:45.752 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.752 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.752 "hdgst": ${hdgst:-false}, 00:22:45.752 "ddgst": ${ddgst:-false} 00:22:45.752 }, 00:22:45.752 "method": "bdev_nvme_attach_controller" 00:22:45.752 } 00:22:45.752 EOF 00:22:45.752 )") 00:22:45.752 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.752 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.752 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.752 { 00:22:45.752 "params": { 00:22:45.752 "name": "Nvme$subsystem", 00:22:45.752 "trtype": "$TEST_TRANSPORT", 00:22:45.752 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.752 "adrfam": "ipv4", 00:22:45.752 "trsvcid": "$NVMF_PORT", 00:22:45.752 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.752 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.752 "hdgst": ${hdgst:-false}, 00:22:45.752 "ddgst": ${ddgst:-false} 00:22:45.752 }, 00:22:45.752 "method": "bdev_nvme_attach_controller" 00:22:45.752 } 00:22:45.752 EOF 00:22:45.752 )") 00:22:45.752 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.752 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.752 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.752 { 00:22:45.752 "params": { 00:22:45.752 "name": "Nvme$subsystem", 00:22:45.752 "trtype": "$TEST_TRANSPORT", 00:22:45.752 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.752 "adrfam": "ipv4", 00:22:45.752 "trsvcid": "$NVMF_PORT", 00:22:45.752 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.752 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.752 "hdgst": ${hdgst:-false}, 00:22:45.752 "ddgst": ${ddgst:-false} 00:22:45.752 }, 00:22:45.752 "method": "bdev_nvme_attach_controller" 00:22:45.752 } 00:22:45.752 EOF 00:22:45.752 )") 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.753 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.753 { 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme$subsystem", 00:22:45.753 "trtype": "$TEST_TRANSPORT", 00:22:45.753 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "$NVMF_PORT", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.753 "hdgst": ${hdgst:-false}, 00:22:45.753 "ddgst": ${ddgst:-false} 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 } 00:22:45.753 EOF 00:22:45.753 )") 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.753 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.753 { 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme$subsystem", 00:22:45.753 "trtype": "$TEST_TRANSPORT", 00:22:45.753 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "$NVMF_PORT", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.753 "hdgst": ${hdgst:-false}, 00:22:45.753 "ddgst": ${ddgst:-false} 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 } 00:22:45.753 EOF 00:22:45.753 )") 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.753 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.753 { 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme$subsystem", 00:22:45.753 "trtype": "$TEST_TRANSPORT", 00:22:45.753 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "$NVMF_PORT", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.753 "hdgst": ${hdgst:-false}, 00:22:45.753 "ddgst": ${ddgst:-false} 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 } 00:22:45.753 EOF 00:22:45.753 )") 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.753 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.753 { 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme$subsystem", 00:22:45.753 "trtype": "$TEST_TRANSPORT", 00:22:45.753 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "$NVMF_PORT", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.753 "hdgst": ${hdgst:-false}, 00:22:45.753 "ddgst": ${ddgst:-false} 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 } 00:22:45.753 EOF 00:22:45.753 )") 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.753 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.753 { 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme$subsystem", 00:22:45.753 "trtype": "$TEST_TRANSPORT", 00:22:45.753 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "$NVMF_PORT", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.753 "hdgst": ${hdgst:-false}, 00:22:45.753 "ddgst": ${ddgst:-false} 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 } 00:22:45.753 EOF 00:22:45.753 )") 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.753 23:15:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.753 { 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme$subsystem", 00:22:45.753 "trtype": "$TEST_TRANSPORT", 00:22:45.753 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "$NVMF_PORT", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.753 "hdgst": ${hdgst:-false}, 00:22:45.753 "ddgst": ${ddgst:-false} 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 } 00:22:45.753 EOF 00:22:45.753 )") 00:22:45.753 23:15:11 -- nvmf/common.sh@542 -- # cat 00:22:45.753 23:15:11 -- nvmf/common.sh@544 -- # jq . 00:22:45.753 23:15:11 -- nvmf/common.sh@545 -- # IFS=, 00:22:45.753 23:15:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme1", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme2", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme3", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme4", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme5", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme6", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme7", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme8", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme9", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:45.753 "hdgst": false, 00:22:45.753 "ddgst": false 00:22:45.753 }, 00:22:45.753 "method": "bdev_nvme_attach_controller" 00:22:45.753 },{ 00:22:45.753 "params": { 00:22:45.753 "name": "Nvme10", 00:22:45.753 "trtype": "tcp", 00:22:45.753 "traddr": "10.0.0.2", 00:22:45.753 "adrfam": "ipv4", 00:22:45.753 "trsvcid": "4420", 00:22:45.753 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:45.753 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:45.754 "hdgst": false, 00:22:45.754 "ddgst": false 00:22:45.754 }, 00:22:45.754 "method": "bdev_nvme_attach_controller" 00:22:45.754 }' 00:22:45.754 [2024-11-26 23:15:11.968171] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:45.754 [2024-11-26 23:15:11.968255] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid271235 ] 00:22:45.754 EAL: No free 2048 kB hugepages reported on node 1 00:22:45.754 [2024-11-26 23:15:12.033141] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:45.754 [2024-11-26 23:15:12.142853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:47.652 Running I/O for 10 seconds... 00:22:48.218 23:15:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:48.218 23:15:14 -- common/autotest_common.sh@862 -- # return 0 00:22:48.218 23:15:14 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:48.218 23:15:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.218 23:15:14 -- common/autotest_common.sh@10 -- # set +x 00:22:48.218 23:15:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.218 23:15:14 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:48.218 23:15:14 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:48.218 23:15:14 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:48.218 23:15:14 -- target/shutdown.sh@57 -- # local ret=1 00:22:48.218 23:15:14 -- target/shutdown.sh@58 -- # local i 00:22:48.218 23:15:14 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:48.218 23:15:14 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:48.218 23:15:14 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:48.218 23:15:14 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:48.218 23:15:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.218 23:15:14 -- common/autotest_common.sh@10 -- # set +x 00:22:48.218 23:15:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.218 23:15:14 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:48.218 23:15:14 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:48.218 23:15:14 -- target/shutdown.sh@64 -- # ret=0 00:22:48.218 23:15:14 -- target/shutdown.sh@65 -- # break 00:22:48.218 23:15:14 -- target/shutdown.sh@69 -- # return 0 00:22:48.218 23:15:14 -- target/shutdown.sh@109 -- # killprocess 271235 00:22:48.218 23:15:14 -- common/autotest_common.sh@936 -- # '[' -z 271235 ']' 00:22:48.218 23:15:14 -- common/autotest_common.sh@940 -- # kill -0 271235 00:22:48.218 23:15:14 -- common/autotest_common.sh@941 -- # uname 00:22:48.218 23:15:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:48.218 23:15:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 271235 00:22:48.218 23:15:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:48.218 23:15:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:48.218 23:15:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 271235' 00:22:48.218 killing process with pid 271235 00:22:48.218 23:15:14 -- common/autotest_common.sh@955 -- # kill 271235 00:22:48.218 23:15:14 -- common/autotest_common.sh@960 -- # wait 271235 00:22:48.475 Received shutdown signal, test time was about 0.668689 seconds 00:22:48.475 00:22:48.475 Latency(us) 00:22:48.475 [2024-11-26T22:15:14.869Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:48.475 [2024-11-26T22:15:14.870Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme1n1 : 0.66 412.82 25.80 0.00 0.00 151300.53 14175.19 122722.23 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme2n1 : 0.66 412.00 25.75 0.00 0.00 149797.06 16505.36 121945.51 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme3n1 : 0.66 411.16 25.70 0.00 0.00 147385.86 20583.16 141363.58 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme4n1 : 0.66 410.18 25.64 0.00 0.00 146830.80 17670.45 119615.34 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme5n1 : 0.67 408.80 25.55 0.00 0.00 145465.11 18350.08 120392.06 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme6n1 : 0.67 407.26 25.45 0.00 0.00 144426.03 17767.54 121945.51 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme7n1 : 0.63 363.64 22.73 0.00 0.00 157765.89 21845.33 123498.95 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme8n1 : 0.63 361.09 22.57 0.00 0.00 157157.80 21359.88 125829.12 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme9n1 : 0.64 358.00 22.37 0.00 0.00 156790.73 20194.80 128159.29 00:22:48.476 [2024-11-26T22:15:14.870Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.476 Verification LBA range: start 0x0 length 0x400 00:22:48.476 Nvme10n1 : 0.65 351.77 21.99 0.00 0.00 157201.23 23787.14 128159.29 00:22:48.476 [2024-11-26T22:15:14.870Z] =================================================================================================================== 00:22:48.476 [2024-11-26T22:15:14.870Z] Total : 3896.71 243.54 0.00 0.00 151009.68 14175.19 141363.58 00:22:48.734 23:15:14 -- target/shutdown.sh@112 -- # sleep 1 00:22:49.666 23:15:15 -- target/shutdown.sh@113 -- # kill -0 271041 00:22:49.666 23:15:15 -- target/shutdown.sh@115 -- # stoptarget 00:22:49.666 23:15:15 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:49.666 23:15:15 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:49.666 23:15:15 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:49.666 23:15:15 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:49.666 23:15:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:49.666 23:15:15 -- nvmf/common.sh@116 -- # sync 00:22:49.666 23:15:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:49.666 23:15:15 -- nvmf/common.sh@119 -- # set +e 00:22:49.666 23:15:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:49.666 23:15:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:49.666 rmmod nvme_tcp 00:22:49.666 rmmod nvme_fabrics 00:22:49.666 rmmod nvme_keyring 00:22:49.666 23:15:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:49.666 23:15:15 -- nvmf/common.sh@123 -- # set -e 00:22:49.666 23:15:15 -- nvmf/common.sh@124 -- # return 0 00:22:49.666 23:15:15 -- nvmf/common.sh@477 -- # '[' -n 271041 ']' 00:22:49.666 23:15:15 -- nvmf/common.sh@478 -- # killprocess 271041 00:22:49.666 23:15:15 -- common/autotest_common.sh@936 -- # '[' -z 271041 ']' 00:22:49.666 23:15:15 -- common/autotest_common.sh@940 -- # kill -0 271041 00:22:49.666 23:15:15 -- common/autotest_common.sh@941 -- # uname 00:22:49.666 23:15:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:49.666 23:15:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 271041 00:22:49.666 23:15:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:49.666 23:15:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:49.666 23:15:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 271041' 00:22:49.666 killing process with pid 271041 00:22:49.666 23:15:16 -- common/autotest_common.sh@955 -- # kill 271041 00:22:49.666 23:15:16 -- common/autotest_common.sh@960 -- # wait 271041 00:22:50.231 23:15:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:50.231 23:15:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:50.231 23:15:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:50.231 23:15:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:50.231 23:15:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:50.231 23:15:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:50.231 23:15:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:50.231 23:15:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:52.767 23:15:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:52.767 00:22:52.767 real 0m8.384s 00:22:52.767 user 0m26.723s 00:22:52.767 sys 0m1.501s 00:22:52.767 23:15:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:52.767 23:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:52.767 ************************************ 00:22:52.767 END TEST nvmf_shutdown_tc2 00:22:52.767 ************************************ 00:22:52.767 23:15:18 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:52.767 23:15:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:52.767 23:15:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:52.767 23:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:52.767 ************************************ 00:22:52.767 START TEST nvmf_shutdown_tc3 00:22:52.767 ************************************ 00:22:52.767 23:15:18 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:52.767 23:15:18 -- target/shutdown.sh@120 -- # starttarget 00:22:52.767 23:15:18 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:52.767 23:15:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:52.767 23:15:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:52.767 23:15:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:52.767 23:15:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:52.767 23:15:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:52.767 23:15:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:52.767 23:15:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:52.767 23:15:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:52.767 23:15:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:52.767 23:15:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:52.767 23:15:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:52.767 23:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:52.767 23:15:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:52.767 23:15:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:52.767 23:15:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:52.767 23:15:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:52.767 23:15:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:52.767 23:15:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:52.767 23:15:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:52.767 23:15:18 -- nvmf/common.sh@294 -- # net_devs=() 00:22:52.767 23:15:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:52.767 23:15:18 -- nvmf/common.sh@295 -- # e810=() 00:22:52.767 23:15:18 -- nvmf/common.sh@295 -- # local -ga e810 00:22:52.767 23:15:18 -- nvmf/common.sh@296 -- # x722=() 00:22:52.767 23:15:18 -- nvmf/common.sh@296 -- # local -ga x722 00:22:52.767 23:15:18 -- nvmf/common.sh@297 -- # mlx=() 00:22:52.767 23:15:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:52.767 23:15:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:52.767 23:15:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:52.768 23:15:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:52.768 23:15:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:52.768 23:15:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:52.768 23:15:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:52.768 23:15:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:52.768 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:52.768 23:15:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:52.768 23:15:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:52.768 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:52.768 23:15:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:52.768 23:15:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:52.768 23:15:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:52.768 23:15:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:52.768 23:15:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:52.768 23:15:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:52.768 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:52.768 23:15:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:52.768 23:15:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:52.768 23:15:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:52.768 23:15:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:52.768 23:15:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:52.768 23:15:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:52.768 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:52.768 23:15:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:52.768 23:15:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:52.768 23:15:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:52.768 23:15:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:52.768 23:15:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:52.768 23:15:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:52.768 23:15:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:52.768 23:15:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:52.768 23:15:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:52.768 23:15:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:52.768 23:15:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:52.768 23:15:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:52.768 23:15:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:52.768 23:15:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:52.768 23:15:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:52.768 23:15:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:52.768 23:15:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:52.768 23:15:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:52.768 23:15:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:52.768 23:15:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:52.768 23:15:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:52.768 23:15:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:52.768 23:15:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:52.768 23:15:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:52.768 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:52.768 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.144 ms 00:22:52.768 00:22:52.768 --- 10.0.0.2 ping statistics --- 00:22:52.768 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:52.768 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:22:52.768 23:15:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:52.768 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:52.768 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:22:52.768 00:22:52.768 --- 10.0.0.1 ping statistics --- 00:22:52.768 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:52.768 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:22:52.768 23:15:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:52.768 23:15:18 -- nvmf/common.sh@410 -- # return 0 00:22:52.768 23:15:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:52.768 23:15:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:52.768 23:15:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:52.768 23:15:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:52.768 23:15:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:52.768 23:15:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:52.768 23:15:18 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:52.768 23:15:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:52.768 23:15:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:52.768 23:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:52.768 23:15:18 -- nvmf/common.sh@469 -- # nvmfpid=272269 00:22:52.768 23:15:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:52.768 23:15:18 -- nvmf/common.sh@470 -- # waitforlisten 272269 00:22:52.768 23:15:18 -- common/autotest_common.sh@829 -- # '[' -z 272269 ']' 00:22:52.768 23:15:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:52.768 23:15:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:52.768 23:15:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:52.768 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:52.768 23:15:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:52.768 23:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:52.768 [2024-11-26 23:15:18.906024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:52.768 [2024-11-26 23:15:18.906108] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:52.768 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.768 [2024-11-26 23:15:18.978106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:52.768 [2024-11-26 23:15:19.087364] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:52.768 [2024-11-26 23:15:19.087518] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:52.768 [2024-11-26 23:15:19.087542] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:52.768 [2024-11-26 23:15:19.087562] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:52.768 [2024-11-26 23:15:19.087664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:52.768 [2024-11-26 23:15:19.087730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:52.768 [2024-11-26 23:15:19.087792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:52.768 [2024-11-26 23:15:19.087794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:53.700 23:15:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:53.700 23:15:19 -- common/autotest_common.sh@862 -- # return 0 00:22:53.700 23:15:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:53.700 23:15:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:53.700 23:15:19 -- common/autotest_common.sh@10 -- # set +x 00:22:53.700 23:15:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:53.700 23:15:19 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:53.700 23:15:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.700 23:15:19 -- common/autotest_common.sh@10 -- # set +x 00:22:53.700 [2024-11-26 23:15:19.891070] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:53.700 23:15:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.700 23:15:19 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:53.700 23:15:19 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:53.700 23:15:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:53.700 23:15:19 -- common/autotest_common.sh@10 -- # set +x 00:22:53.700 23:15:19 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.700 23:15:19 -- target/shutdown.sh@28 -- # cat 00:22:53.700 23:15:19 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:53.700 23:15:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.700 23:15:19 -- common/autotest_common.sh@10 -- # set +x 00:22:53.700 Malloc1 00:22:53.700 [2024-11-26 23:15:19.967007] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:53.700 Malloc2 00:22:53.700 Malloc3 00:22:53.700 Malloc4 00:22:53.958 Malloc5 00:22:53.958 Malloc6 00:22:53.958 Malloc7 00:22:53.958 Malloc8 00:22:53.958 Malloc9 00:22:54.217 Malloc10 00:22:54.217 23:15:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.217 23:15:20 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:54.217 23:15:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:54.217 23:15:20 -- common/autotest_common.sh@10 -- # set +x 00:22:54.217 23:15:20 -- target/shutdown.sh@124 -- # perfpid=272481 00:22:54.217 23:15:20 -- target/shutdown.sh@125 -- # waitforlisten 272481 /var/tmp/bdevperf.sock 00:22:54.217 23:15:20 -- common/autotest_common.sh@829 -- # '[' -z 272481 ']' 00:22:54.217 23:15:20 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:54.217 23:15:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:54.217 23:15:20 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:54.217 23:15:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:54.217 23:15:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:54.217 23:15:20 -- nvmf/common.sh@520 -- # config=() 00:22:54.217 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:54.217 23:15:20 -- nvmf/common.sh@520 -- # local subsystem config 00:22:54.217 23:15:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:54.217 23:15:20 -- common/autotest_common.sh@10 -- # set +x 00:22:54.217 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.217 { 00:22:54.217 "params": { 00:22:54.217 "name": "Nvme$subsystem", 00:22:54.217 "trtype": "$TEST_TRANSPORT", 00:22:54.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.217 "adrfam": "ipv4", 00:22:54.217 "trsvcid": "$NVMF_PORT", 00:22:54.217 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.217 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.217 "hdgst": ${hdgst:-false}, 00:22:54.217 "ddgst": ${ddgst:-false} 00:22:54.217 }, 00:22:54.217 "method": "bdev_nvme_attach_controller" 00:22:54.217 } 00:22:54.217 EOF 00:22:54.217 )") 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.217 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.217 { 00:22:54.217 "params": { 00:22:54.217 "name": "Nvme$subsystem", 00:22:54.217 "trtype": "$TEST_TRANSPORT", 00:22:54.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.217 "adrfam": "ipv4", 00:22:54.217 "trsvcid": "$NVMF_PORT", 00:22:54.217 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.217 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.217 "hdgst": ${hdgst:-false}, 00:22:54.217 "ddgst": ${ddgst:-false} 00:22:54.217 }, 00:22:54.217 "method": "bdev_nvme_attach_controller" 00:22:54.217 } 00:22:54.217 EOF 00:22:54.217 )") 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.217 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.217 { 00:22:54.217 "params": { 00:22:54.217 "name": "Nvme$subsystem", 00:22:54.217 "trtype": "$TEST_TRANSPORT", 00:22:54.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.217 "adrfam": "ipv4", 00:22:54.217 "trsvcid": "$NVMF_PORT", 00:22:54.217 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.217 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.217 "hdgst": ${hdgst:-false}, 00:22:54.217 "ddgst": ${ddgst:-false} 00:22:54.217 }, 00:22:54.217 "method": "bdev_nvme_attach_controller" 00:22:54.217 } 00:22:54.217 EOF 00:22:54.217 )") 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.217 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.217 { 00:22:54.217 "params": { 00:22:54.217 "name": "Nvme$subsystem", 00:22:54.217 "trtype": "$TEST_TRANSPORT", 00:22:54.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.217 "adrfam": "ipv4", 00:22:54.217 "trsvcid": "$NVMF_PORT", 00:22:54.217 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.217 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.217 "hdgst": ${hdgst:-false}, 00:22:54.217 "ddgst": ${ddgst:-false} 00:22:54.217 }, 00:22:54.217 "method": "bdev_nvme_attach_controller" 00:22:54.217 } 00:22:54.217 EOF 00:22:54.217 )") 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.217 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.217 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.217 { 00:22:54.217 "params": { 00:22:54.217 "name": "Nvme$subsystem", 00:22:54.217 "trtype": "$TEST_TRANSPORT", 00:22:54.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.217 "adrfam": "ipv4", 00:22:54.217 "trsvcid": "$NVMF_PORT", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.218 "hdgst": ${hdgst:-false}, 00:22:54.218 "ddgst": ${ddgst:-false} 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 } 00:22:54.218 EOF 00:22:54.218 )") 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.218 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.218 { 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme$subsystem", 00:22:54.218 "trtype": "$TEST_TRANSPORT", 00:22:54.218 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "$NVMF_PORT", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.218 "hdgst": ${hdgst:-false}, 00:22:54.218 "ddgst": ${ddgst:-false} 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 } 00:22:54.218 EOF 00:22:54.218 )") 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.218 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.218 { 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme$subsystem", 00:22:54.218 "trtype": "$TEST_TRANSPORT", 00:22:54.218 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "$NVMF_PORT", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.218 "hdgst": ${hdgst:-false}, 00:22:54.218 "ddgst": ${ddgst:-false} 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 } 00:22:54.218 EOF 00:22:54.218 )") 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.218 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.218 { 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme$subsystem", 00:22:54.218 "trtype": "$TEST_TRANSPORT", 00:22:54.218 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "$NVMF_PORT", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.218 "hdgst": ${hdgst:-false}, 00:22:54.218 "ddgst": ${ddgst:-false} 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 } 00:22:54.218 EOF 00:22:54.218 )") 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.218 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.218 { 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme$subsystem", 00:22:54.218 "trtype": "$TEST_TRANSPORT", 00:22:54.218 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "$NVMF_PORT", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.218 "hdgst": ${hdgst:-false}, 00:22:54.218 "ddgst": ${ddgst:-false} 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 } 00:22:54.218 EOF 00:22:54.218 )") 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.218 23:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:54.218 { 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme$subsystem", 00:22:54.218 "trtype": "$TEST_TRANSPORT", 00:22:54.218 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "$NVMF_PORT", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:54.218 "hdgst": ${hdgst:-false}, 00:22:54.218 "ddgst": ${ddgst:-false} 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 } 00:22:54.218 EOF 00:22:54.218 )") 00:22:54.218 23:15:20 -- nvmf/common.sh@542 -- # cat 00:22:54.218 23:15:20 -- nvmf/common.sh@544 -- # jq . 00:22:54.218 23:15:20 -- nvmf/common.sh@545 -- # IFS=, 00:22:54.218 23:15:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme1", 00:22:54.218 "trtype": "tcp", 00:22:54.218 "traddr": "10.0.0.2", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "4420", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:54.218 "hdgst": false, 00:22:54.218 "ddgst": false 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 },{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme2", 00:22:54.218 "trtype": "tcp", 00:22:54.218 "traddr": "10.0.0.2", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "4420", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:54.218 "hdgst": false, 00:22:54.218 "ddgst": false 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 },{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme3", 00:22:54.218 "trtype": "tcp", 00:22:54.218 "traddr": "10.0.0.2", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "4420", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:54.218 "hdgst": false, 00:22:54.218 "ddgst": false 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 },{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme4", 00:22:54.218 "trtype": "tcp", 00:22:54.218 "traddr": "10.0.0.2", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "4420", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:54.218 "hdgst": false, 00:22:54.218 "ddgst": false 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 },{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme5", 00:22:54.218 "trtype": "tcp", 00:22:54.218 "traddr": "10.0.0.2", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "4420", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:54.218 "hdgst": false, 00:22:54.218 "ddgst": false 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 },{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme6", 00:22:54.218 "trtype": "tcp", 00:22:54.218 "traddr": "10.0.0.2", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "4420", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:54.218 "hdgst": false, 00:22:54.218 "ddgst": false 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 },{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme7", 00:22:54.218 "trtype": "tcp", 00:22:54.218 "traddr": "10.0.0.2", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "4420", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:54.218 "hdgst": false, 00:22:54.218 "ddgst": false 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 },{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme8", 00:22:54.218 "trtype": "tcp", 00:22:54.218 "traddr": "10.0.0.2", 00:22:54.218 "adrfam": "ipv4", 00:22:54.218 "trsvcid": "4420", 00:22:54.218 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:54.218 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:54.218 "hdgst": false, 00:22:54.218 "ddgst": false 00:22:54.218 }, 00:22:54.218 "method": "bdev_nvme_attach_controller" 00:22:54.218 },{ 00:22:54.218 "params": { 00:22:54.218 "name": "Nvme9", 00:22:54.219 "trtype": "tcp", 00:22:54.219 "traddr": "10.0.0.2", 00:22:54.219 "adrfam": "ipv4", 00:22:54.219 "trsvcid": "4420", 00:22:54.219 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:54.219 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:54.219 "hdgst": false, 00:22:54.219 "ddgst": false 00:22:54.219 }, 00:22:54.219 "method": "bdev_nvme_attach_controller" 00:22:54.219 },{ 00:22:54.219 "params": { 00:22:54.219 "name": "Nvme10", 00:22:54.219 "trtype": "tcp", 00:22:54.219 "traddr": "10.0.0.2", 00:22:54.219 "adrfam": "ipv4", 00:22:54.219 "trsvcid": "4420", 00:22:54.219 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:54.219 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:54.219 "hdgst": false, 00:22:54.219 "ddgst": false 00:22:54.219 }, 00:22:54.219 "method": "bdev_nvme_attach_controller" 00:22:54.219 }' 00:22:54.219 [2024-11-26 23:15:20.479972] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:54.219 [2024-11-26 23:15:20.480048] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid272481 ] 00:22:54.219 EAL: No free 2048 kB hugepages reported on node 1 00:22:54.219 [2024-11-26 23:15:20.544972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:54.477 [2024-11-26 23:15:20.654093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:56.375 Running I/O for 10 seconds... 00:22:56.633 23:15:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:56.633 23:15:22 -- common/autotest_common.sh@862 -- # return 0 00:22:56.633 23:15:22 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:56.633 23:15:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.633 23:15:22 -- common/autotest_common.sh@10 -- # set +x 00:22:56.633 23:15:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.633 23:15:23 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:56.633 23:15:23 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:56.633 23:15:23 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:56.633 23:15:23 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:56.633 23:15:23 -- target/shutdown.sh@57 -- # local ret=1 00:22:56.633 23:15:23 -- target/shutdown.sh@58 -- # local i 00:22:56.633 23:15:23 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:56.633 23:15:23 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:56.633 23:15:23 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:56.633 23:15:23 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:56.633 23:15:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.633 23:15:23 -- common/autotest_common.sh@10 -- # set +x 00:22:56.903 23:15:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.903 23:15:23 -- target/shutdown.sh@60 -- # read_io_count=254 00:22:56.903 23:15:23 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:22:56.903 23:15:23 -- target/shutdown.sh@64 -- # ret=0 00:22:56.903 23:15:23 -- target/shutdown.sh@65 -- # break 00:22:56.903 23:15:23 -- target/shutdown.sh@69 -- # return 0 00:22:56.903 23:15:23 -- target/shutdown.sh@134 -- # killprocess 272269 00:22:56.903 23:15:23 -- common/autotest_common.sh@936 -- # '[' -z 272269 ']' 00:22:56.903 23:15:23 -- common/autotest_common.sh@940 -- # kill -0 272269 00:22:56.903 23:15:23 -- common/autotest_common.sh@941 -- # uname 00:22:56.903 23:15:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:56.903 23:15:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 272269 00:22:56.903 23:15:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:56.903 23:15:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:56.903 23:15:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 272269' 00:22:56.903 killing process with pid 272269 00:22:56.903 23:15:23 -- common/autotest_common.sh@955 -- # kill 272269 00:22:56.903 23:15:23 -- common/autotest_common.sh@960 -- # wait 272269 00:22:56.903 [2024-11-26 23:15:23.078600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.078989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.079303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391cd0 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.903 [2024-11-26 23:15:23.080928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.080940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.080952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.080964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.080976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.080988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.081274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238f790 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.082088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.904 [2024-11-26 23:15:23.082127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082145] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.904 [2024-11-26 23:15:23.082160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.904 [2024-11-26 23:15:23.082189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082205] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.904 [2024-11-26 23:15:23.082219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb0cf70 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.082285] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.904 [2024-11-26 23:15:23.082306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.904 [2024-11-26 23:15:23.082334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082348] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.904 [2024-11-26 23:15:23.082361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.904 [2024-11-26 23:15:23.082389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb654a0 is same with the state(5) to be set 00:22:56.904 [2024-11-26 23:15:23.082491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.082969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.082985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.083003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.083019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.083034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.083049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.083064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.904 [2024-11-26 23:15:23.083080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.904 [2024-11-26 23:15:23.083094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x238fc40 is same with the state(5) to be set 00:22:56.905 [2024-11-26 23:15:23.083318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.083985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.083999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.905 [2024-11-26 23:15:23.084260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.905 [2024-11-26 23:15:23.084274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.084303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.084331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.084360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:44800 len:12[2024-11-26 23:15:23.084366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390580 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.084393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.084428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.084457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.084487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.084535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.084553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd5d220 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.084628] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xd5d220 was disconnected and freed. reset controller. 00:22:56.906 [2024-11-26 23:15:23.085021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with [2024-11-26 23:15:23.085137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.906 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with [2024-11-26 23:15:23.085346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35584 len:1the state(5) to be set 00:22:56.906 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128[2024-11-26 23:15:23.085423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with [2024-11-26 23:15:23.085438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.906 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.906 [2024-11-26 23:15:23.085522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.906 [2024-11-26 23:15:23.085533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.906 [2024-11-26 23:15:23.085560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with [2024-11-26 23:15:23.085612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:36096 len:1the state(5) to be set 00:22:56.907 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with [2024-11-26 23:15:23.085703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30720 len:12the state(5) to be set 00:22:56.907 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 23:15:23.085719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390a30 is same with the state(5) to be set 00:22:56.907 [2024-11-26 23:15:23.085912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.085983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.085998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.086012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.086032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.086046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.086061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.086074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.086089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.086102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.086117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.086130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.086144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.086158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.086177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.907 [2024-11-26 23:15:23.086191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.907 [2024-11-26 23:15:23.086206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.086977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.086991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.087017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.087032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.087048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.087062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.087078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.087094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.087109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 [2024-11-26 23:15:23.087114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with [2024-11-26 23:15:23.087122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.908 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 [2024-11-26 23:15:23.087142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:40192 len:1[2024-11-26 23:15:23.087142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.908 the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 23:15:23.087158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.908 the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.908 [2024-11-26 23:15:23.087361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087692] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc8e560 was disconnected and freed. reset controller. 00:22:56.909 [2024-11-26 23:15:23.087703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.087903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2390ec0 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.088899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.088932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.088952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.088966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.088978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.088990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.909 [2024-11-26 23:15:23.089482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.089709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391370 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controlle[2024-11-26 23:15:23.090395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with r 00:22:56.910 the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:56.910 [2024-11-26 23:15:23.090436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb654a0 (9): Bad file descriptor 00:22:56.910 [2024-11-26 23:15:23.090461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb0cf70 (9): Bad file descriptor 00:22:56.910 [2024-11-26 23:15:23.090484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.090990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.091269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2391820 is same with the state(5) to be set 00:22:56.910 [2024-11-26 23:15:23.093643] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.910 [2024-11-26 23:15:23.093671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.910 [2024-11-26 23:15:23.093688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.910 [2024-11-26 23:15:23.093702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.910 [2024-11-26 23:15:23.093716] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.910 [2024-11-26 23:15:23.093729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.910 [2024-11-26 23:15:23.093743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.910 [2024-11-26 23:15:23.093757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.093775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcbda60 is same with the state(5) to be set 00:22:56.911 [2024-11-26 23:15:23.093831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.093851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.093866] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.093879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.093893] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.093905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.093919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.093932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.093945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcae0a0 is same with the state(5) to be set 00:22:56.911 [2024-11-26 23:15:23.093990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094026] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094053] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094080] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb38690 is same with the state(5) to be set 00:22:56.911 [2024-11-26 23:15:23.094150] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094250] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcc3150 is same with the state(5) to be set 00:22:56.911 [2024-11-26 23:15:23.094326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcd3600 is same with the state(5) to be set 00:22:56.911 [2024-11-26 23:15:23.094482] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094545] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094575] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094602] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb2f1b0 is same with the state(5) to be set 00:22:56.911 [2024-11-26 23:15:23.094676] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094738] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094771] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb0fcd0 is same with the state(5) to be set 00:22:56.911 [2024-11-26 23:15:23.094855] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094890] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094944] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.911 [2024-11-26 23:15:23.094957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.094971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb5a490 is same with the state(5) to be set 00:22:56.911 [2024-11-26 23:15:23.095416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.095462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.095495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.095547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.095578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.095607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.095641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.095672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.911 [2024-11-26 23:15:23.095702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.911 [2024-11-26 23:15:23.095716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.095976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.095990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd5f9c0 is same with the state(5) to be set 00:22:56.912 [2024-11-26 23:15:23.096257] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xd5f9c0 was disconnected and freed. reset controller. 00:22:56.912 [2024-11-26 23:15:23.096356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.096973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.096987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd60f60 is same with the state(5) to be set 00:22:56.912 [2024-11-26 23:15:23.097188] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xd60f60 was disconnected and freed. reset controller. 00:22:56.912 [2024-11-26 23:15:23.097285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.912 [2024-11-26 23:15:23.097419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.912 [2024-11-26 23:15:23.097433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.097978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.097993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.098007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.098022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.098035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.098051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd61bf0 is same with the state(5) to be set 00:22:56.913 [2024-11-26 23:15:23.098120] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xd61bf0 was disconnected and freed. reset controller. 00:22:56.913 [2024-11-26 23:15:23.098788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.913 [2024-11-26 23:15:23.098901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.913 [2024-11-26 23:15:23.098927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb0cf70 with addr=10.0.0.2, port=4420 00:22:56.913 [2024-11-26 23:15:23.098944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb0cf70 is same with the state(5) to be set 00:22:56.913 [2024-11-26 23:15:23.099025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.913 [2024-11-26 23:15:23.099101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.913 [2024-11-26 23:15:23.099126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb654a0 with addr=10.0.0.2, port=4420 00:22:56.913 [2024-11-26 23:15:23.099142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb654a0 is same with the state(5) to be set 00:22:56.913 [2024-11-26 23:15:23.099237] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.913 [2024-11-26 23:15:23.103248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:56.913 [2024-11-26 23:15:23.103306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:56.913 [2024-11-26 23:15:23.103326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:56.913 [2024-11-26 23:15:23.103355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcc3150 (9): Bad file descriptor 00:22:56.913 [2024-11-26 23:15:23.103381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb38690 (9): Bad file descriptor 00:22:56.913 [2024-11-26 23:15:23.103401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb2f1b0 (9): Bad file descriptor 00:22:56.913 [2024-11-26 23:15:23.103420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb0cf70 (9): Bad file descriptor 00:22:56.913 [2024-11-26 23:15:23.103449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb654a0 (9): Bad file descriptor 00:22:56.913 [2024-11-26 23:15:23.103629] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.913 [2024-11-26 23:15:23.103746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.103773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.103798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.103825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.103843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.103858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.103873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.103888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.103904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.103918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.103934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.103948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.103964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.103978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.103994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.913 [2024-11-26 23:15:23.104271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.913 [2024-11-26 23:15:23.104285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.104596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.104610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd647b0 is same with the state(5) to be set 00:22:56.914 [2024-11-26 23:15:23.104687] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xd647b0 was disconnected and freed. reset controller. 00:22:56.914 [2024-11-26 23:15:23.104887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:56.914 [2024-11-26 23:15:23.104910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:56.914 [2024-11-26 23:15:23.104929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:56.914 [2024-11-26 23:15:23.104950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:56.914 [2024-11-26 23:15:23.104965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:56.914 [2024-11-26 23:15:23.104978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:56.914 [2024-11-26 23:15:23.105002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcbda60 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.105034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcae0a0 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.105071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd3600 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.105102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb0fcd0 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.105133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb5a490 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.105163] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.914 [2024-11-26 23:15:23.105185] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.914 [2024-11-26 23:15:23.107048] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.914 [2024-11-26 23:15:23.107139] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.914 [2024-11-26 23:15:23.107169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.914 [2024-11-26 23:15:23.107186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.914 [2024-11-26 23:15:23.107201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:56.914 [2024-11-26 23:15:23.107335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.914 [2024-11-26 23:15:23.107441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.914 [2024-11-26 23:15:23.107470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb2f1b0 with addr=10.0.0.2, port=4420 00:22:56.914 [2024-11-26 23:15:23.107487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb2f1b0 is same with the state(5) to be set 00:22:56.914 [2024-11-26 23:15:23.107593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.914 [2024-11-26 23:15:23.107677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.914 [2024-11-26 23:15:23.107704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb38690 with addr=10.0.0.2, port=4420 00:22:56.914 [2024-11-26 23:15:23.107729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb38690 is same with the state(5) to be set 00:22:56.914 [2024-11-26 23:15:23.107805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.914 [2024-11-26 23:15:23.107904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.914 [2024-11-26 23:15:23.107930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcc3150 with addr=10.0.0.2, port=4420 00:22:56.914 [2024-11-26 23:15:23.107945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcc3150 is same with the state(5) to be set 00:22:56.914 [2024-11-26 23:15:23.108111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.914 [2024-11-26 23:15:23.108208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.914 [2024-11-26 23:15:23.108234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcbda60 with addr=10.0.0.2, port=4420 00:22:56.914 [2024-11-26 23:15:23.108251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcbda60 is same with the state(5) to be set 00:22:56.914 [2024-11-26 23:15:23.108270] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb2f1b0 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.108289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb38690 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.108307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcc3150 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.108685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcbda60 (9): Bad file descriptor 00:22:56.914 [2024-11-26 23:15:23.108712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:56.914 [2024-11-26 23:15:23.108726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:56.914 [2024-11-26 23:15:23.108740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:56.914 [2024-11-26 23:15:23.108760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:56.914 [2024-11-26 23:15:23.108775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:56.914 [2024-11-26 23:15:23.108788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:56.914 [2024-11-26 23:15:23.108805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:56.914 [2024-11-26 23:15:23.108818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:56.914 [2024-11-26 23:15:23.108835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:56.914 [2024-11-26 23:15:23.108889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.914 [2024-11-26 23:15:23.108908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.914 [2024-11-26 23:15:23.108921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.914 [2024-11-26 23:15:23.108933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:56.914 [2024-11-26 23:15:23.108946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:56.914 [2024-11-26 23:15:23.108959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:56.914 [2024-11-26 23:15:23.109012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.914 [2024-11-26 23:15:23.115054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.914 [2024-11-26 23:15:23.115499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.914 [2024-11-26 23:15:23.115521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.115984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.115999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.915 [2024-11-26 23:15:23.116785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.915 [2024-11-26 23:15:23.116801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.116815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.116832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.116847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.116863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.116877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.116892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.116906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.116921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.116936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.116951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.116965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.116980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.116993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.117009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.117023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.117039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.117053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.117068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.117086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.117102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd5e480 is same with the state(5) to be set 00:22:56.916 [2024-11-26 23:15:23.118370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.118982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.118996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.916 [2024-11-26 23:15:23.119592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.916 [2024-11-26 23:15:23.119608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.119981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.119994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.120354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.120369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd631d0 is same with the state(5) to be set 00:22:56.917 [2024-11-26 23:15:23.121615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.121970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.121984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.917 [2024-11-26 23:15:23.122346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.917 [2024-11-26 23:15:23.122362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.122978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.122994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.123592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.123606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd65d90 is same with the state(5) to be set 00:22:56.918 [2024-11-26 23:15:23.124813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.124837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.124857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.124873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.124890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.124904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.124920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.124935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.124951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.124964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.124980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.124995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.125011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.125025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.125041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.125060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.918 [2024-11-26 23:15:23.125076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.918 [2024-11-26 23:15:23.125090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.125973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.125989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.919 [2024-11-26 23:15:23.126471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.919 [2024-11-26 23:15:23.126484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.920 [2024-11-26 23:15:23.126767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.920 [2024-11-26 23:15:23.126781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8cf80 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.128354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:56.920 [2024-11-26 23:15:23.128390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:56.920 [2024-11-26 23:15:23.128426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:56.920 [2024-11-26 23:15:23.128536] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.128566] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.128586] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.128610] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.128630] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.128649] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.128727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:56.920 [2024-11-26 23:15:23.128753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:56.920 task offset: 40320 on job bdev=Nvme1n1 fails 00:22:56.920 00:22:56.920 Latency(us) 00:22:56.920 [2024-11-26T22:15:23.314Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme1n1 ended in about 0.77 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme1n1 : 0.77 378.06 23.63 83.15 0.00 137876.19 6844.87 119615.34 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme2n1 ended in about 0.80 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme2n1 : 0.80 314.13 19.63 80.10 0.00 159810.13 100973.99 147577.36 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme3n1 ended in about 0.78 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme3n1 : 0.78 372.57 23.29 30.73 0.00 153654.30 8107.05 121168.78 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme4n1 ended in about 0.78 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme4n1 : 0.78 372.11 23.26 30.69 0.00 152261.28 8155.59 116508.44 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme5n1 ended in about 0.78 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme5n1 : 0.78 371.67 23.23 30.65 0.00 150939.31 8204.14 117285.17 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme6n1 ended in about 0.80 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme6n1 : 0.80 312.86 19.55 79.77 0.00 154373.07 92818.39 125829.12 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme7n1 ended in about 0.79 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme7n1 : 0.79 366.84 22.93 33.00 0.00 149560.32 3325.35 118838.61 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme8n1 ended in about 0.81 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme8n1 : 0.81 311.61 19.48 79.45 0.00 152045.37 87381.33 122722.23 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme9n1 ended in about 0.81 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme9n1 : 0.81 310.39 19.40 79.14 0.00 151155.84 76507.21 123498.95 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.920 [2024-11-26T22:15:23.314Z] Job: Nvme10n1 ended in about 0.77 seconds with error 00:22:56.920 Verification LBA range: start 0x0 length 0x400 00:22:56.920 Nvme10n1 : 0.77 325.45 20.34 82.98 0.00 142097.92 22330.79 125052.40 00:22:56.920 [2024-11-26T22:15:23.314Z] =================================================================================================================== 00:22:56.920 [2024-11-26T22:15:23.314Z] Total : 3435.69 214.73 609.67 0.00 150220.62 3325.35 147577.36 00:22:56.920 [2024-11-26 23:15:23.154007] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:56.920 [2024-11-26 23:15:23.154099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:56.920 [2024-11-26 23:15:23.154138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:56.920 [2024-11-26 23:15:23.154158] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:56.920 [2024-11-26 23:15:23.154175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:56.920 [2024-11-26 23:15:23.154427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.154562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.154591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb654a0 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.154611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb654a0 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.154715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.154800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.154826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb0cf70 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.154841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb0cf70 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.154931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.155016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.155042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcd3600 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.155058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcd3600 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.156312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.156407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.156433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcae0a0 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.156449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcae0a0 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.156539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.156640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.156666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb0fcd0 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.156682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb0fcd0 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.156761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.156845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.156870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb5a490 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.156886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb5a490 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.156955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.157029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.157055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcc3150 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.157071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcc3150 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.157140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.157211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.157236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb38690 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.157253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb38690 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.157325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.157411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.920 [2024-11-26 23:15:23.157436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb2f1b0 with addr=10.0.0.2, port=4420 00:22:56.920 [2024-11-26 23:15:23.157452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb2f1b0 is same with the state(5) to be set 00:22:56.920 [2024-11-26 23:15:23.157485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb654a0 (9): Bad file descriptor 00:22:56.920 [2024-11-26 23:15:23.157509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb0cf70 (9): Bad file descriptor 00:22:56.920 [2024-11-26 23:15:23.157555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd3600 (9): Bad file descriptor 00:22:56.920 [2024-11-26 23:15:23.157605] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.157639] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.157661] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.157680] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.920 [2024-11-26 23:15:23.157984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:56.920 [2024-11-26 23:15:23.158048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcae0a0 (9): Bad file descriptor 00:22:56.920 [2024-11-26 23:15:23.158074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb0fcd0 (9): Bad file descriptor 00:22:56.920 [2024-11-26 23:15:23.158093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb5a490 (9): Bad file descriptor 00:22:56.920 [2024-11-26 23:15:23.158110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcc3150 (9): Bad file descriptor 00:22:56.920 [2024-11-26 23:15:23.158127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb38690 (9): Bad file descriptor 00:22:56.920 [2024-11-26 23:15:23.158144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb2f1b0 (9): Bad file descriptor 00:22:56.921 [2024-11-26 23:15:23.158160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.158174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.158191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:56.921 [2024-11-26 23:15:23.158210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.158224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.158237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:56.921 [2024-11-26 23:15:23.158254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.158268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.158281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:56.921 [2024-11-26 23:15:23.158814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.158841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.158855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.158935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.921 [2024-11-26 23:15:23.159014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.921 [2024-11-26 23:15:23.159051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcbda60 with addr=10.0.0.2, port=4420 00:22:56.921 [2024-11-26 23:15:23.159067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcbda60 is same with the state(5) to be set 00:22:56.921 [2024-11-26 23:15:23.159087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.159101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.159115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:56.921 [2024-11-26 23:15:23.159132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.159147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.159160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:56.921 [2024-11-26 23:15:23.159176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.159190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.159203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:56.921 [2024-11-26 23:15:23.159219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.159233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.159246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:56.921 [2024-11-26 23:15:23.159263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.159277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.159291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:56.921 [2024-11-26 23:15:23.159306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.159320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.159333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:56.921 [2024-11-26 23:15:23.159372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.159390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.159403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.159415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.159427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.159439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.921 [2024-11-26 23:15:23.159456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcbda60 (9): Bad file descriptor 00:22:56.921 [2024-11-26 23:15:23.159495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:56.921 [2024-11-26 23:15:23.159513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:56.921 [2024-11-26 23:15:23.159537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:56.921 [2024-11-26 23:15:23.159578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.489 23:15:23 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:57.489 23:15:23 -- target/shutdown.sh@138 -- # sleep 1 00:22:58.480 23:15:24 -- target/shutdown.sh@141 -- # kill -9 272481 00:22:58.480 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (272481) - No such process 00:22:58.480 23:15:24 -- target/shutdown.sh@141 -- # true 00:22:58.480 23:15:24 -- target/shutdown.sh@143 -- # stoptarget 00:22:58.480 23:15:24 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:58.480 23:15:24 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:58.480 23:15:24 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:58.480 23:15:24 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:58.480 23:15:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:58.480 23:15:24 -- nvmf/common.sh@116 -- # sync 00:22:58.480 23:15:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:58.480 23:15:24 -- nvmf/common.sh@119 -- # set +e 00:22:58.480 23:15:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:58.480 23:15:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:58.480 rmmod nvme_tcp 00:22:58.480 rmmod nvme_fabrics 00:22:58.480 rmmod nvme_keyring 00:22:58.480 23:15:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:58.480 23:15:24 -- nvmf/common.sh@123 -- # set -e 00:22:58.480 23:15:24 -- nvmf/common.sh@124 -- # return 0 00:22:58.480 23:15:24 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:58.480 23:15:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:58.480 23:15:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:58.480 23:15:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:58.480 23:15:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:58.480 23:15:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:58.480 23:15:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:58.480 23:15:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:58.480 23:15:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.502 23:15:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:00.502 00:23:00.502 real 0m8.164s 00:23:00.502 user 0m21.029s 00:23:00.502 sys 0m1.502s 00:23:00.502 23:15:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:00.502 23:15:26 -- common/autotest_common.sh@10 -- # set +x 00:23:00.502 ************************************ 00:23:00.502 END TEST nvmf_shutdown_tc3 00:23:00.502 ************************************ 00:23:00.502 23:15:26 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:23:00.502 00:23:00.502 real 0m29.434s 00:23:00.502 user 1m24.989s 00:23:00.502 sys 0m6.409s 00:23:00.502 23:15:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:00.502 23:15:26 -- common/autotest_common.sh@10 -- # set +x 00:23:00.502 ************************************ 00:23:00.502 END TEST nvmf_shutdown 00:23:00.502 ************************************ 00:23:00.502 23:15:26 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:23:00.502 23:15:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:00.502 23:15:26 -- common/autotest_common.sh@10 -- # set +x 00:23:00.502 23:15:26 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:23:00.502 23:15:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:00.502 23:15:26 -- common/autotest_common.sh@10 -- # set +x 00:23:00.502 23:15:26 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:23:00.502 23:15:26 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:00.502 23:15:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:00.502 23:15:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:00.502 23:15:26 -- common/autotest_common.sh@10 -- # set +x 00:23:00.502 ************************************ 00:23:00.502 START TEST nvmf_multicontroller 00:23:00.502 ************************************ 00:23:00.502 23:15:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:00.502 * Looking for test storage... 00:23:00.502 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:00.502 23:15:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:00.502 23:15:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:00.502 23:15:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:00.762 23:15:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:00.762 23:15:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:00.762 23:15:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:00.762 23:15:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:00.762 23:15:26 -- scripts/common.sh@335 -- # IFS=.-: 00:23:00.762 23:15:26 -- scripts/common.sh@335 -- # read -ra ver1 00:23:00.762 23:15:26 -- scripts/common.sh@336 -- # IFS=.-: 00:23:00.762 23:15:26 -- scripts/common.sh@336 -- # read -ra ver2 00:23:00.762 23:15:26 -- scripts/common.sh@337 -- # local 'op=<' 00:23:00.762 23:15:26 -- scripts/common.sh@339 -- # ver1_l=2 00:23:00.762 23:15:26 -- scripts/common.sh@340 -- # ver2_l=1 00:23:00.762 23:15:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:00.762 23:15:26 -- scripts/common.sh@343 -- # case "$op" in 00:23:00.762 23:15:26 -- scripts/common.sh@344 -- # : 1 00:23:00.762 23:15:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:00.762 23:15:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:00.762 23:15:26 -- scripts/common.sh@364 -- # decimal 1 00:23:00.762 23:15:26 -- scripts/common.sh@352 -- # local d=1 00:23:00.762 23:15:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:00.762 23:15:26 -- scripts/common.sh@354 -- # echo 1 00:23:00.762 23:15:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:00.762 23:15:26 -- scripts/common.sh@365 -- # decimal 2 00:23:00.762 23:15:26 -- scripts/common.sh@352 -- # local d=2 00:23:00.762 23:15:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:00.762 23:15:26 -- scripts/common.sh@354 -- # echo 2 00:23:00.762 23:15:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:00.762 23:15:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:00.762 23:15:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:00.762 23:15:26 -- scripts/common.sh@367 -- # return 0 00:23:00.762 23:15:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:00.762 23:15:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:00.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.762 --rc genhtml_branch_coverage=1 00:23:00.762 --rc genhtml_function_coverage=1 00:23:00.762 --rc genhtml_legend=1 00:23:00.762 --rc geninfo_all_blocks=1 00:23:00.762 --rc geninfo_unexecuted_blocks=1 00:23:00.762 00:23:00.762 ' 00:23:00.762 23:15:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:00.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.762 --rc genhtml_branch_coverage=1 00:23:00.762 --rc genhtml_function_coverage=1 00:23:00.762 --rc genhtml_legend=1 00:23:00.762 --rc geninfo_all_blocks=1 00:23:00.762 --rc geninfo_unexecuted_blocks=1 00:23:00.762 00:23:00.762 ' 00:23:00.762 23:15:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:00.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.762 --rc genhtml_branch_coverage=1 00:23:00.762 --rc genhtml_function_coverage=1 00:23:00.762 --rc genhtml_legend=1 00:23:00.762 --rc geninfo_all_blocks=1 00:23:00.762 --rc geninfo_unexecuted_blocks=1 00:23:00.762 00:23:00.762 ' 00:23:00.762 23:15:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:00.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.762 --rc genhtml_branch_coverage=1 00:23:00.762 --rc genhtml_function_coverage=1 00:23:00.762 --rc genhtml_legend=1 00:23:00.762 --rc geninfo_all_blocks=1 00:23:00.762 --rc geninfo_unexecuted_blocks=1 00:23:00.762 00:23:00.762 ' 00:23:00.762 23:15:26 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:00.762 23:15:26 -- nvmf/common.sh@7 -- # uname -s 00:23:00.762 23:15:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:00.762 23:15:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:00.762 23:15:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:00.762 23:15:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:00.762 23:15:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:00.762 23:15:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:00.762 23:15:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:00.762 23:15:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:00.762 23:15:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:00.762 23:15:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:00.762 23:15:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.762 23:15:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.762 23:15:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:00.762 23:15:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:00.762 23:15:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:00.762 23:15:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:00.762 23:15:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:00.762 23:15:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:00.762 23:15:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:00.763 23:15:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.763 23:15:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.763 23:15:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.763 23:15:26 -- paths/export.sh@5 -- # export PATH 00:23:00.763 23:15:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.763 23:15:26 -- nvmf/common.sh@46 -- # : 0 00:23:00.763 23:15:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:00.763 23:15:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:00.763 23:15:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:00.763 23:15:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:00.763 23:15:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:00.763 23:15:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:00.763 23:15:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:00.763 23:15:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:00.763 23:15:26 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:00.763 23:15:26 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:00.763 23:15:26 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:23:00.763 23:15:26 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:23:00.763 23:15:26 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:23:00.763 23:15:26 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:23:00.763 23:15:26 -- host/multicontroller.sh@23 -- # nvmftestinit 00:23:00.763 23:15:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:00.763 23:15:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:00.763 23:15:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:00.763 23:15:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:00.763 23:15:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:00.763 23:15:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.763 23:15:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.763 23:15:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.763 23:15:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:00.763 23:15:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:00.763 23:15:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:00.763 23:15:26 -- common/autotest_common.sh@10 -- # set +x 00:23:02.665 23:15:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:02.666 23:15:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:02.666 23:15:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:02.666 23:15:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:02.666 23:15:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:02.666 23:15:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:02.666 23:15:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:02.666 23:15:29 -- nvmf/common.sh@294 -- # net_devs=() 00:23:02.666 23:15:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:02.666 23:15:29 -- nvmf/common.sh@295 -- # e810=() 00:23:02.666 23:15:29 -- nvmf/common.sh@295 -- # local -ga e810 00:23:02.666 23:15:29 -- nvmf/common.sh@296 -- # x722=() 00:23:02.666 23:15:29 -- nvmf/common.sh@296 -- # local -ga x722 00:23:02.666 23:15:29 -- nvmf/common.sh@297 -- # mlx=() 00:23:02.666 23:15:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:02.666 23:15:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:02.666 23:15:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:02.666 23:15:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:02.666 23:15:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:02.666 23:15:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:02.666 23:15:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:02.666 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:02.666 23:15:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:02.666 23:15:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:02.666 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:02.666 23:15:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:02.666 23:15:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:02.666 23:15:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:02.666 23:15:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:02.666 23:15:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:02.666 23:15:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:02.666 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:02.666 23:15:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:02.666 23:15:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:02.666 23:15:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:02.666 23:15:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:02.666 23:15:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:02.666 23:15:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:02.666 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:02.666 23:15:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:02.666 23:15:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:02.666 23:15:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:02.666 23:15:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:02.666 23:15:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:02.666 23:15:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:02.666 23:15:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:02.666 23:15:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:02.666 23:15:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:02.666 23:15:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:02.666 23:15:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:02.666 23:15:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:02.666 23:15:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:02.666 23:15:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:02.666 23:15:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:02.666 23:15:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:02.666 23:15:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:02.666 23:15:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:02.926 23:15:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:02.926 23:15:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:02.926 23:15:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:02.926 23:15:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:02.926 23:15:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:02.926 23:15:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:02.926 23:15:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:02.926 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:02.926 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.343 ms 00:23:02.926 00:23:02.926 --- 10.0.0.2 ping statistics --- 00:23:02.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:02.926 rtt min/avg/max/mdev = 0.343/0.343/0.343/0.000 ms 00:23:02.926 23:15:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:02.926 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:02.926 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:23:02.926 00:23:02.926 --- 10.0.0.1 ping statistics --- 00:23:02.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:02.926 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:23:02.926 23:15:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:02.926 23:15:29 -- nvmf/common.sh@410 -- # return 0 00:23:02.926 23:15:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:02.926 23:15:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:02.926 23:15:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:02.926 23:15:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:02.926 23:15:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:02.926 23:15:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:02.926 23:15:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:02.926 23:15:29 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:23:02.926 23:15:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:02.926 23:15:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:02.926 23:15:29 -- common/autotest_common.sh@10 -- # set +x 00:23:02.926 23:15:29 -- nvmf/common.sh@469 -- # nvmfpid=275047 00:23:02.926 23:15:29 -- nvmf/common.sh@470 -- # waitforlisten 275047 00:23:02.926 23:15:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:02.926 23:15:29 -- common/autotest_common.sh@829 -- # '[' -z 275047 ']' 00:23:02.926 23:15:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:02.926 23:15:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:02.926 23:15:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:02.926 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:02.926 23:15:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:02.926 23:15:29 -- common/autotest_common.sh@10 -- # set +x 00:23:02.926 [2024-11-26 23:15:29.239827] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:02.926 [2024-11-26 23:15:29.239914] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:02.926 EAL: No free 2048 kB hugepages reported on node 1 00:23:02.926 [2024-11-26 23:15:29.311175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:03.185 [2024-11-26 23:15:29.430927] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:03.185 [2024-11-26 23:15:29.431084] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:03.185 [2024-11-26 23:15:29.431100] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:03.185 [2024-11-26 23:15:29.431112] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:03.185 [2024-11-26 23:15:29.431247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:03.185 [2024-11-26 23:15:29.431339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:03.185 [2024-11-26 23:15:29.431337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:04.119 23:15:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:04.119 23:15:30 -- common/autotest_common.sh@862 -- # return 0 00:23:04.119 23:15:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:04.119 23:15:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 23:15:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:04.119 23:15:30 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 [2024-11-26 23:15:30.286572] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 Malloc0 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 [2024-11-26 23:15:30.344196] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 [2024-11-26 23:15:30.352073] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 Malloc1 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:23:04.119 23:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:04.119 23:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.119 23:15:30 -- host/multicontroller.sh@44 -- # bdevperf_pid=275207 00:23:04.119 23:15:30 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:23:04.119 23:15:30 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:04.119 23:15:30 -- host/multicontroller.sh@47 -- # waitforlisten 275207 /var/tmp/bdevperf.sock 00:23:04.119 23:15:30 -- common/autotest_common.sh@829 -- # '[' -z 275207 ']' 00:23:04.119 23:15:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:04.119 23:15:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:04.119 23:15:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:04.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:04.119 23:15:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:04.119 23:15:30 -- common/autotest_common.sh@10 -- # set +x 00:23:05.494 23:15:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:05.494 23:15:31 -- common/autotest_common.sh@862 -- # return 0 00:23:05.494 23:15:31 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:05.494 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.494 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.494 NVMe0n1 00:23:05.494 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.494 23:15:31 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:05.494 23:15:31 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:05.494 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.494 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.494 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.494 1 00:23:05.494 23:15:31 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:05.494 23:15:31 -- common/autotest_common.sh@650 -- # local es=0 00:23:05.494 23:15:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:05.494 23:15:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:05.494 23:15:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.494 23:15:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:05.494 23:15:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.494 23:15:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:05.494 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.494 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.494 request: 00:23:05.494 { 00:23:05.494 "name": "NVMe0", 00:23:05.494 "trtype": "tcp", 00:23:05.494 "traddr": "10.0.0.2", 00:23:05.494 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:05.494 "hostaddr": "10.0.0.2", 00:23:05.494 "hostsvcid": "60000", 00:23:05.494 "adrfam": "ipv4", 00:23:05.494 "trsvcid": "4420", 00:23:05.494 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:05.494 "method": "bdev_nvme_attach_controller", 00:23:05.494 "req_id": 1 00:23:05.494 } 00:23:05.494 Got JSON-RPC error response 00:23:05.494 response: 00:23:05.494 { 00:23:05.494 "code": -114, 00:23:05.494 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:05.494 } 00:23:05.494 23:15:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:05.494 23:15:31 -- common/autotest_common.sh@653 -- # es=1 00:23:05.494 23:15:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:05.494 23:15:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:05.494 23:15:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:05.494 23:15:31 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:05.495 23:15:31 -- common/autotest_common.sh@650 -- # local es=0 00:23:05.495 23:15:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:05.495 23:15:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.495 23:15:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:05.495 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.495 request: 00:23:05.495 { 00:23:05.495 "name": "NVMe0", 00:23:05.495 "trtype": "tcp", 00:23:05.495 "traddr": "10.0.0.2", 00:23:05.495 "hostaddr": "10.0.0.2", 00:23:05.495 "hostsvcid": "60000", 00:23:05.495 "adrfam": "ipv4", 00:23:05.495 "trsvcid": "4420", 00:23:05.495 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:05.495 "method": "bdev_nvme_attach_controller", 00:23:05.495 "req_id": 1 00:23:05.495 } 00:23:05.495 Got JSON-RPC error response 00:23:05.495 response: 00:23:05.495 { 00:23:05.495 "code": -114, 00:23:05.495 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:05.495 } 00:23:05.495 23:15:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:05.495 23:15:31 -- common/autotest_common.sh@653 -- # es=1 00:23:05.495 23:15:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:05.495 23:15:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:05.495 23:15:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:05.495 23:15:31 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@650 -- # local es=0 00:23:05.495 23:15:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.495 23:15:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.495 request: 00:23:05.495 { 00:23:05.495 "name": "NVMe0", 00:23:05.495 "trtype": "tcp", 00:23:05.495 "traddr": "10.0.0.2", 00:23:05.495 "hostaddr": "10.0.0.2", 00:23:05.495 "hostsvcid": "60000", 00:23:05.495 "adrfam": "ipv4", 00:23:05.495 "trsvcid": "4420", 00:23:05.495 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:05.495 "multipath": "disable", 00:23:05.495 "method": "bdev_nvme_attach_controller", 00:23:05.495 "req_id": 1 00:23:05.495 } 00:23:05.495 Got JSON-RPC error response 00:23:05.495 response: 00:23:05.495 { 00:23:05.495 "code": -114, 00:23:05.495 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:05.495 } 00:23:05.495 23:15:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:05.495 23:15:31 -- common/autotest_common.sh@653 -- # es=1 00:23:05.495 23:15:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:05.495 23:15:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:05.495 23:15:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:05.495 23:15:31 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:05.495 23:15:31 -- common/autotest_common.sh@650 -- # local es=0 00:23:05.495 23:15:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:05.495 23:15:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:05.495 23:15:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.495 23:15:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:05.495 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.495 request: 00:23:05.495 { 00:23:05.495 "name": "NVMe0", 00:23:05.495 "trtype": "tcp", 00:23:05.495 "traddr": "10.0.0.2", 00:23:05.495 "hostaddr": "10.0.0.2", 00:23:05.495 "hostsvcid": "60000", 00:23:05.495 "adrfam": "ipv4", 00:23:05.495 "trsvcid": "4420", 00:23:05.495 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:05.495 "multipath": "failover", 00:23:05.495 "method": "bdev_nvme_attach_controller", 00:23:05.495 "req_id": 1 00:23:05.495 } 00:23:05.495 Got JSON-RPC error response 00:23:05.495 response: 00:23:05.495 { 00:23:05.495 "code": -114, 00:23:05.495 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:05.495 } 00:23:05.495 23:15:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:05.495 23:15:31 -- common/autotest_common.sh@653 -- # es=1 00:23:05.495 23:15:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:05.495 23:15:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:05.495 23:15:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:05.495 23:15:31 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:05.495 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.495 00:23:05.495 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.495 23:15:31 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:05.495 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.495 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.495 23:15:31 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:05.495 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.495 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.495 00:23:05.495 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.495 23:15:31 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:05.495 23:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.495 23:15:31 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:05.495 23:15:31 -- common/autotest_common.sh@10 -- # set +x 00:23:05.753 23:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.754 23:15:31 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:05.754 23:15:31 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:06.689 0 00:23:06.689 23:15:33 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:06.689 23:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.689 23:15:33 -- common/autotest_common.sh@10 -- # set +x 00:23:06.689 23:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.689 23:15:33 -- host/multicontroller.sh@100 -- # killprocess 275207 00:23:06.689 23:15:33 -- common/autotest_common.sh@936 -- # '[' -z 275207 ']' 00:23:06.689 23:15:33 -- common/autotest_common.sh@940 -- # kill -0 275207 00:23:06.689 23:15:33 -- common/autotest_common.sh@941 -- # uname 00:23:06.689 23:15:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:06.689 23:15:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 275207 00:23:06.689 23:15:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:06.689 23:15:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:06.689 23:15:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 275207' 00:23:06.689 killing process with pid 275207 00:23:06.689 23:15:33 -- common/autotest_common.sh@955 -- # kill 275207 00:23:06.689 23:15:33 -- common/autotest_common.sh@960 -- # wait 275207 00:23:06.948 23:15:33 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:06.948 23:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.948 23:15:33 -- common/autotest_common.sh@10 -- # set +x 00:23:06.948 23:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.948 23:15:33 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:06.948 23:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.948 23:15:33 -- common/autotest_common.sh@10 -- # set +x 00:23:06.948 23:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.948 23:15:33 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:06.948 23:15:33 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:06.948 23:15:33 -- common/autotest_common.sh@1607 -- # read -r file 00:23:06.948 23:15:33 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:06.948 23:15:33 -- common/autotest_common.sh@1606 -- # sort -u 00:23:06.948 23:15:33 -- common/autotest_common.sh@1608 -- # cat 00:23:06.948 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:06.948 [2024-11-26 23:15:30.452000] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:06.948 [2024-11-26 23:15:30.452099] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid275207 ] 00:23:06.948 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.948 [2024-11-26 23:15:30.516003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:06.948 [2024-11-26 23:15:30.624584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:06.948 [2024-11-26 23:15:31.875450] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 3fee6cf6-7bc3-49cc-b88b-8f9108161872 already exists 00:23:06.948 [2024-11-26 23:15:31.875488] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:3fee6cf6-7bc3-49cc-b88b-8f9108161872 alias for bdev NVMe1n1 00:23:06.948 [2024-11-26 23:15:31.875539] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:06.948 Running I/O for 1 seconds... 00:23:06.948 00:23:06.948 Latency(us) 00:23:06.948 [2024-11-26T22:15:33.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:06.948 [2024-11-26T22:15:33.342Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:06.948 NVMe0n1 : 1.01 18257.57 71.32 0.00 0.00 6991.10 3907.89 14757.74 00:23:06.948 [2024-11-26T22:15:33.342Z] =================================================================================================================== 00:23:06.948 [2024-11-26T22:15:33.342Z] Total : 18257.57 71.32 0.00 0.00 6991.10 3907.89 14757.74 00:23:06.948 Received shutdown signal, test time was about 1.000000 seconds 00:23:06.948 00:23:06.948 Latency(us) 00:23:06.948 [2024-11-26T22:15:33.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:06.948 [2024-11-26T22:15:33.342Z] =================================================================================================================== 00:23:06.948 [2024-11-26T22:15:33.342Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:06.948 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:06.948 23:15:33 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:06.948 23:15:33 -- common/autotest_common.sh@1607 -- # read -r file 00:23:06.948 23:15:33 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:06.948 23:15:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:06.948 23:15:33 -- nvmf/common.sh@116 -- # sync 00:23:06.948 23:15:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:06.948 23:15:33 -- nvmf/common.sh@119 -- # set +e 00:23:06.948 23:15:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:07.206 23:15:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:07.206 rmmod nvme_tcp 00:23:07.206 rmmod nvme_fabrics 00:23:07.206 rmmod nvme_keyring 00:23:07.206 23:15:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:07.206 23:15:33 -- nvmf/common.sh@123 -- # set -e 00:23:07.206 23:15:33 -- nvmf/common.sh@124 -- # return 0 00:23:07.206 23:15:33 -- nvmf/common.sh@477 -- # '[' -n 275047 ']' 00:23:07.206 23:15:33 -- nvmf/common.sh@478 -- # killprocess 275047 00:23:07.206 23:15:33 -- common/autotest_common.sh@936 -- # '[' -z 275047 ']' 00:23:07.206 23:15:33 -- common/autotest_common.sh@940 -- # kill -0 275047 00:23:07.206 23:15:33 -- common/autotest_common.sh@941 -- # uname 00:23:07.206 23:15:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:07.206 23:15:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 275047 00:23:07.206 23:15:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:07.206 23:15:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:07.206 23:15:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 275047' 00:23:07.206 killing process with pid 275047 00:23:07.206 23:15:33 -- common/autotest_common.sh@955 -- # kill 275047 00:23:07.206 23:15:33 -- common/autotest_common.sh@960 -- # wait 275047 00:23:07.464 23:15:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:07.464 23:15:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:07.464 23:15:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:07.464 23:15:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:07.464 23:15:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:07.464 23:15:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:07.464 23:15:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:07.464 23:15:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:10.000 23:15:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:10.000 00:23:10.000 real 0m8.966s 00:23:10.000 user 0m16.945s 00:23:10.000 sys 0m2.419s 00:23:10.000 23:15:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:10.000 23:15:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.000 ************************************ 00:23:10.000 END TEST nvmf_multicontroller 00:23:10.000 ************************************ 00:23:10.000 23:15:35 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:10.000 23:15:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:10.000 23:15:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:10.000 23:15:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.000 ************************************ 00:23:10.000 START TEST nvmf_aer 00:23:10.000 ************************************ 00:23:10.000 23:15:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:10.000 * Looking for test storage... 00:23:10.000 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:10.000 23:15:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:10.000 23:15:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:10.000 23:15:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:10.000 23:15:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:10.000 23:15:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:10.000 23:15:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:10.000 23:15:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:10.000 23:15:35 -- scripts/common.sh@335 -- # IFS=.-: 00:23:10.000 23:15:35 -- scripts/common.sh@335 -- # read -ra ver1 00:23:10.000 23:15:35 -- scripts/common.sh@336 -- # IFS=.-: 00:23:10.000 23:15:35 -- scripts/common.sh@336 -- # read -ra ver2 00:23:10.000 23:15:35 -- scripts/common.sh@337 -- # local 'op=<' 00:23:10.000 23:15:35 -- scripts/common.sh@339 -- # ver1_l=2 00:23:10.000 23:15:35 -- scripts/common.sh@340 -- # ver2_l=1 00:23:10.000 23:15:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:10.000 23:15:35 -- scripts/common.sh@343 -- # case "$op" in 00:23:10.000 23:15:35 -- scripts/common.sh@344 -- # : 1 00:23:10.000 23:15:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:10.000 23:15:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:10.000 23:15:35 -- scripts/common.sh@364 -- # decimal 1 00:23:10.000 23:15:35 -- scripts/common.sh@352 -- # local d=1 00:23:10.000 23:15:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:10.000 23:15:35 -- scripts/common.sh@354 -- # echo 1 00:23:10.000 23:15:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:10.000 23:15:35 -- scripts/common.sh@365 -- # decimal 2 00:23:10.000 23:15:35 -- scripts/common.sh@352 -- # local d=2 00:23:10.000 23:15:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:10.000 23:15:35 -- scripts/common.sh@354 -- # echo 2 00:23:10.000 23:15:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:10.000 23:15:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:10.000 23:15:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:10.000 23:15:35 -- scripts/common.sh@367 -- # return 0 00:23:10.000 23:15:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:10.000 23:15:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:10.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:10.000 --rc genhtml_branch_coverage=1 00:23:10.000 --rc genhtml_function_coverage=1 00:23:10.000 --rc genhtml_legend=1 00:23:10.000 --rc geninfo_all_blocks=1 00:23:10.000 --rc geninfo_unexecuted_blocks=1 00:23:10.000 00:23:10.000 ' 00:23:10.000 23:15:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:10.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:10.000 --rc genhtml_branch_coverage=1 00:23:10.000 --rc genhtml_function_coverage=1 00:23:10.000 --rc genhtml_legend=1 00:23:10.000 --rc geninfo_all_blocks=1 00:23:10.000 --rc geninfo_unexecuted_blocks=1 00:23:10.000 00:23:10.000 ' 00:23:10.000 23:15:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:10.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:10.001 --rc genhtml_branch_coverage=1 00:23:10.001 --rc genhtml_function_coverage=1 00:23:10.001 --rc genhtml_legend=1 00:23:10.001 --rc geninfo_all_blocks=1 00:23:10.001 --rc geninfo_unexecuted_blocks=1 00:23:10.001 00:23:10.001 ' 00:23:10.001 23:15:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:10.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:10.001 --rc genhtml_branch_coverage=1 00:23:10.001 --rc genhtml_function_coverage=1 00:23:10.001 --rc genhtml_legend=1 00:23:10.001 --rc geninfo_all_blocks=1 00:23:10.001 --rc geninfo_unexecuted_blocks=1 00:23:10.001 00:23:10.001 ' 00:23:10.001 23:15:35 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:10.001 23:15:35 -- nvmf/common.sh@7 -- # uname -s 00:23:10.001 23:15:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:10.001 23:15:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:10.001 23:15:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:10.001 23:15:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:10.001 23:15:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:10.001 23:15:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:10.001 23:15:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:10.001 23:15:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:10.001 23:15:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:10.001 23:15:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:10.001 23:15:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:10.001 23:15:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:10.001 23:15:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:10.001 23:15:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:10.001 23:15:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:10.001 23:15:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:10.001 23:15:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:10.001 23:15:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:10.001 23:15:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:10.001 23:15:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:10.001 23:15:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:10.001 23:15:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:10.001 23:15:35 -- paths/export.sh@5 -- # export PATH 00:23:10.001 23:15:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:10.001 23:15:35 -- nvmf/common.sh@46 -- # : 0 00:23:10.001 23:15:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:10.001 23:15:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:10.001 23:15:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:10.001 23:15:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:10.001 23:15:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:10.001 23:15:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:10.001 23:15:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:10.001 23:15:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:10.001 23:15:35 -- host/aer.sh@11 -- # nvmftestinit 00:23:10.001 23:15:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:10.001 23:15:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:10.001 23:15:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:10.001 23:15:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:10.001 23:15:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:10.001 23:15:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:10.001 23:15:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:10.001 23:15:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:10.001 23:15:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:10.001 23:15:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:10.001 23:15:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:10.001 23:15:35 -- common/autotest_common.sh@10 -- # set +x 00:23:11.903 23:15:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:11.903 23:15:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:11.903 23:15:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:11.903 23:15:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:11.903 23:15:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:11.903 23:15:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:11.903 23:15:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:11.903 23:15:37 -- nvmf/common.sh@294 -- # net_devs=() 00:23:11.903 23:15:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:11.903 23:15:37 -- nvmf/common.sh@295 -- # e810=() 00:23:11.903 23:15:37 -- nvmf/common.sh@295 -- # local -ga e810 00:23:11.903 23:15:37 -- nvmf/common.sh@296 -- # x722=() 00:23:11.903 23:15:37 -- nvmf/common.sh@296 -- # local -ga x722 00:23:11.903 23:15:37 -- nvmf/common.sh@297 -- # mlx=() 00:23:11.903 23:15:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:11.903 23:15:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:11.903 23:15:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:11.903 23:15:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:11.903 23:15:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:11.903 23:15:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:11.903 23:15:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:11.903 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:11.903 23:15:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:11.903 23:15:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:11.903 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:11.903 23:15:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:11.903 23:15:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:11.903 23:15:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.903 23:15:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:11.903 23:15:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.903 23:15:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:11.903 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:11.903 23:15:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.903 23:15:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:11.903 23:15:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.903 23:15:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:11.903 23:15:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.903 23:15:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:11.903 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:11.903 23:15:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.903 23:15:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:11.903 23:15:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:11.903 23:15:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:11.903 23:15:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:11.903 23:15:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:11.903 23:15:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:11.903 23:15:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:11.903 23:15:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:11.903 23:15:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:11.903 23:15:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:11.903 23:15:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:11.903 23:15:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:11.903 23:15:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:11.903 23:15:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:11.903 23:15:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:11.903 23:15:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:11.903 23:15:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:11.903 23:15:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:11.903 23:15:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:11.903 23:15:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:11.903 23:15:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:11.903 23:15:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:11.903 23:15:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:11.903 23:15:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:11.903 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:11.903 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.276 ms 00:23:11.903 00:23:11.903 --- 10.0.0.2 ping statistics --- 00:23:11.903 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.903 rtt min/avg/max/mdev = 0.276/0.276/0.276/0.000 ms 00:23:11.903 23:15:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:11.903 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:11.903 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:23:11.903 00:23:11.903 --- 10.0.0.1 ping statistics --- 00:23:11.903 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.903 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:23:11.903 23:15:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:11.903 23:15:38 -- nvmf/common.sh@410 -- # return 0 00:23:11.903 23:15:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:11.903 23:15:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:11.903 23:15:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:11.903 23:15:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:11.903 23:15:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:11.903 23:15:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:11.903 23:15:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:11.903 23:15:38 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:11.903 23:15:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:11.903 23:15:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:11.903 23:15:38 -- common/autotest_common.sh@10 -- # set +x 00:23:11.903 23:15:38 -- nvmf/common.sh@469 -- # nvmfpid=277577 00:23:11.903 23:15:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:11.903 23:15:38 -- nvmf/common.sh@470 -- # waitforlisten 277577 00:23:11.903 23:15:38 -- common/autotest_common.sh@829 -- # '[' -z 277577 ']' 00:23:11.903 23:15:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:11.903 23:15:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:11.903 23:15:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:11.903 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:11.903 23:15:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:11.903 23:15:38 -- common/autotest_common.sh@10 -- # set +x 00:23:11.903 [2024-11-26 23:15:38.204635] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:11.903 [2024-11-26 23:15:38.204707] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:11.903 EAL: No free 2048 kB hugepages reported on node 1 00:23:11.903 [2024-11-26 23:15:38.278345] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:12.161 [2024-11-26 23:15:38.393922] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:12.161 [2024-11-26 23:15:38.394088] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:12.161 [2024-11-26 23:15:38.394108] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:12.161 [2024-11-26 23:15:38.394122] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:12.161 [2024-11-26 23:15:38.394182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:12.161 [2024-11-26 23:15:38.394234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:12.161 [2024-11-26 23:15:38.394351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:12.161 [2024-11-26 23:15:38.394354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:13.094 23:15:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:13.094 23:15:39 -- common/autotest_common.sh@862 -- # return 0 00:23:13.094 23:15:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:13.094 23:15:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:13.094 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.094 23:15:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:13.094 23:15:39 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:13.094 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.094 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.094 [2024-11-26 23:15:39.185013] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:13.094 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.094 23:15:39 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:13.094 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.094 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.094 Malloc0 00:23:13.094 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.094 23:15:39 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:13.094 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.094 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.094 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.094 23:15:39 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:13.094 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.094 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.094 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.094 23:15:39 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:13.094 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.094 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.094 [2024-11-26 23:15:39.237256] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:13.094 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.094 23:15:39 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:13.094 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.094 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.094 [2024-11-26 23:15:39.244997] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:13.094 [ 00:23:13.094 { 00:23:13.094 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:13.094 "subtype": "Discovery", 00:23:13.094 "listen_addresses": [], 00:23:13.094 "allow_any_host": true, 00:23:13.094 "hosts": [] 00:23:13.094 }, 00:23:13.094 { 00:23:13.094 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:13.094 "subtype": "NVMe", 00:23:13.094 "listen_addresses": [ 00:23:13.094 { 00:23:13.094 "transport": "TCP", 00:23:13.094 "trtype": "TCP", 00:23:13.094 "adrfam": "IPv4", 00:23:13.094 "traddr": "10.0.0.2", 00:23:13.094 "trsvcid": "4420" 00:23:13.094 } 00:23:13.094 ], 00:23:13.094 "allow_any_host": true, 00:23:13.094 "hosts": [], 00:23:13.094 "serial_number": "SPDK00000000000001", 00:23:13.094 "model_number": "SPDK bdev Controller", 00:23:13.094 "max_namespaces": 2, 00:23:13.094 "min_cntlid": 1, 00:23:13.094 "max_cntlid": 65519, 00:23:13.094 "namespaces": [ 00:23:13.094 { 00:23:13.094 "nsid": 1, 00:23:13.094 "bdev_name": "Malloc0", 00:23:13.094 "name": "Malloc0", 00:23:13.094 "nguid": "564C2D57BFBF4893BACB27B56E7BEE10", 00:23:13.094 "uuid": "564c2d57-bfbf-4893-bacb-27b56e7bee10" 00:23:13.094 } 00:23:13.094 ] 00:23:13.094 } 00:23:13.094 ] 00:23:13.094 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.094 23:15:39 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:13.094 23:15:39 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:13.094 23:15:39 -- host/aer.sh@33 -- # aerpid=277698 00:23:13.094 23:15:39 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:13.094 23:15:39 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:13.094 23:15:39 -- common/autotest_common.sh@1254 -- # local i=0 00:23:13.094 23:15:39 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:13.094 23:15:39 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:13.094 23:15:39 -- common/autotest_common.sh@1257 -- # i=1 00:23:13.094 23:15:39 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:13.094 EAL: No free 2048 kB hugepages reported on node 1 00:23:13.094 23:15:39 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:13.094 23:15:39 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:13.094 23:15:39 -- common/autotest_common.sh@1257 -- # i=2 00:23:13.094 23:15:39 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:13.094 23:15:39 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:13.094 23:15:39 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:23:13.094 23:15:39 -- common/autotest_common.sh@1257 -- # i=3 00:23:13.094 23:15:39 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:13.352 23:15:39 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:13.352 23:15:39 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:13.352 23:15:39 -- common/autotest_common.sh@1265 -- # return 0 00:23:13.352 23:15:39 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:13.352 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.352 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.352 Malloc1 00:23:13.352 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.352 23:15:39 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:13.352 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.352 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.352 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.352 23:15:39 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:13.352 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.352 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.352 Asynchronous Event Request test 00:23:13.352 Attaching to 10.0.0.2 00:23:13.352 Attached to 10.0.0.2 00:23:13.352 Registering asynchronous event callbacks... 00:23:13.352 Starting namespace attribute notice tests for all controllers... 00:23:13.352 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:13.352 aer_cb - Changed Namespace 00:23:13.352 Cleaning up... 00:23:13.352 [ 00:23:13.352 { 00:23:13.352 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:13.352 "subtype": "Discovery", 00:23:13.352 "listen_addresses": [], 00:23:13.352 "allow_any_host": true, 00:23:13.352 "hosts": [] 00:23:13.352 }, 00:23:13.352 { 00:23:13.352 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:13.352 "subtype": "NVMe", 00:23:13.352 "listen_addresses": [ 00:23:13.352 { 00:23:13.352 "transport": "TCP", 00:23:13.352 "trtype": "TCP", 00:23:13.352 "adrfam": "IPv4", 00:23:13.352 "traddr": "10.0.0.2", 00:23:13.352 "trsvcid": "4420" 00:23:13.352 } 00:23:13.352 ], 00:23:13.352 "allow_any_host": true, 00:23:13.352 "hosts": [], 00:23:13.352 "serial_number": "SPDK00000000000001", 00:23:13.352 "model_number": "SPDK bdev Controller", 00:23:13.352 "max_namespaces": 2, 00:23:13.352 "min_cntlid": 1, 00:23:13.352 "max_cntlid": 65519, 00:23:13.352 "namespaces": [ 00:23:13.352 { 00:23:13.352 "nsid": 1, 00:23:13.352 "bdev_name": "Malloc0", 00:23:13.352 "name": "Malloc0", 00:23:13.352 "nguid": "564C2D57BFBF4893BACB27B56E7BEE10", 00:23:13.352 "uuid": "564c2d57-bfbf-4893-bacb-27b56e7bee10" 00:23:13.352 }, 00:23:13.352 { 00:23:13.352 "nsid": 2, 00:23:13.352 "bdev_name": "Malloc1", 00:23:13.352 "name": "Malloc1", 00:23:13.352 "nguid": "F01A666AD27F4DD583770A518CCA6E2D", 00:23:13.352 "uuid": "f01a666a-d27f-4dd5-8377-0a518cca6e2d" 00:23:13.352 } 00:23:13.352 ] 00:23:13.352 } 00:23:13.352 ] 00:23:13.352 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.352 23:15:39 -- host/aer.sh@43 -- # wait 277698 00:23:13.352 23:15:39 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:13.352 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.352 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.352 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.352 23:15:39 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:13.352 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.352 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.352 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.352 23:15:39 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:13.352 23:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.352 23:15:39 -- common/autotest_common.sh@10 -- # set +x 00:23:13.352 23:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.352 23:15:39 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:13.352 23:15:39 -- host/aer.sh@51 -- # nvmftestfini 00:23:13.352 23:15:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:13.352 23:15:39 -- nvmf/common.sh@116 -- # sync 00:23:13.352 23:15:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:13.352 23:15:39 -- nvmf/common.sh@119 -- # set +e 00:23:13.352 23:15:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:13.352 23:15:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:13.352 rmmod nvme_tcp 00:23:13.611 rmmod nvme_fabrics 00:23:13.611 rmmod nvme_keyring 00:23:13.611 23:15:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:13.611 23:15:39 -- nvmf/common.sh@123 -- # set -e 00:23:13.611 23:15:39 -- nvmf/common.sh@124 -- # return 0 00:23:13.611 23:15:39 -- nvmf/common.sh@477 -- # '[' -n 277577 ']' 00:23:13.611 23:15:39 -- nvmf/common.sh@478 -- # killprocess 277577 00:23:13.611 23:15:39 -- common/autotest_common.sh@936 -- # '[' -z 277577 ']' 00:23:13.611 23:15:39 -- common/autotest_common.sh@940 -- # kill -0 277577 00:23:13.611 23:15:39 -- common/autotest_common.sh@941 -- # uname 00:23:13.611 23:15:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:13.611 23:15:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 277577 00:23:13.611 23:15:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:13.611 23:15:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:13.611 23:15:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 277577' 00:23:13.611 killing process with pid 277577 00:23:13.611 23:15:39 -- common/autotest_common.sh@955 -- # kill 277577 00:23:13.611 [2024-11-26 23:15:39.824697] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:13.611 23:15:39 -- common/autotest_common.sh@960 -- # wait 277577 00:23:13.870 23:15:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:13.870 23:15:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:13.870 23:15:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:13.870 23:15:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:13.870 23:15:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:13.870 23:15:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.870 23:15:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:13.870 23:15:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:15.774 23:15:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:15.774 00:23:15.774 real 0m6.311s 00:23:15.774 user 0m7.542s 00:23:15.774 sys 0m2.021s 00:23:15.774 23:15:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:15.774 23:15:42 -- common/autotest_common.sh@10 -- # set +x 00:23:15.774 ************************************ 00:23:15.774 END TEST nvmf_aer 00:23:15.774 ************************************ 00:23:15.774 23:15:42 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:15.774 23:15:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:15.774 23:15:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:15.774 23:15:42 -- common/autotest_common.sh@10 -- # set +x 00:23:15.774 ************************************ 00:23:15.774 START TEST nvmf_async_init 00:23:15.774 ************************************ 00:23:15.774 23:15:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:16.033 * Looking for test storage... 00:23:16.033 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:16.033 23:15:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:16.033 23:15:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:16.033 23:15:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:16.034 23:15:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:16.034 23:15:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:16.034 23:15:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:16.034 23:15:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:16.034 23:15:42 -- scripts/common.sh@335 -- # IFS=.-: 00:23:16.034 23:15:42 -- scripts/common.sh@335 -- # read -ra ver1 00:23:16.034 23:15:42 -- scripts/common.sh@336 -- # IFS=.-: 00:23:16.034 23:15:42 -- scripts/common.sh@336 -- # read -ra ver2 00:23:16.034 23:15:42 -- scripts/common.sh@337 -- # local 'op=<' 00:23:16.034 23:15:42 -- scripts/common.sh@339 -- # ver1_l=2 00:23:16.034 23:15:42 -- scripts/common.sh@340 -- # ver2_l=1 00:23:16.034 23:15:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:16.034 23:15:42 -- scripts/common.sh@343 -- # case "$op" in 00:23:16.034 23:15:42 -- scripts/common.sh@344 -- # : 1 00:23:16.034 23:15:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:16.034 23:15:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:16.034 23:15:42 -- scripts/common.sh@364 -- # decimal 1 00:23:16.034 23:15:42 -- scripts/common.sh@352 -- # local d=1 00:23:16.034 23:15:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:16.034 23:15:42 -- scripts/common.sh@354 -- # echo 1 00:23:16.034 23:15:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:16.034 23:15:42 -- scripts/common.sh@365 -- # decimal 2 00:23:16.034 23:15:42 -- scripts/common.sh@352 -- # local d=2 00:23:16.034 23:15:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:16.034 23:15:42 -- scripts/common.sh@354 -- # echo 2 00:23:16.034 23:15:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:16.034 23:15:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:16.034 23:15:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:16.034 23:15:42 -- scripts/common.sh@367 -- # return 0 00:23:16.034 23:15:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:16.034 23:15:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:16.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.034 --rc genhtml_branch_coverage=1 00:23:16.034 --rc genhtml_function_coverage=1 00:23:16.034 --rc genhtml_legend=1 00:23:16.034 --rc geninfo_all_blocks=1 00:23:16.034 --rc geninfo_unexecuted_blocks=1 00:23:16.034 00:23:16.034 ' 00:23:16.034 23:15:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:16.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.034 --rc genhtml_branch_coverage=1 00:23:16.034 --rc genhtml_function_coverage=1 00:23:16.034 --rc genhtml_legend=1 00:23:16.034 --rc geninfo_all_blocks=1 00:23:16.034 --rc geninfo_unexecuted_blocks=1 00:23:16.034 00:23:16.034 ' 00:23:16.034 23:15:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:16.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.034 --rc genhtml_branch_coverage=1 00:23:16.034 --rc genhtml_function_coverage=1 00:23:16.034 --rc genhtml_legend=1 00:23:16.034 --rc geninfo_all_blocks=1 00:23:16.034 --rc geninfo_unexecuted_blocks=1 00:23:16.034 00:23:16.034 ' 00:23:16.034 23:15:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:16.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.034 --rc genhtml_branch_coverage=1 00:23:16.034 --rc genhtml_function_coverage=1 00:23:16.034 --rc genhtml_legend=1 00:23:16.034 --rc geninfo_all_blocks=1 00:23:16.034 --rc geninfo_unexecuted_blocks=1 00:23:16.034 00:23:16.034 ' 00:23:16.034 23:15:42 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:16.034 23:15:42 -- nvmf/common.sh@7 -- # uname -s 00:23:16.034 23:15:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:16.034 23:15:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:16.034 23:15:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:16.034 23:15:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:16.034 23:15:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:16.034 23:15:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:16.034 23:15:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:16.034 23:15:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:16.034 23:15:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:16.034 23:15:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:16.034 23:15:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:16.034 23:15:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:16.034 23:15:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:16.034 23:15:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:16.034 23:15:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:16.034 23:15:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:16.034 23:15:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:16.034 23:15:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:16.034 23:15:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:16.034 23:15:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.034 23:15:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.034 23:15:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.034 23:15:42 -- paths/export.sh@5 -- # export PATH 00:23:16.034 23:15:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.034 23:15:42 -- nvmf/common.sh@46 -- # : 0 00:23:16.034 23:15:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:16.034 23:15:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:16.034 23:15:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:16.034 23:15:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:16.034 23:15:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:16.034 23:15:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:16.034 23:15:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:16.034 23:15:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:16.034 23:15:42 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:16.034 23:15:42 -- host/async_init.sh@14 -- # null_block_size=512 00:23:16.034 23:15:42 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:16.034 23:15:42 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:16.034 23:15:42 -- host/async_init.sh@20 -- # uuidgen 00:23:16.034 23:15:42 -- host/async_init.sh@20 -- # tr -d - 00:23:16.034 23:15:42 -- host/async_init.sh@20 -- # nguid=0a7df6738b7a4c56b2a9a5a1f0aa56ce 00:23:16.034 23:15:42 -- host/async_init.sh@22 -- # nvmftestinit 00:23:16.034 23:15:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:16.034 23:15:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:16.034 23:15:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:16.034 23:15:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:16.034 23:15:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:16.034 23:15:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:16.034 23:15:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:16.034 23:15:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:16.034 23:15:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:16.034 23:15:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:16.034 23:15:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:16.034 23:15:42 -- common/autotest_common.sh@10 -- # set +x 00:23:18.563 23:15:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:18.563 23:15:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:18.563 23:15:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:18.563 23:15:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:18.563 23:15:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:18.563 23:15:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:18.563 23:15:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:18.563 23:15:44 -- nvmf/common.sh@294 -- # net_devs=() 00:23:18.563 23:15:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:18.563 23:15:44 -- nvmf/common.sh@295 -- # e810=() 00:23:18.563 23:15:44 -- nvmf/common.sh@295 -- # local -ga e810 00:23:18.563 23:15:44 -- nvmf/common.sh@296 -- # x722=() 00:23:18.563 23:15:44 -- nvmf/common.sh@296 -- # local -ga x722 00:23:18.563 23:15:44 -- nvmf/common.sh@297 -- # mlx=() 00:23:18.563 23:15:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:18.563 23:15:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:18.563 23:15:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:18.563 23:15:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:18.563 23:15:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:18.563 23:15:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:18.563 23:15:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:18.563 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:18.563 23:15:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:18.563 23:15:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:18.563 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:18.563 23:15:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:18.563 23:15:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:18.563 23:15:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:18.563 23:15:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:18.563 23:15:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:18.563 23:15:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:18.563 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:18.563 23:15:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:18.563 23:15:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:18.563 23:15:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:18.563 23:15:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:18.563 23:15:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:18.563 23:15:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:18.563 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:18.563 23:15:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:18.563 23:15:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:18.563 23:15:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:18.563 23:15:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:18.563 23:15:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:18.563 23:15:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:18.563 23:15:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:18.563 23:15:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:18.563 23:15:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:18.563 23:15:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:18.563 23:15:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:18.563 23:15:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:18.563 23:15:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:18.563 23:15:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:18.563 23:15:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:18.563 23:15:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:18.563 23:15:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:18.563 23:15:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:18.563 23:15:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:18.563 23:15:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:18.563 23:15:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:18.563 23:15:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:18.563 23:15:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:18.563 23:15:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:18.563 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:18.563 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.327 ms 00:23:18.563 00:23:18.563 --- 10.0.0.2 ping statistics --- 00:23:18.563 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:18.563 rtt min/avg/max/mdev = 0.327/0.327/0.327/0.000 ms 00:23:18.563 23:15:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:18.563 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:18.563 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:23:18.563 00:23:18.563 --- 10.0.0.1 ping statistics --- 00:23:18.563 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:18.563 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:23:18.563 23:15:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:18.563 23:15:44 -- nvmf/common.sh@410 -- # return 0 00:23:18.563 23:15:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:18.563 23:15:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:18.563 23:15:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:18.563 23:15:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:18.563 23:15:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:18.563 23:15:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:18.563 23:15:44 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:18.563 23:15:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:18.563 23:15:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:18.563 23:15:44 -- common/autotest_common.sh@10 -- # set +x 00:23:18.563 23:15:44 -- nvmf/common.sh@469 -- # nvmfpid=279697 00:23:18.563 23:15:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:18.563 23:15:44 -- nvmf/common.sh@470 -- # waitforlisten 279697 00:23:18.563 23:15:44 -- common/autotest_common.sh@829 -- # '[' -z 279697 ']' 00:23:18.563 23:15:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:18.563 23:15:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:18.563 23:15:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:18.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:18.563 23:15:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:18.563 23:15:44 -- common/autotest_common.sh@10 -- # set +x 00:23:18.563 [2024-11-26 23:15:44.626858] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:18.563 [2024-11-26 23:15:44.626933] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:18.563 EAL: No free 2048 kB hugepages reported on node 1 00:23:18.563 [2024-11-26 23:15:44.694235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:18.563 [2024-11-26 23:15:44.804479] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:18.563 [2024-11-26 23:15:44.804643] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:18.563 [2024-11-26 23:15:44.804660] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:18.563 [2024-11-26 23:15:44.804672] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:18.563 [2024-11-26 23:15:44.804700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:19.494 23:15:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:19.494 23:15:45 -- common/autotest_common.sh@862 -- # return 0 00:23:19.494 23:15:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:19.494 23:15:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:19.494 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 23:15:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:19.494 23:15:45 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:19.494 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.494 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 [2024-11-26 23:15:45.614649] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:19.494 23:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.494 23:15:45 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:19.494 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.494 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 null0 00:23:19.494 23:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.494 23:15:45 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:19.494 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.494 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 23:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.494 23:15:45 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:19.494 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.494 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 23:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.494 23:15:45 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 0a7df6738b7a4c56b2a9a5a1f0aa56ce 00:23:19.494 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.494 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 23:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.494 23:15:45 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:19.494 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.494 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 [2024-11-26 23:15:45.654862] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:19.494 23:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.494 23:15:45 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:19.494 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.494 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.750 nvme0n1 00:23:19.750 23:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.750 23:15:45 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:19.750 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.750 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.750 [ 00:23:19.750 { 00:23:19.750 "name": "nvme0n1", 00:23:19.750 "aliases": [ 00:23:19.750 "0a7df673-8b7a-4c56-b2a9-a5a1f0aa56ce" 00:23:19.750 ], 00:23:19.750 "product_name": "NVMe disk", 00:23:19.750 "block_size": 512, 00:23:19.750 "num_blocks": 2097152, 00:23:19.750 "uuid": "0a7df673-8b7a-4c56-b2a9-a5a1f0aa56ce", 00:23:19.750 "assigned_rate_limits": { 00:23:19.750 "rw_ios_per_sec": 0, 00:23:19.750 "rw_mbytes_per_sec": 0, 00:23:19.750 "r_mbytes_per_sec": 0, 00:23:19.750 "w_mbytes_per_sec": 0 00:23:19.750 }, 00:23:19.750 "claimed": false, 00:23:19.750 "zoned": false, 00:23:19.750 "supported_io_types": { 00:23:19.750 "read": true, 00:23:19.750 "write": true, 00:23:19.750 "unmap": false, 00:23:19.750 "write_zeroes": true, 00:23:19.750 "flush": true, 00:23:19.750 "reset": true, 00:23:19.750 "compare": true, 00:23:19.750 "compare_and_write": true, 00:23:19.750 "abort": true, 00:23:19.750 "nvme_admin": true, 00:23:19.750 "nvme_io": true 00:23:19.750 }, 00:23:19.750 "driver_specific": { 00:23:19.750 "nvme": [ 00:23:19.750 { 00:23:19.750 "trid": { 00:23:19.750 "trtype": "TCP", 00:23:19.750 "adrfam": "IPv4", 00:23:19.750 "traddr": "10.0.0.2", 00:23:19.750 "trsvcid": "4420", 00:23:19.750 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:19.750 }, 00:23:19.750 "ctrlr_data": { 00:23:19.750 "cntlid": 1, 00:23:19.750 "vendor_id": "0x8086", 00:23:19.750 "model_number": "SPDK bdev Controller", 00:23:19.750 "serial_number": "00000000000000000000", 00:23:19.750 "firmware_revision": "24.01.1", 00:23:19.750 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:19.750 "oacs": { 00:23:19.750 "security": 0, 00:23:19.750 "format": 0, 00:23:19.751 "firmware": 0, 00:23:19.751 "ns_manage": 0 00:23:19.751 }, 00:23:19.751 "multi_ctrlr": true, 00:23:19.751 "ana_reporting": false 00:23:19.751 }, 00:23:19.751 "vs": { 00:23:19.751 "nvme_version": "1.3" 00:23:19.751 }, 00:23:19.751 "ns_data": { 00:23:19.751 "id": 1, 00:23:19.751 "can_share": true 00:23:19.751 } 00:23:19.751 } 00:23:19.751 ], 00:23:19.751 "mp_policy": "active_passive" 00:23:19.751 } 00:23:19.751 } 00:23:19.751 ] 00:23:19.751 23:15:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.751 23:15:45 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:19.751 23:15:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.751 23:15:45 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 [2024-11-26 23:15:45.903433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:19.751 [2024-11-26 23:15:45.903522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1991ba0 (9): Bad file descriptor 00:23:19.751 [2024-11-26 23:15:46.035679] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:19.751 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.751 23:15:46 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:19.751 23:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.751 23:15:46 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 [ 00:23:19.751 { 00:23:19.751 "name": "nvme0n1", 00:23:19.751 "aliases": [ 00:23:19.751 "0a7df673-8b7a-4c56-b2a9-a5a1f0aa56ce" 00:23:19.751 ], 00:23:19.751 "product_name": "NVMe disk", 00:23:19.751 "block_size": 512, 00:23:19.751 "num_blocks": 2097152, 00:23:19.751 "uuid": "0a7df673-8b7a-4c56-b2a9-a5a1f0aa56ce", 00:23:19.751 "assigned_rate_limits": { 00:23:19.751 "rw_ios_per_sec": 0, 00:23:19.751 "rw_mbytes_per_sec": 0, 00:23:19.751 "r_mbytes_per_sec": 0, 00:23:19.751 "w_mbytes_per_sec": 0 00:23:19.751 }, 00:23:19.751 "claimed": false, 00:23:19.751 "zoned": false, 00:23:19.751 "supported_io_types": { 00:23:19.751 "read": true, 00:23:19.751 "write": true, 00:23:19.751 "unmap": false, 00:23:19.751 "write_zeroes": true, 00:23:19.751 "flush": true, 00:23:19.751 "reset": true, 00:23:19.751 "compare": true, 00:23:19.751 "compare_and_write": true, 00:23:19.751 "abort": true, 00:23:19.751 "nvme_admin": true, 00:23:19.751 "nvme_io": true 00:23:19.751 }, 00:23:19.751 "driver_specific": { 00:23:19.751 "nvme": [ 00:23:19.751 { 00:23:19.751 "trid": { 00:23:19.751 "trtype": "TCP", 00:23:19.751 "adrfam": "IPv4", 00:23:19.751 "traddr": "10.0.0.2", 00:23:19.751 "trsvcid": "4420", 00:23:19.751 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:19.751 }, 00:23:19.751 "ctrlr_data": { 00:23:19.751 "cntlid": 2, 00:23:19.751 "vendor_id": "0x8086", 00:23:19.751 "model_number": "SPDK bdev Controller", 00:23:19.751 "serial_number": "00000000000000000000", 00:23:19.751 "firmware_revision": "24.01.1", 00:23:19.751 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:19.751 "oacs": { 00:23:19.751 "security": 0, 00:23:19.751 "format": 0, 00:23:19.751 "firmware": 0, 00:23:19.751 "ns_manage": 0 00:23:19.751 }, 00:23:19.751 "multi_ctrlr": true, 00:23:19.751 "ana_reporting": false 00:23:19.751 }, 00:23:19.751 "vs": { 00:23:19.751 "nvme_version": "1.3" 00:23:19.751 }, 00:23:19.751 "ns_data": { 00:23:19.751 "id": 1, 00:23:19.751 "can_share": true 00:23:19.751 } 00:23:19.751 } 00:23:19.751 ], 00:23:19.751 "mp_policy": "active_passive" 00:23:19.751 } 00:23:19.751 } 00:23:19.751 ] 00:23:19.751 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.751 23:15:46 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:19.751 23:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.751 23:15:46 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.751 23:15:46 -- host/async_init.sh@53 -- # mktemp 00:23:19.751 23:15:46 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.Y13wNDBVKK 00:23:19.751 23:15:46 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:19.751 23:15:46 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.Y13wNDBVKK 00:23:19.751 23:15:46 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:19.751 23:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.751 23:15:46 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.751 23:15:46 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:19.751 23:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.751 23:15:46 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 [2024-11-26 23:15:46.080020] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:19.751 [2024-11-26 23:15:46.080160] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:19.751 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.751 23:15:46 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Y13wNDBVKK 00:23:19.751 23:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.751 23:15:46 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.751 23:15:46 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Y13wNDBVKK 00:23:19.751 23:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.751 23:15:46 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 [2024-11-26 23:15:46.096063] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:20.007 nvme0n1 00:23:20.007 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.007 23:15:46 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:20.007 23:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.007 23:15:46 -- common/autotest_common.sh@10 -- # set +x 00:23:20.007 [ 00:23:20.007 { 00:23:20.007 "name": "nvme0n1", 00:23:20.007 "aliases": [ 00:23:20.007 "0a7df673-8b7a-4c56-b2a9-a5a1f0aa56ce" 00:23:20.007 ], 00:23:20.007 "product_name": "NVMe disk", 00:23:20.007 "block_size": 512, 00:23:20.007 "num_blocks": 2097152, 00:23:20.007 "uuid": "0a7df673-8b7a-4c56-b2a9-a5a1f0aa56ce", 00:23:20.007 "assigned_rate_limits": { 00:23:20.007 "rw_ios_per_sec": 0, 00:23:20.007 "rw_mbytes_per_sec": 0, 00:23:20.007 "r_mbytes_per_sec": 0, 00:23:20.007 "w_mbytes_per_sec": 0 00:23:20.007 }, 00:23:20.008 "claimed": false, 00:23:20.008 "zoned": false, 00:23:20.008 "supported_io_types": { 00:23:20.008 "read": true, 00:23:20.008 "write": true, 00:23:20.008 "unmap": false, 00:23:20.008 "write_zeroes": true, 00:23:20.008 "flush": true, 00:23:20.008 "reset": true, 00:23:20.008 "compare": true, 00:23:20.008 "compare_and_write": true, 00:23:20.008 "abort": true, 00:23:20.008 "nvme_admin": true, 00:23:20.008 "nvme_io": true 00:23:20.008 }, 00:23:20.008 "driver_specific": { 00:23:20.008 "nvme": [ 00:23:20.008 { 00:23:20.008 "trid": { 00:23:20.008 "trtype": "TCP", 00:23:20.008 "adrfam": "IPv4", 00:23:20.008 "traddr": "10.0.0.2", 00:23:20.008 "trsvcid": "4421", 00:23:20.008 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:20.008 }, 00:23:20.008 "ctrlr_data": { 00:23:20.008 "cntlid": 3, 00:23:20.008 "vendor_id": "0x8086", 00:23:20.008 "model_number": "SPDK bdev Controller", 00:23:20.008 "serial_number": "00000000000000000000", 00:23:20.008 "firmware_revision": "24.01.1", 00:23:20.008 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:20.008 "oacs": { 00:23:20.008 "security": 0, 00:23:20.008 "format": 0, 00:23:20.008 "firmware": 0, 00:23:20.008 "ns_manage": 0 00:23:20.008 }, 00:23:20.008 "multi_ctrlr": true, 00:23:20.008 "ana_reporting": false 00:23:20.008 }, 00:23:20.008 "vs": { 00:23:20.008 "nvme_version": "1.3" 00:23:20.008 }, 00:23:20.008 "ns_data": { 00:23:20.008 "id": 1, 00:23:20.008 "can_share": true 00:23:20.008 } 00:23:20.008 } 00:23:20.008 ], 00:23:20.008 "mp_policy": "active_passive" 00:23:20.008 } 00:23:20.008 } 00:23:20.008 ] 00:23:20.008 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.008 23:15:46 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:20.008 23:15:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.008 23:15:46 -- common/autotest_common.sh@10 -- # set +x 00:23:20.008 23:15:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.008 23:15:46 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.Y13wNDBVKK 00:23:20.008 23:15:46 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:20.008 23:15:46 -- host/async_init.sh@78 -- # nvmftestfini 00:23:20.008 23:15:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:20.008 23:15:46 -- nvmf/common.sh@116 -- # sync 00:23:20.008 23:15:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:20.008 23:15:46 -- nvmf/common.sh@119 -- # set +e 00:23:20.008 23:15:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:20.008 23:15:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:20.008 rmmod nvme_tcp 00:23:20.008 rmmod nvme_fabrics 00:23:20.008 rmmod nvme_keyring 00:23:20.008 23:15:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:20.008 23:15:46 -- nvmf/common.sh@123 -- # set -e 00:23:20.008 23:15:46 -- nvmf/common.sh@124 -- # return 0 00:23:20.008 23:15:46 -- nvmf/common.sh@477 -- # '[' -n 279697 ']' 00:23:20.008 23:15:46 -- nvmf/common.sh@478 -- # killprocess 279697 00:23:20.008 23:15:46 -- common/autotest_common.sh@936 -- # '[' -z 279697 ']' 00:23:20.008 23:15:46 -- common/autotest_common.sh@940 -- # kill -0 279697 00:23:20.008 23:15:46 -- common/autotest_common.sh@941 -- # uname 00:23:20.008 23:15:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:20.008 23:15:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 279697 00:23:20.008 23:15:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:20.008 23:15:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:20.008 23:15:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 279697' 00:23:20.008 killing process with pid 279697 00:23:20.008 23:15:46 -- common/autotest_common.sh@955 -- # kill 279697 00:23:20.008 23:15:46 -- common/autotest_common.sh@960 -- # wait 279697 00:23:20.265 23:15:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:20.265 23:15:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:20.265 23:15:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:20.265 23:15:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:20.265 23:15:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:20.265 23:15:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:20.265 23:15:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:20.265 23:15:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:22.798 23:15:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:22.798 00:23:22.798 real 0m6.452s 00:23:22.798 user 0m3.135s 00:23:22.798 sys 0m1.951s 00:23:22.798 23:15:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:22.798 23:15:48 -- common/autotest_common.sh@10 -- # set +x 00:23:22.798 ************************************ 00:23:22.798 END TEST nvmf_async_init 00:23:22.798 ************************************ 00:23:22.798 23:15:48 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:22.798 23:15:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:22.798 23:15:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:22.798 23:15:48 -- common/autotest_common.sh@10 -- # set +x 00:23:22.798 ************************************ 00:23:22.798 START TEST dma 00:23:22.798 ************************************ 00:23:22.798 23:15:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:22.798 * Looking for test storage... 00:23:22.798 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:22.798 23:15:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:22.798 23:15:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:22.798 23:15:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:22.798 23:15:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:22.798 23:15:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:22.798 23:15:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:22.798 23:15:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:22.798 23:15:48 -- scripts/common.sh@335 -- # IFS=.-: 00:23:22.798 23:15:48 -- scripts/common.sh@335 -- # read -ra ver1 00:23:22.798 23:15:48 -- scripts/common.sh@336 -- # IFS=.-: 00:23:22.798 23:15:48 -- scripts/common.sh@336 -- # read -ra ver2 00:23:22.798 23:15:48 -- scripts/common.sh@337 -- # local 'op=<' 00:23:22.798 23:15:48 -- scripts/common.sh@339 -- # ver1_l=2 00:23:22.798 23:15:48 -- scripts/common.sh@340 -- # ver2_l=1 00:23:22.798 23:15:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:22.798 23:15:48 -- scripts/common.sh@343 -- # case "$op" in 00:23:22.798 23:15:48 -- scripts/common.sh@344 -- # : 1 00:23:22.798 23:15:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:22.798 23:15:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:22.798 23:15:48 -- scripts/common.sh@364 -- # decimal 1 00:23:22.798 23:15:48 -- scripts/common.sh@352 -- # local d=1 00:23:22.798 23:15:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:22.798 23:15:48 -- scripts/common.sh@354 -- # echo 1 00:23:22.798 23:15:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:22.798 23:15:48 -- scripts/common.sh@365 -- # decimal 2 00:23:22.798 23:15:48 -- scripts/common.sh@352 -- # local d=2 00:23:22.798 23:15:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:22.798 23:15:48 -- scripts/common.sh@354 -- # echo 2 00:23:22.798 23:15:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:22.798 23:15:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:22.798 23:15:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:22.798 23:15:48 -- scripts/common.sh@367 -- # return 0 00:23:22.798 23:15:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:22.798 23:15:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:22.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:22.798 --rc genhtml_branch_coverage=1 00:23:22.798 --rc genhtml_function_coverage=1 00:23:22.798 --rc genhtml_legend=1 00:23:22.798 --rc geninfo_all_blocks=1 00:23:22.798 --rc geninfo_unexecuted_blocks=1 00:23:22.798 00:23:22.798 ' 00:23:22.798 23:15:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:22.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:22.798 --rc genhtml_branch_coverage=1 00:23:22.798 --rc genhtml_function_coverage=1 00:23:22.798 --rc genhtml_legend=1 00:23:22.798 --rc geninfo_all_blocks=1 00:23:22.798 --rc geninfo_unexecuted_blocks=1 00:23:22.798 00:23:22.798 ' 00:23:22.798 23:15:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:22.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:22.798 --rc genhtml_branch_coverage=1 00:23:22.798 --rc genhtml_function_coverage=1 00:23:22.798 --rc genhtml_legend=1 00:23:22.798 --rc geninfo_all_blocks=1 00:23:22.798 --rc geninfo_unexecuted_blocks=1 00:23:22.798 00:23:22.798 ' 00:23:22.798 23:15:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:22.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:22.798 --rc genhtml_branch_coverage=1 00:23:22.798 --rc genhtml_function_coverage=1 00:23:22.798 --rc genhtml_legend=1 00:23:22.798 --rc geninfo_all_blocks=1 00:23:22.798 --rc geninfo_unexecuted_blocks=1 00:23:22.798 00:23:22.798 ' 00:23:22.798 23:15:48 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:22.798 23:15:48 -- nvmf/common.sh@7 -- # uname -s 00:23:22.798 23:15:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:22.798 23:15:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:22.798 23:15:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:22.798 23:15:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:22.798 23:15:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:22.798 23:15:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:22.798 23:15:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:22.798 23:15:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:22.798 23:15:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:22.798 23:15:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:22.798 23:15:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:22.798 23:15:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:22.798 23:15:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:22.798 23:15:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:22.798 23:15:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:22.798 23:15:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:22.798 23:15:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:22.798 23:15:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:22.798 23:15:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:22.798 23:15:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.798 23:15:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.799 23:15:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.799 23:15:48 -- paths/export.sh@5 -- # export PATH 00:23:22.799 23:15:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.799 23:15:48 -- nvmf/common.sh@46 -- # : 0 00:23:22.799 23:15:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:22.799 23:15:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:22.799 23:15:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:22.799 23:15:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:22.799 23:15:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:22.799 23:15:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:22.799 23:15:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:22.799 23:15:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:22.799 23:15:48 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:22.799 23:15:48 -- host/dma.sh@13 -- # exit 0 00:23:22.799 00:23:22.799 real 0m0.152s 00:23:22.799 user 0m0.102s 00:23:22.799 sys 0m0.058s 00:23:22.799 23:15:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:22.799 23:15:48 -- common/autotest_common.sh@10 -- # set +x 00:23:22.799 ************************************ 00:23:22.799 END TEST dma 00:23:22.799 ************************************ 00:23:22.799 23:15:48 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:22.799 23:15:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:22.799 23:15:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:22.799 23:15:48 -- common/autotest_common.sh@10 -- # set +x 00:23:22.799 ************************************ 00:23:22.799 START TEST nvmf_identify 00:23:22.799 ************************************ 00:23:22.799 23:15:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:22.799 * Looking for test storage... 00:23:22.799 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:22.799 23:15:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:22.799 23:15:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:22.799 23:15:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:22.799 23:15:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:22.799 23:15:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:22.799 23:15:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:22.799 23:15:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:22.799 23:15:48 -- scripts/common.sh@335 -- # IFS=.-: 00:23:22.799 23:15:48 -- scripts/common.sh@335 -- # read -ra ver1 00:23:22.799 23:15:48 -- scripts/common.sh@336 -- # IFS=.-: 00:23:22.799 23:15:48 -- scripts/common.sh@336 -- # read -ra ver2 00:23:22.799 23:15:48 -- scripts/common.sh@337 -- # local 'op=<' 00:23:22.799 23:15:48 -- scripts/common.sh@339 -- # ver1_l=2 00:23:22.799 23:15:48 -- scripts/common.sh@340 -- # ver2_l=1 00:23:22.799 23:15:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:22.799 23:15:48 -- scripts/common.sh@343 -- # case "$op" in 00:23:22.799 23:15:48 -- scripts/common.sh@344 -- # : 1 00:23:22.799 23:15:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:22.799 23:15:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:22.799 23:15:48 -- scripts/common.sh@364 -- # decimal 1 00:23:22.799 23:15:48 -- scripts/common.sh@352 -- # local d=1 00:23:22.799 23:15:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:22.799 23:15:48 -- scripts/common.sh@354 -- # echo 1 00:23:22.799 23:15:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:22.799 23:15:48 -- scripts/common.sh@365 -- # decimal 2 00:23:22.799 23:15:48 -- scripts/common.sh@352 -- # local d=2 00:23:22.799 23:15:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:22.799 23:15:48 -- scripts/common.sh@354 -- # echo 2 00:23:22.799 23:15:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:22.799 23:15:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:22.799 23:15:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:22.799 23:15:48 -- scripts/common.sh@367 -- # return 0 00:23:22.799 23:15:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:22.799 23:15:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:22.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:22.799 --rc genhtml_branch_coverage=1 00:23:22.799 --rc genhtml_function_coverage=1 00:23:22.799 --rc genhtml_legend=1 00:23:22.799 --rc geninfo_all_blocks=1 00:23:22.799 --rc geninfo_unexecuted_blocks=1 00:23:22.799 00:23:22.799 ' 00:23:22.799 23:15:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:22.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:22.799 --rc genhtml_branch_coverage=1 00:23:22.799 --rc genhtml_function_coverage=1 00:23:22.799 --rc genhtml_legend=1 00:23:22.799 --rc geninfo_all_blocks=1 00:23:22.799 --rc geninfo_unexecuted_blocks=1 00:23:22.799 00:23:22.799 ' 00:23:22.799 23:15:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:22.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:22.799 --rc genhtml_branch_coverage=1 00:23:22.799 --rc genhtml_function_coverage=1 00:23:22.799 --rc genhtml_legend=1 00:23:22.799 --rc geninfo_all_blocks=1 00:23:22.799 --rc geninfo_unexecuted_blocks=1 00:23:22.799 00:23:22.799 ' 00:23:22.799 23:15:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:22.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:22.799 --rc genhtml_branch_coverage=1 00:23:22.799 --rc genhtml_function_coverage=1 00:23:22.799 --rc genhtml_legend=1 00:23:22.799 --rc geninfo_all_blocks=1 00:23:22.799 --rc geninfo_unexecuted_blocks=1 00:23:22.799 00:23:22.799 ' 00:23:22.799 23:15:48 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:22.799 23:15:48 -- nvmf/common.sh@7 -- # uname -s 00:23:22.799 23:15:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:22.799 23:15:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:22.799 23:15:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:22.799 23:15:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:22.799 23:15:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:22.799 23:15:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:22.799 23:15:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:22.799 23:15:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:22.799 23:15:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:22.799 23:15:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:22.799 23:15:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:22.799 23:15:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:22.799 23:15:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:22.799 23:15:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:22.799 23:15:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:22.799 23:15:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:22.799 23:15:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:22.799 23:15:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:22.799 23:15:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:22.800 23:15:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.800 23:15:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.800 23:15:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.800 23:15:48 -- paths/export.sh@5 -- # export PATH 00:23:22.800 23:15:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.800 23:15:48 -- nvmf/common.sh@46 -- # : 0 00:23:22.800 23:15:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:22.800 23:15:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:22.800 23:15:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:22.800 23:15:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:22.800 23:15:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:22.800 23:15:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:22.800 23:15:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:22.800 23:15:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:22.800 23:15:48 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:22.800 23:15:48 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:22.800 23:15:48 -- host/identify.sh@14 -- # nvmftestinit 00:23:22.800 23:15:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:22.800 23:15:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:22.800 23:15:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:22.800 23:15:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:22.800 23:15:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:22.800 23:15:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:22.800 23:15:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:22.800 23:15:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:22.800 23:15:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:22.800 23:15:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:22.800 23:15:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:22.800 23:15:48 -- common/autotest_common.sh@10 -- # set +x 00:23:24.699 23:15:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:24.699 23:15:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:24.699 23:15:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:24.699 23:15:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:24.699 23:15:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:24.699 23:15:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:24.699 23:15:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:24.699 23:15:50 -- nvmf/common.sh@294 -- # net_devs=() 00:23:24.699 23:15:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:24.699 23:15:50 -- nvmf/common.sh@295 -- # e810=() 00:23:24.699 23:15:50 -- nvmf/common.sh@295 -- # local -ga e810 00:23:24.699 23:15:50 -- nvmf/common.sh@296 -- # x722=() 00:23:24.699 23:15:50 -- nvmf/common.sh@296 -- # local -ga x722 00:23:24.699 23:15:50 -- nvmf/common.sh@297 -- # mlx=() 00:23:24.699 23:15:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:24.699 23:15:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:24.699 23:15:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:24.699 23:15:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:24.699 23:15:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:24.699 23:15:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:24.700 23:15:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:24.700 23:15:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:24.700 23:15:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:24.700 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:24.700 23:15:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:24.700 23:15:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:24.700 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:24.700 23:15:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:24.700 23:15:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:24.700 23:15:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:24.700 23:15:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:24.700 23:15:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:24.700 23:15:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:24.700 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:24.700 23:15:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:24.700 23:15:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:24.700 23:15:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:24.700 23:15:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:24.700 23:15:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:24.700 23:15:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:24.700 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:24.700 23:15:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:24.700 23:15:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:24.700 23:15:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:24.700 23:15:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:24.700 23:15:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:24.700 23:15:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:24.700 23:15:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:24.700 23:15:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:24.700 23:15:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:24.700 23:15:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:24.700 23:15:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:24.700 23:15:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:24.700 23:15:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:24.700 23:15:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:24.700 23:15:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:24.700 23:15:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:24.700 23:15:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:24.700 23:15:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:24.700 23:15:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:24.700 23:15:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:24.700 23:15:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:24.700 23:15:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:24.700 23:15:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:24.700 23:15:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:24.700 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:24.700 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:23:24.700 00:23:24.700 --- 10.0.0.2 ping statistics --- 00:23:24.700 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:24.700 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:23:24.700 23:15:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:24.700 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:24.700 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:23:24.700 00:23:24.700 --- 10.0.0.1 ping statistics --- 00:23:24.700 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:24.700 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:23:24.700 23:15:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:24.700 23:15:50 -- nvmf/common.sh@410 -- # return 0 00:23:24.700 23:15:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:24.700 23:15:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:24.700 23:15:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:24.700 23:15:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:24.700 23:15:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:24.700 23:15:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:24.700 23:15:50 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:24.700 23:15:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:24.700 23:15:50 -- common/autotest_common.sh@10 -- # set +x 00:23:24.700 23:15:50 -- host/identify.sh@19 -- # nvmfpid=281977 00:23:24.700 23:15:50 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:24.700 23:15:51 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:24.700 23:15:51 -- host/identify.sh@23 -- # waitforlisten 281977 00:23:24.700 23:15:51 -- common/autotest_common.sh@829 -- # '[' -z 281977 ']' 00:23:24.700 23:15:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:24.700 23:15:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:24.700 23:15:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:24.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:24.700 23:15:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:24.700 23:15:51 -- common/autotest_common.sh@10 -- # set +x 00:23:24.700 [2024-11-26 23:15:51.040621] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:24.700 [2024-11-26 23:15:51.040696] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:24.700 EAL: No free 2048 kB hugepages reported on node 1 00:23:24.959 [2024-11-26 23:15:51.108698] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:24.959 [2024-11-26 23:15:51.222038] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:24.959 [2024-11-26 23:15:51.222194] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:24.959 [2024-11-26 23:15:51.222210] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:24.959 [2024-11-26 23:15:51.222223] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:24.959 [2024-11-26 23:15:51.222287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:24.959 [2024-11-26 23:15:51.222404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:24.959 [2024-11-26 23:15:51.222475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:24.959 [2024-11-26 23:15:51.222478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:25.894 23:15:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:25.894 23:15:52 -- common/autotest_common.sh@862 -- # return 0 00:23:25.894 23:15:52 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:25.894 23:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.894 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:25.894 [2024-11-26 23:15:52.057081] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:25.894 23:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.894 23:15:52 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:25.894 23:15:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:25.894 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:25.894 23:15:52 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:25.894 23:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.894 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:25.894 Malloc0 00:23:25.894 23:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.894 23:15:52 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:25.894 23:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.894 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:25.894 23:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.894 23:15:52 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:25.894 23:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.894 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:25.894 23:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.894 23:15:52 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:25.894 23:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.894 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:25.894 [2024-11-26 23:15:52.128160] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:25.894 23:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.894 23:15:52 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:25.894 23:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.894 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:25.894 23:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.894 23:15:52 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:25.894 23:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.894 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:25.894 [2024-11-26 23:15:52.143931] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:25.894 [ 00:23:25.894 { 00:23:25.894 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:25.894 "subtype": "Discovery", 00:23:25.894 "listen_addresses": [ 00:23:25.894 { 00:23:25.894 "transport": "TCP", 00:23:25.894 "trtype": "TCP", 00:23:25.894 "adrfam": "IPv4", 00:23:25.894 "traddr": "10.0.0.2", 00:23:25.894 "trsvcid": "4420" 00:23:25.894 } 00:23:25.894 ], 00:23:25.894 "allow_any_host": true, 00:23:25.894 "hosts": [] 00:23:25.894 }, 00:23:25.894 { 00:23:25.894 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:25.894 "subtype": "NVMe", 00:23:25.894 "listen_addresses": [ 00:23:25.894 { 00:23:25.894 "transport": "TCP", 00:23:25.894 "trtype": "TCP", 00:23:25.894 "adrfam": "IPv4", 00:23:25.894 "traddr": "10.0.0.2", 00:23:25.894 "trsvcid": "4420" 00:23:25.894 } 00:23:25.894 ], 00:23:25.894 "allow_any_host": true, 00:23:25.894 "hosts": [], 00:23:25.894 "serial_number": "SPDK00000000000001", 00:23:25.894 "model_number": "SPDK bdev Controller", 00:23:25.894 "max_namespaces": 32, 00:23:25.894 "min_cntlid": 1, 00:23:25.894 "max_cntlid": 65519, 00:23:25.894 "namespaces": [ 00:23:25.894 { 00:23:25.894 "nsid": 1, 00:23:25.895 "bdev_name": "Malloc0", 00:23:25.895 "name": "Malloc0", 00:23:25.895 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:25.895 "eui64": "ABCDEF0123456789", 00:23:25.895 "uuid": "fd6eadeb-02a5-45f9-9449-783bdfaa2c8b" 00:23:25.895 } 00:23:25.895 ] 00:23:25.895 } 00:23:25.895 ] 00:23:25.895 23:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.895 23:15:52 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:25.895 [2024-11-26 23:15:52.165988] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:25.895 [2024-11-26 23:15:52.166025] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid282147 ] 00:23:25.895 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.895 [2024-11-26 23:15:52.196774] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:25.895 [2024-11-26 23:15:52.196854] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:25.895 [2024-11-26 23:15:52.196866] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:25.895 [2024-11-26 23:15:52.196888] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:25.895 [2024-11-26 23:15:52.196901] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:25.895 [2024-11-26 23:15:52.200584] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:25.895 [2024-11-26 23:15:52.200645] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x21d7e10 0 00:23:25.895 [2024-11-26 23:15:52.200766] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:25.895 [2024-11-26 23:15:52.200785] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:25.895 [2024-11-26 23:15:52.200793] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:25.895 [2024-11-26 23:15:52.200799] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:25.895 [2024-11-26 23:15:52.200857] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.200873] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.200881] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.895 [2024-11-26 23:15:52.200900] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:25.895 [2024-11-26 23:15:52.200926] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.895 [2024-11-26 23:15:52.207538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.895 [2024-11-26 23:15:52.207557] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.895 [2024-11-26 23:15:52.207565] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.207572] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.895 [2024-11-26 23:15:52.207590] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:25.895 [2024-11-26 23:15:52.207601] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:25.895 [2024-11-26 23:15:52.207610] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:25.895 [2024-11-26 23:15:52.207630] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.207639] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.207645] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.895 [2024-11-26 23:15:52.207657] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.895 [2024-11-26 23:15:52.207681] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.895 [2024-11-26 23:15:52.207787] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.895 [2024-11-26 23:15:52.207801] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.895 [2024-11-26 23:15:52.207808] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.207814] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.895 [2024-11-26 23:15:52.207825] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:25.895 [2024-11-26 23:15:52.207837] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:25.895 [2024-11-26 23:15:52.207849] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.207857] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.207863] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.895 [2024-11-26 23:15:52.207874] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.895 [2024-11-26 23:15:52.207894] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.895 [2024-11-26 23:15:52.207968] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.895 [2024-11-26 23:15:52.207980] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.895 [2024-11-26 23:15:52.207987] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.207993] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.895 [2024-11-26 23:15:52.208003] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:25.895 [2024-11-26 23:15:52.208016] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:25.895 [2024-11-26 23:15:52.208027] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208039] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208046] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.895 [2024-11-26 23:15:52.208056] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.895 [2024-11-26 23:15:52.208077] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.895 [2024-11-26 23:15:52.208150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.895 [2024-11-26 23:15:52.208164] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.895 [2024-11-26 23:15:52.208171] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208177] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.895 [2024-11-26 23:15:52.208187] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:25.895 [2024-11-26 23:15:52.208203] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208211] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208217] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.895 [2024-11-26 23:15:52.208228] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.895 [2024-11-26 23:15:52.208248] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.895 [2024-11-26 23:15:52.208321] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.895 [2024-11-26 23:15:52.208334] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.895 [2024-11-26 23:15:52.208341] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208347] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.895 [2024-11-26 23:15:52.208357] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:25.895 [2024-11-26 23:15:52.208365] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:25.895 [2024-11-26 23:15:52.208377] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:25.895 [2024-11-26 23:15:52.208487] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:25.895 [2024-11-26 23:15:52.208495] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:25.895 [2024-11-26 23:15:52.208509] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208516] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208522] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.895 [2024-11-26 23:15:52.208542] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.895 [2024-11-26 23:15:52.208564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.895 [2024-11-26 23:15:52.208641] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.895 [2024-11-26 23:15:52.208654] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.895 [2024-11-26 23:15:52.208661] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208667] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.895 [2024-11-26 23:15:52.208677] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:25.895 [2024-11-26 23:15:52.208697] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208706] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208713] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.895 [2024-11-26 23:15:52.208723] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.895 [2024-11-26 23:15:52.208744] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.895 [2024-11-26 23:15:52.208817] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.895 [2024-11-26 23:15:52.208830] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.895 [2024-11-26 23:15:52.208837] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.895 [2024-11-26 23:15:52.208843] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.895 [2024-11-26 23:15:52.208852] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:25.896 [2024-11-26 23:15:52.208860] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:25.896 [2024-11-26 23:15:52.208872] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:25.896 [2024-11-26 23:15:52.208886] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:25.896 [2024-11-26 23:15:52.208901] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.208908] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.208915] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.208925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.896 [2024-11-26 23:15:52.208946] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.896 [2024-11-26 23:15:52.209052] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.896 [2024-11-26 23:15:52.209066] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.896 [2024-11-26 23:15:52.209073] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209079] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=4096, cccid=0 00:23:25.896 [2024-11-26 23:15:52.209087] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2257b30) on tqpair(0x21d7e10): expected_datao=0, payload_size=4096 00:23:25.896 [2024-11-26 23:15:52.209114] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209125] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209162] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.896 [2024-11-26 23:15:52.209175] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.896 [2024-11-26 23:15:52.209181] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209188] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.896 [2024-11-26 23:15:52.209201] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:25.896 [2024-11-26 23:15:52.209210] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:25.896 [2024-11-26 23:15:52.209217] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:25.896 [2024-11-26 23:15:52.209226] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:25.896 [2024-11-26 23:15:52.209238] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:25.896 [2024-11-26 23:15:52.209246] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:25.896 [2024-11-26 23:15:52.209265] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:25.896 [2024-11-26 23:15:52.209278] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209285] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209292] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.209302] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:25.896 [2024-11-26 23:15:52.209323] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.896 [2024-11-26 23:15:52.209410] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.896 [2024-11-26 23:15:52.209424] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.896 [2024-11-26 23:15:52.209430] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209437] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:25.896 [2024-11-26 23:15:52.209450] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209457] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209463] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.209473] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.896 [2024-11-26 23:15:52.209482] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209489] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209495] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.209504] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.896 [2024-11-26 23:15:52.209513] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209519] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209534] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.209544] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.896 [2024-11-26 23:15:52.209554] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209560] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209567] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.209575] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.896 [2024-11-26 23:15:52.209584] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:25.896 [2024-11-26 23:15:52.209602] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:25.896 [2024-11-26 23:15:52.209615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209621] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209628] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.209641] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.896 [2024-11-26 23:15:52.209665] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:25.896 [2024-11-26 23:15:52.209677] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257c90, cid 1, qid 0 00:23:25.896 [2024-11-26 23:15:52.209684] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257df0, cid 2, qid 0 00:23:25.896 [2024-11-26 23:15:52.209692] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:25.896 [2024-11-26 23:15:52.209699] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:25.896 [2024-11-26 23:15:52.209809] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.896 [2024-11-26 23:15:52.209820] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.896 [2024-11-26 23:15:52.209827] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209833] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:25.896 [2024-11-26 23:15:52.209844] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:25.896 [2024-11-26 23:15:52.209852] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:25.896 [2024-11-26 23:15:52.209869] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209878] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.209884] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.209894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.896 [2024-11-26 23:15:52.209914] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:25.896 [2024-11-26 23:15:52.210008] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.896 [2024-11-26 23:15:52.210019] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.896 [2024-11-26 23:15:52.210026] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.210032] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=4096, cccid=4 00:23:25.896 [2024-11-26 23:15:52.210039] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22580b0) on tqpair(0x21d7e10): expected_datao=0, payload_size=4096 00:23:25.896 [2024-11-26 23:15:52.210055] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.210063] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.250625] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.896 [2024-11-26 23:15:52.250644] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.896 [2024-11-26 23:15:52.250652] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.250659] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:25.896 [2024-11-26 23:15:52.250680] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:25.896 [2024-11-26 23:15:52.250718] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.250728] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.250735] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.250746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.896 [2024-11-26 23:15:52.250758] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.250769] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.250776] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21d7e10) 00:23:25.896 [2024-11-26 23:15:52.250785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.896 [2024-11-26 23:15:52.250813] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:25.896 [2024-11-26 23:15:52.250825] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2258210, cid 5, qid 0 00:23:25.896 [2024-11-26 23:15:52.250981] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.896 [2024-11-26 23:15:52.250995] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.896 [2024-11-26 23:15:52.251002] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.896 [2024-11-26 23:15:52.251008] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=1024, cccid=4 00:23:25.897 [2024-11-26 23:15:52.251016] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22580b0) on tqpair(0x21d7e10): expected_datao=0, payload_size=1024 00:23:25.897 [2024-11-26 23:15:52.251026] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.897 [2024-11-26 23:15:52.251033] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.897 [2024-11-26 23:15:52.251042] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.897 [2024-11-26 23:15:52.251051] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.897 [2024-11-26 23:15:52.251057] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.897 [2024-11-26 23:15:52.251063] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2258210) on tqpair=0x21d7e10 00:23:26.159 [2024-11-26 23:15:52.295544] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.159 [2024-11-26 23:15:52.295565] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.159 [2024-11-26 23:15:52.295588] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.159 [2024-11-26 23:15:52.295595] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:26.159 [2024-11-26 23:15:52.295615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.159 [2024-11-26 23:15:52.295624] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.295630] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:26.160 [2024-11-26 23:15:52.295642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.160 [2024-11-26 23:15:52.295674] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:26.160 [2024-11-26 23:15:52.295780] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.160 [2024-11-26 23:15:52.295793] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.160 [2024-11-26 23:15:52.295799] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.295806] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=3072, cccid=4 00:23:26.160 [2024-11-26 23:15:52.295813] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22580b0) on tqpair(0x21d7e10): expected_datao=0, payload_size=3072 00:23:26.160 [2024-11-26 23:15:52.295831] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.295840] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.295852] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.160 [2024-11-26 23:15:52.295861] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.160 [2024-11-26 23:15:52.295867] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.295874] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:26.160 [2024-11-26 23:15:52.295890] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.295902] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.295909] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:26.160 [2024-11-26 23:15:52.295920] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.160 [2024-11-26 23:15:52.295948] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:26.160 [2024-11-26 23:15:52.296041] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.160 [2024-11-26 23:15:52.296053] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.160 [2024-11-26 23:15:52.296059] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.296065] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=8, cccid=4 00:23:26.160 [2024-11-26 23:15:52.296072] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22580b0) on tqpair(0x21d7e10): expected_datao=0, payload_size=8 00:23:26.160 [2024-11-26 23:15:52.296083] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.296090] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.336612] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.160 [2024-11-26 23:15:52.336630] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.160 [2024-11-26 23:15:52.336638] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.336644] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:26.160 ===================================================== 00:23:26.160 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:26.160 ===================================================== 00:23:26.160 Controller Capabilities/Features 00:23:26.160 ================================ 00:23:26.160 Vendor ID: 0000 00:23:26.160 Subsystem Vendor ID: 0000 00:23:26.160 Serial Number: .................... 00:23:26.160 Model Number: ........................................ 00:23:26.160 Firmware Version: 24.01.1 00:23:26.160 Recommended Arb Burst: 0 00:23:26.160 IEEE OUI Identifier: 00 00 00 00:23:26.160 Multi-path I/O 00:23:26.160 May have multiple subsystem ports: No 00:23:26.160 May have multiple controllers: No 00:23:26.160 Associated with SR-IOV VF: No 00:23:26.160 Max Data Transfer Size: 131072 00:23:26.160 Max Number of Namespaces: 0 00:23:26.160 Max Number of I/O Queues: 1024 00:23:26.160 NVMe Specification Version (VS): 1.3 00:23:26.160 NVMe Specification Version (Identify): 1.3 00:23:26.160 Maximum Queue Entries: 128 00:23:26.160 Contiguous Queues Required: Yes 00:23:26.160 Arbitration Mechanisms Supported 00:23:26.160 Weighted Round Robin: Not Supported 00:23:26.160 Vendor Specific: Not Supported 00:23:26.160 Reset Timeout: 15000 ms 00:23:26.160 Doorbell Stride: 4 bytes 00:23:26.160 NVM Subsystem Reset: Not Supported 00:23:26.160 Command Sets Supported 00:23:26.160 NVM Command Set: Supported 00:23:26.160 Boot Partition: Not Supported 00:23:26.160 Memory Page Size Minimum: 4096 bytes 00:23:26.160 Memory Page Size Maximum: 4096 bytes 00:23:26.160 Persistent Memory Region: Not Supported 00:23:26.160 Optional Asynchronous Events Supported 00:23:26.160 Namespace Attribute Notices: Not Supported 00:23:26.160 Firmware Activation Notices: Not Supported 00:23:26.160 ANA Change Notices: Not Supported 00:23:26.160 PLE Aggregate Log Change Notices: Not Supported 00:23:26.160 LBA Status Info Alert Notices: Not Supported 00:23:26.160 EGE Aggregate Log Change Notices: Not Supported 00:23:26.160 Normal NVM Subsystem Shutdown event: Not Supported 00:23:26.160 Zone Descriptor Change Notices: Not Supported 00:23:26.160 Discovery Log Change Notices: Supported 00:23:26.160 Controller Attributes 00:23:26.160 128-bit Host Identifier: Not Supported 00:23:26.160 Non-Operational Permissive Mode: Not Supported 00:23:26.160 NVM Sets: Not Supported 00:23:26.160 Read Recovery Levels: Not Supported 00:23:26.160 Endurance Groups: Not Supported 00:23:26.160 Predictable Latency Mode: Not Supported 00:23:26.160 Traffic Based Keep ALive: Not Supported 00:23:26.160 Namespace Granularity: Not Supported 00:23:26.160 SQ Associations: Not Supported 00:23:26.160 UUID List: Not Supported 00:23:26.160 Multi-Domain Subsystem: Not Supported 00:23:26.160 Fixed Capacity Management: Not Supported 00:23:26.160 Variable Capacity Management: Not Supported 00:23:26.160 Delete Endurance Group: Not Supported 00:23:26.160 Delete NVM Set: Not Supported 00:23:26.160 Extended LBA Formats Supported: Not Supported 00:23:26.160 Flexible Data Placement Supported: Not Supported 00:23:26.160 00:23:26.160 Controller Memory Buffer Support 00:23:26.160 ================================ 00:23:26.160 Supported: No 00:23:26.160 00:23:26.160 Persistent Memory Region Support 00:23:26.160 ================================ 00:23:26.160 Supported: No 00:23:26.160 00:23:26.160 Admin Command Set Attributes 00:23:26.160 ============================ 00:23:26.160 Security Send/Receive: Not Supported 00:23:26.160 Format NVM: Not Supported 00:23:26.160 Firmware Activate/Download: Not Supported 00:23:26.160 Namespace Management: Not Supported 00:23:26.160 Device Self-Test: Not Supported 00:23:26.160 Directives: Not Supported 00:23:26.160 NVMe-MI: Not Supported 00:23:26.160 Virtualization Management: Not Supported 00:23:26.160 Doorbell Buffer Config: Not Supported 00:23:26.160 Get LBA Status Capability: Not Supported 00:23:26.160 Command & Feature Lockdown Capability: Not Supported 00:23:26.160 Abort Command Limit: 1 00:23:26.160 Async Event Request Limit: 4 00:23:26.160 Number of Firmware Slots: N/A 00:23:26.160 Firmware Slot 1 Read-Only: N/A 00:23:26.160 Firmware Activation Without Reset: N/A 00:23:26.160 Multiple Update Detection Support: N/A 00:23:26.160 Firmware Update Granularity: No Information Provided 00:23:26.160 Per-Namespace SMART Log: No 00:23:26.160 Asymmetric Namespace Access Log Page: Not Supported 00:23:26.160 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:26.160 Command Effects Log Page: Not Supported 00:23:26.160 Get Log Page Extended Data: Supported 00:23:26.160 Telemetry Log Pages: Not Supported 00:23:26.160 Persistent Event Log Pages: Not Supported 00:23:26.160 Supported Log Pages Log Page: May Support 00:23:26.160 Commands Supported & Effects Log Page: Not Supported 00:23:26.160 Feature Identifiers & Effects Log Page:May Support 00:23:26.160 NVMe-MI Commands & Effects Log Page: May Support 00:23:26.160 Data Area 4 for Telemetry Log: Not Supported 00:23:26.160 Error Log Page Entries Supported: 128 00:23:26.160 Keep Alive: Not Supported 00:23:26.160 00:23:26.160 NVM Command Set Attributes 00:23:26.160 ========================== 00:23:26.160 Submission Queue Entry Size 00:23:26.160 Max: 1 00:23:26.160 Min: 1 00:23:26.160 Completion Queue Entry Size 00:23:26.160 Max: 1 00:23:26.160 Min: 1 00:23:26.160 Number of Namespaces: 0 00:23:26.160 Compare Command: Not Supported 00:23:26.160 Write Uncorrectable Command: Not Supported 00:23:26.160 Dataset Management Command: Not Supported 00:23:26.160 Write Zeroes Command: Not Supported 00:23:26.160 Set Features Save Field: Not Supported 00:23:26.160 Reservations: Not Supported 00:23:26.160 Timestamp: Not Supported 00:23:26.160 Copy: Not Supported 00:23:26.160 Volatile Write Cache: Not Present 00:23:26.160 Atomic Write Unit (Normal): 1 00:23:26.160 Atomic Write Unit (PFail): 1 00:23:26.160 Atomic Compare & Write Unit: 1 00:23:26.160 Fused Compare & Write: Supported 00:23:26.160 Scatter-Gather List 00:23:26.160 SGL Command Set: Supported 00:23:26.160 SGL Keyed: Supported 00:23:26.160 SGL Bit Bucket Descriptor: Not Supported 00:23:26.160 SGL Metadata Pointer: Not Supported 00:23:26.160 Oversized SGL: Not Supported 00:23:26.160 SGL Metadata Address: Not Supported 00:23:26.160 SGL Offset: Supported 00:23:26.160 Transport SGL Data Block: Not Supported 00:23:26.160 Replay Protected Memory Block: Not Supported 00:23:26.160 00:23:26.160 Firmware Slot Information 00:23:26.160 ========================= 00:23:26.160 Active slot: 0 00:23:26.160 00:23:26.160 00:23:26.160 Error Log 00:23:26.160 ========= 00:23:26.160 00:23:26.160 Active Namespaces 00:23:26.160 ================= 00:23:26.160 Discovery Log Page 00:23:26.160 ================== 00:23:26.160 Generation Counter: 2 00:23:26.160 Number of Records: 2 00:23:26.160 Record Format: 0 00:23:26.160 00:23:26.160 Discovery Log Entry 0 00:23:26.160 ---------------------- 00:23:26.160 Transport Type: 3 (TCP) 00:23:26.160 Address Family: 1 (IPv4) 00:23:26.160 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:26.160 Entry Flags: 00:23:26.160 Duplicate Returned Information: 1 00:23:26.160 Explicit Persistent Connection Support for Discovery: 1 00:23:26.160 Transport Requirements: 00:23:26.160 Secure Channel: Not Required 00:23:26.160 Port ID: 0 (0x0000) 00:23:26.160 Controller ID: 65535 (0xffff) 00:23:26.160 Admin Max SQ Size: 128 00:23:26.160 Transport Service Identifier: 4420 00:23:26.160 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:26.160 Transport Address: 10.0.0.2 00:23:26.160 Discovery Log Entry 1 00:23:26.160 ---------------------- 00:23:26.160 Transport Type: 3 (TCP) 00:23:26.160 Address Family: 1 (IPv4) 00:23:26.160 Subsystem Type: 2 (NVM Subsystem) 00:23:26.160 Entry Flags: 00:23:26.160 Duplicate Returned Information: 0 00:23:26.160 Explicit Persistent Connection Support for Discovery: 0 00:23:26.160 Transport Requirements: 00:23:26.160 Secure Channel: Not Required 00:23:26.160 Port ID: 0 (0x0000) 00:23:26.160 Controller ID: 65535 (0xffff) 00:23:26.160 Admin Max SQ Size: 128 00:23:26.160 Transport Service Identifier: 4420 00:23:26.160 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:26.160 Transport Address: 10.0.0.2 [2024-11-26 23:15:52.336764] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:26.160 [2024-11-26 23:15:52.336790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:26.160 [2024-11-26 23:15:52.336802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:26.160 [2024-11-26 23:15:52.336811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:26.160 [2024-11-26 23:15:52.336820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:26.160 [2024-11-26 23:15:52.336842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.336850] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.160 [2024-11-26 23:15:52.336856] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.160 [2024-11-26 23:15:52.336867] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.160 [2024-11-26 23:15:52.336892] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.160 [2024-11-26 23:15:52.336964] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.336976] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.336982] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.336989] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.337001] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337008] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337015] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.337025] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.337051] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.337155] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.337167] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.337173] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337180] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.337190] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:26.161 [2024-11-26 23:15:52.337197] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:26.161 [2024-11-26 23:15:52.337213] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337221] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337227] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.337238] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.337258] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.337338] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.337352] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.337359] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337365] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.337383] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337391] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337398] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.337408] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.337428] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.337506] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.337519] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.337535] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337542] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.337560] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337569] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337575] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.337585] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.337606] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.337684] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.337698] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.337705] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337711] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.337728] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337737] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337743] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.337753] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.337779] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.337855] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.337868] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.337875] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337881] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.337898] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337907] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.337913] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.337923] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.337943] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.338028] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.338041] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.338048] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338054] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.338071] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338080] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338086] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.338096] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.338117] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.338190] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.338201] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.338208] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338214] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.338231] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338239] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338245] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.338256] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.338276] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.338346] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.338357] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.338364] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338370] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.338386] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338395] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.338401] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.338411] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.338435] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.338503] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.338514] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.338521] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.342541] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.342563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.342572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.342578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:26.161 [2024-11-26 23:15:52.342588] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.342609] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:26.161 [2024-11-26 23:15:52.342709] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.342722] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.342729] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.342735] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:26.161 [2024-11-26 23:15:52.342749] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:23:26.161 00:23:26.161 23:15:52 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:26.161 [2024-11-26 23:15:52.368255] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:26.161 [2024-11-26 23:15:52.368295] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid282150 ] 00:23:26.161 EAL: No free 2048 kB hugepages reported on node 1 00:23:26.161 [2024-11-26 23:15:52.399248] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:26.161 [2024-11-26 23:15:52.399294] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:26.161 [2024-11-26 23:15:52.399310] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:26.161 [2024-11-26 23:15:52.399324] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:26.161 [2024-11-26 23:15:52.399335] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:26.161 [2024-11-26 23:15:52.402566] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:26.161 [2024-11-26 23:15:52.402622] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x17ffe10 0 00:23:26.161 [2024-11-26 23:15:52.409538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:26.161 [2024-11-26 23:15:52.409558] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:26.161 [2024-11-26 23:15:52.409566] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:26.161 [2024-11-26 23:15:52.409571] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:26.161 [2024-11-26 23:15:52.409623] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.409635] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.409646] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.161 [2024-11-26 23:15:52.409660] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:26.161 [2024-11-26 23:15:52.409687] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.161 [2024-11-26 23:15:52.417542] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.417560] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.417568] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.417575] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.161 [2024-11-26 23:15:52.417589] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:26.161 [2024-11-26 23:15:52.417613] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:26.161 [2024-11-26 23:15:52.417623] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:26.161 [2024-11-26 23:15:52.417640] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.417649] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.417655] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.161 [2024-11-26 23:15:52.417667] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.417691] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.161 [2024-11-26 23:15:52.417815] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.417828] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.417834] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.417841] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.161 [2024-11-26 23:15:52.417850] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:26.161 [2024-11-26 23:15:52.417862] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:26.161 [2024-11-26 23:15:52.417874] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.417882] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.417888] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.161 [2024-11-26 23:15:52.417899] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.417920] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.161 [2024-11-26 23:15:52.417997] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.161 [2024-11-26 23:15:52.418011] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.161 [2024-11-26 23:15:52.418018] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.418025] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.161 [2024-11-26 23:15:52.418034] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:26.161 [2024-11-26 23:15:52.418047] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:26.161 [2024-11-26 23:15:52.418060] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.418067] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.161 [2024-11-26 23:15:52.418073] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.161 [2024-11-26 23:15:52.418088] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.161 [2024-11-26 23:15:52.418110] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.161 [2024-11-26 23:15:52.418183] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.418196] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.418202] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418209] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.418218] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:26.162 [2024-11-26 23:15:52.418234] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418243] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418249] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.418259] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.162 [2024-11-26 23:15:52.418280] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.162 [2024-11-26 23:15:52.418350] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.418364] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.418370] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418377] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.418386] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:26.162 [2024-11-26 23:15:52.418394] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:26.162 [2024-11-26 23:15:52.418406] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:26.162 [2024-11-26 23:15:52.418516] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:26.162 [2024-11-26 23:15:52.418522] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:26.162 [2024-11-26 23:15:52.418544] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418552] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418558] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.418569] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.162 [2024-11-26 23:15:52.418591] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.162 [2024-11-26 23:15:52.418695] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.418707] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.418714] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418721] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.418730] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:26.162 [2024-11-26 23:15:52.418745] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418754] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418764] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.418776] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.162 [2024-11-26 23:15:52.418797] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.162 [2024-11-26 23:15:52.418883] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.418896] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.418903] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418910] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.418918] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:26.162 [2024-11-26 23:15:52.418926] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.418939] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:26.162 [2024-11-26 23:15:52.418953] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.418967] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418974] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.418981] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.418991] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.162 [2024-11-26 23:15:52.419012] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.162 [2024-11-26 23:15:52.419141] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.162 [2024-11-26 23:15:52.419156] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.162 [2024-11-26 23:15:52.419163] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.419169] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17ffe10): datao=0, datal=4096, cccid=0 00:23:26.162 [2024-11-26 23:15:52.419177] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x187fb30) on tqpair(0x17ffe10): expected_datao=0, payload_size=4096 00:23:26.162 [2024-11-26 23:15:52.419195] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.419204] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459632] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.459649] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.459657] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459664] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.459676] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:26.162 [2024-11-26 23:15:52.459685] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:26.162 [2024-11-26 23:15:52.459692] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:26.162 [2024-11-26 23:15:52.459698] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:26.162 [2024-11-26 23:15:52.459706] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:26.162 [2024-11-26 23:15:52.459714] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.459736] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.459750] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459758] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459764] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.459776] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:26.162 [2024-11-26 23:15:52.459799] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.162 [2024-11-26 23:15:52.459878] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.459890] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.459897] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459904] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187fb30) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.459915] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459922] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459929] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.459938] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:26.162 [2024-11-26 23:15:52.459949] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459956] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459962] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.459971] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:26.162 [2024-11-26 23:15:52.459981] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459988] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.459994] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.460003] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:26.162 [2024-11-26 23:15:52.460013] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460020] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.460035] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:26.162 [2024-11-26 23:15:52.460044] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.460062] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.460075] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460097] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460103] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.460114] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.162 [2024-11-26 23:15:52.460136] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fb30, cid 0, qid 0 00:23:26.162 [2024-11-26 23:15:52.460161] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fc90, cid 1, qid 0 00:23:26.162 [2024-11-26 23:15:52.460173] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187fdf0, cid 2, qid 0 00:23:26.162 [2024-11-26 23:15:52.460181] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.162 [2024-11-26 23:15:52.460189] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18800b0, cid 4, qid 0 00:23:26.162 [2024-11-26 23:15:52.460320] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.460334] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.460341] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460347] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18800b0) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.460356] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:26.162 [2024-11-26 23:15:52.460365] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.460378] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.460394] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.460406] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460413] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460419] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.460430] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:26.162 [2024-11-26 23:15:52.460451] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18800b0, cid 4, qid 0 00:23:26.162 [2024-11-26 23:15:52.460633] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.460648] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.460655] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460661] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18800b0) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.460727] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.460746] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.460760] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460768] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460774] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.460785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.162 [2024-11-26 23:15:52.460806] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18800b0, cid 4, qid 0 00:23:26.162 [2024-11-26 23:15:52.460908] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.162 [2024-11-26 23:15:52.460920] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.162 [2024-11-26 23:15:52.460926] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460933] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17ffe10): datao=0, datal=4096, cccid=4 00:23:26.162 [2024-11-26 23:15:52.460940] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18800b0) on tqpair(0x17ffe10): expected_datao=0, payload_size=4096 00:23:26.162 [2024-11-26 23:15:52.460962] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.460972] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.503538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.162 [2024-11-26 23:15:52.503555] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.162 [2024-11-26 23:15:52.503562] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.503569] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18800b0) on tqpair=0x17ffe10 00:23:26.162 [2024-11-26 23:15:52.503591] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:26.162 [2024-11-26 23:15:52.503612] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.503630] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:26.162 [2024-11-26 23:15:52.503659] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.503666] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.503673] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17ffe10) 00:23:26.162 [2024-11-26 23:15:52.503684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.162 [2024-11-26 23:15:52.503708] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18800b0, cid 4, qid 0 00:23:26.162 [2024-11-26 23:15:52.503855] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.162 [2024-11-26 23:15:52.503870] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.162 [2024-11-26 23:15:52.503877] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.503883] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17ffe10): datao=0, datal=4096, cccid=4 00:23:26.162 [2024-11-26 23:15:52.503891] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18800b0) on tqpair(0x17ffe10): expected_datao=0, payload_size=4096 00:23:26.162 [2024-11-26 23:15:52.503908] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.503918] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.162 [2024-11-26 23:15:52.544634] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.163 [2024-11-26 23:15:52.544655] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.163 [2024-11-26 23:15:52.544664] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.163 [2024-11-26 23:15:52.544671] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18800b0) on tqpair=0x17ffe10 00:23:26.163 [2024-11-26 23:15:52.544699] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:26.163 [2024-11-26 23:15:52.544720] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:26.163 [2024-11-26 23:15:52.544735] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.163 [2024-11-26 23:15:52.544743] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.163 [2024-11-26 23:15:52.544749] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17ffe10) 00:23:26.163 [2024-11-26 23:15:52.544761] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.163 [2024-11-26 23:15:52.544786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18800b0, cid 4, qid 0 00:23:26.163 [2024-11-26 23:15:52.544904] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.163 [2024-11-26 23:15:52.544917] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.163 [2024-11-26 23:15:52.544923] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.163 [2024-11-26 23:15:52.544934] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17ffe10): datao=0, datal=4096, cccid=4 00:23:26.163 [2024-11-26 23:15:52.544943] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18800b0) on tqpair(0x17ffe10): expected_datao=0, payload_size=4096 00:23:26.163 [2024-11-26 23:15:52.544961] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.163 [2024-11-26 23:15:52.544970] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.425 [2024-11-26 23:15:52.585635] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.425 [2024-11-26 23:15:52.585656] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.425 [2024-11-26 23:15:52.585664] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.425 [2024-11-26 23:15:52.585672] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18800b0) on tqpair=0x17ffe10 00:23:26.425 [2024-11-26 23:15:52.585688] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:26.425 [2024-11-26 23:15:52.585703] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:26.425 [2024-11-26 23:15:52.585720] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:26.425 [2024-11-26 23:15:52.585732] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:26.425 [2024-11-26 23:15:52.585741] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:26.425 [2024-11-26 23:15:52.585749] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:26.425 [2024-11-26 23:15:52.585757] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:26.425 [2024-11-26 23:15:52.585766] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:26.425 [2024-11-26 23:15:52.585785] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.425 [2024-11-26 23:15:52.585794] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.425 [2024-11-26 23:15:52.585801] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17ffe10) 00:23:26.425 [2024-11-26 23:15:52.585813] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.425 [2024-11-26 23:15:52.585825] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.425 [2024-11-26 23:15:52.585833] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.425 [2024-11-26 23:15:52.585839] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x17ffe10) 00:23:26.425 [2024-11-26 23:15:52.585849] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:26.425 [2024-11-26 23:15:52.585876] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18800b0, cid 4, qid 0 00:23:26.425 [2024-11-26 23:15:52.585888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1880210, cid 5, qid 0 00:23:26.425 [2024-11-26 23:15:52.585986] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.425 [2024-11-26 23:15:52.586000] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.425 [2024-11-26 23:15:52.586007] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.425 [2024-11-26 23:15:52.586014] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18800b0) on tqpair=0x17ffe10 00:23:26.425 [2024-11-26 23:15:52.586025] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.425 [2024-11-26 23:15:52.586034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.425 [2024-11-26 23:15:52.586040] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.425 [2024-11-26 23:15:52.586051] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1880210) on tqpair=0x17ffe10 00:23:26.426 [2024-11-26 23:15:52.586068] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586077] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586084] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x17ffe10) 00:23:26.426 [2024-11-26 23:15:52.586094] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.426 [2024-11-26 23:15:52.586116] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1880210, cid 5, qid 0 00:23:26.426 [2024-11-26 23:15:52.586198] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.426 [2024-11-26 23:15:52.586211] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.426 [2024-11-26 23:15:52.586217] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586224] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1880210) on tqpair=0x17ffe10 00:23:26.426 [2024-11-26 23:15:52.586240] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586249] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586255] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x17ffe10) 00:23:26.426 [2024-11-26 23:15:52.586266] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.426 [2024-11-26 23:15:52.586286] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1880210, cid 5, qid 0 00:23:26.426 [2024-11-26 23:15:52.586363] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.426 [2024-11-26 23:15:52.586377] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.426 [2024-11-26 23:15:52.586384] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586390] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1880210) on tqpair=0x17ffe10 00:23:26.426 [2024-11-26 23:15:52.586407] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586416] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586422] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x17ffe10) 00:23:26.426 [2024-11-26 23:15:52.586432] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.426 [2024-11-26 23:15:52.586454] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1880210, cid 5, qid 0 00:23:26.426 [2024-11-26 23:15:52.586537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.426 [2024-11-26 23:15:52.586551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.426 [2024-11-26 23:15:52.586558] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586565] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1880210) on tqpair=0x17ffe10 00:23:26.426 [2024-11-26 23:15:52.586585] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586595] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586602] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x17ffe10) 00:23:26.426 [2024-11-26 23:15:52.586612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.426 [2024-11-26 23:15:52.586625] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586632] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586639] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17ffe10) 00:23:26.426 [2024-11-26 23:15:52.586648] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.426 [2024-11-26 23:15:52.586665] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586673] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586680] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x17ffe10) 00:23:26.426 [2024-11-26 23:15:52.586689] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.426 [2024-11-26 23:15:52.586702] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586709] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586716] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x17ffe10) 00:23:26.426 [2024-11-26 23:15:52.586725] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.426 [2024-11-26 23:15:52.586748] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1880210, cid 5, qid 0 00:23:26.426 [2024-11-26 23:15:52.586759] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18800b0, cid 4, qid 0 00:23:26.426 [2024-11-26 23:15:52.586767] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1880370, cid 6, qid 0 00:23:26.426 [2024-11-26 23:15:52.586775] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18804d0, cid 7, qid 0 00:23:26.426 [2024-11-26 23:15:52.586955] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.426 [2024-11-26 23:15:52.586968] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.426 [2024-11-26 23:15:52.586975] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.586981] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17ffe10): datao=0, datal=8192, cccid=5 00:23:26.426 [2024-11-26 23:15:52.586989] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1880210) on tqpair(0x17ffe10): expected_datao=0, payload_size=8192 00:23:26.426 [2024-11-26 23:15:52.587007] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587017] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587029] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.426 [2024-11-26 23:15:52.587039] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.426 [2024-11-26 23:15:52.587046] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587052] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17ffe10): datao=0, datal=512, cccid=4 00:23:26.426 [2024-11-26 23:15:52.587059] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18800b0) on tqpair(0x17ffe10): expected_datao=0, payload_size=512 00:23:26.426 [2024-11-26 23:15:52.587069] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587076] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587085] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.426 [2024-11-26 23:15:52.587093] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.426 [2024-11-26 23:15:52.587100] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587106] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17ffe10): datao=0, datal=512, cccid=6 00:23:26.426 [2024-11-26 23:15:52.587113] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1880370) on tqpair(0x17ffe10): expected_datao=0, payload_size=512 00:23:26.426 [2024-11-26 23:15:52.587123] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587130] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587139] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:26.426 [2024-11-26 23:15:52.587147] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:26.426 [2024-11-26 23:15:52.587158] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587164] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17ffe10): datao=0, datal=4096, cccid=7 00:23:26.426 [2024-11-26 23:15:52.587172] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18804d0) on tqpair(0x17ffe10): expected_datao=0, payload_size=4096 00:23:26.426 [2024-11-26 23:15:52.587182] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587190] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587201] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.426 [2024-11-26 23:15:52.587211] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.426 [2024-11-26 23:15:52.587217] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587224] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1880210) on tqpair=0x17ffe10 00:23:26.426 [2024-11-26 23:15:52.587245] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.426 [2024-11-26 23:15:52.587256] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.426 [2024-11-26 23:15:52.587262] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587269] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18800b0) on tqpair=0x17ffe10 00:23:26.426 [2024-11-26 23:15:52.587284] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.426 [2024-11-26 23:15:52.587295] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.426 [2024-11-26 23:15:52.587316] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587322] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1880370) on tqpair=0x17ffe10 00:23:26.426 [2024-11-26 23:15:52.587334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.426 [2024-11-26 23:15:52.587343] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.426 [2024-11-26 23:15:52.587350] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.426 [2024-11-26 23:15:52.587356] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18804d0) on tqpair=0x17ffe10 00:23:26.426 ===================================================== 00:23:26.426 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:26.426 ===================================================== 00:23:26.426 Controller Capabilities/Features 00:23:26.426 ================================ 00:23:26.426 Vendor ID: 8086 00:23:26.426 Subsystem Vendor ID: 8086 00:23:26.426 Serial Number: SPDK00000000000001 00:23:26.426 Model Number: SPDK bdev Controller 00:23:26.427 Firmware Version: 24.01.1 00:23:26.427 Recommended Arb Burst: 6 00:23:26.427 IEEE OUI Identifier: e4 d2 5c 00:23:26.427 Multi-path I/O 00:23:26.427 May have multiple subsystem ports: Yes 00:23:26.427 May have multiple controllers: Yes 00:23:26.427 Associated with SR-IOV VF: No 00:23:26.427 Max Data Transfer Size: 131072 00:23:26.427 Max Number of Namespaces: 32 00:23:26.427 Max Number of I/O Queues: 127 00:23:26.427 NVMe Specification Version (VS): 1.3 00:23:26.427 NVMe Specification Version (Identify): 1.3 00:23:26.427 Maximum Queue Entries: 128 00:23:26.427 Contiguous Queues Required: Yes 00:23:26.427 Arbitration Mechanisms Supported 00:23:26.427 Weighted Round Robin: Not Supported 00:23:26.427 Vendor Specific: Not Supported 00:23:26.427 Reset Timeout: 15000 ms 00:23:26.427 Doorbell Stride: 4 bytes 00:23:26.427 NVM Subsystem Reset: Not Supported 00:23:26.427 Command Sets Supported 00:23:26.427 NVM Command Set: Supported 00:23:26.427 Boot Partition: Not Supported 00:23:26.427 Memory Page Size Minimum: 4096 bytes 00:23:26.427 Memory Page Size Maximum: 4096 bytes 00:23:26.427 Persistent Memory Region: Not Supported 00:23:26.427 Optional Asynchronous Events Supported 00:23:26.427 Namespace Attribute Notices: Supported 00:23:26.427 Firmware Activation Notices: Not Supported 00:23:26.427 ANA Change Notices: Not Supported 00:23:26.427 PLE Aggregate Log Change Notices: Not Supported 00:23:26.427 LBA Status Info Alert Notices: Not Supported 00:23:26.427 EGE Aggregate Log Change Notices: Not Supported 00:23:26.427 Normal NVM Subsystem Shutdown event: Not Supported 00:23:26.427 Zone Descriptor Change Notices: Not Supported 00:23:26.427 Discovery Log Change Notices: Not Supported 00:23:26.427 Controller Attributes 00:23:26.427 128-bit Host Identifier: Supported 00:23:26.427 Non-Operational Permissive Mode: Not Supported 00:23:26.427 NVM Sets: Not Supported 00:23:26.427 Read Recovery Levels: Not Supported 00:23:26.427 Endurance Groups: Not Supported 00:23:26.427 Predictable Latency Mode: Not Supported 00:23:26.427 Traffic Based Keep ALive: Not Supported 00:23:26.427 Namespace Granularity: Not Supported 00:23:26.427 SQ Associations: Not Supported 00:23:26.427 UUID List: Not Supported 00:23:26.427 Multi-Domain Subsystem: Not Supported 00:23:26.427 Fixed Capacity Management: Not Supported 00:23:26.427 Variable Capacity Management: Not Supported 00:23:26.427 Delete Endurance Group: Not Supported 00:23:26.427 Delete NVM Set: Not Supported 00:23:26.427 Extended LBA Formats Supported: Not Supported 00:23:26.427 Flexible Data Placement Supported: Not Supported 00:23:26.427 00:23:26.427 Controller Memory Buffer Support 00:23:26.427 ================================ 00:23:26.427 Supported: No 00:23:26.427 00:23:26.427 Persistent Memory Region Support 00:23:26.427 ================================ 00:23:26.427 Supported: No 00:23:26.427 00:23:26.427 Admin Command Set Attributes 00:23:26.427 ============================ 00:23:26.427 Security Send/Receive: Not Supported 00:23:26.427 Format NVM: Not Supported 00:23:26.427 Firmware Activate/Download: Not Supported 00:23:26.427 Namespace Management: Not Supported 00:23:26.427 Device Self-Test: Not Supported 00:23:26.427 Directives: Not Supported 00:23:26.427 NVMe-MI: Not Supported 00:23:26.427 Virtualization Management: Not Supported 00:23:26.427 Doorbell Buffer Config: Not Supported 00:23:26.427 Get LBA Status Capability: Not Supported 00:23:26.427 Command & Feature Lockdown Capability: Not Supported 00:23:26.427 Abort Command Limit: 4 00:23:26.427 Async Event Request Limit: 4 00:23:26.427 Number of Firmware Slots: N/A 00:23:26.427 Firmware Slot 1 Read-Only: N/A 00:23:26.427 Firmware Activation Without Reset: N/A 00:23:26.427 Multiple Update Detection Support: N/A 00:23:26.427 Firmware Update Granularity: No Information Provided 00:23:26.427 Per-Namespace SMART Log: No 00:23:26.427 Asymmetric Namespace Access Log Page: Not Supported 00:23:26.427 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:26.427 Command Effects Log Page: Supported 00:23:26.427 Get Log Page Extended Data: Supported 00:23:26.427 Telemetry Log Pages: Not Supported 00:23:26.427 Persistent Event Log Pages: Not Supported 00:23:26.427 Supported Log Pages Log Page: May Support 00:23:26.427 Commands Supported & Effects Log Page: Not Supported 00:23:26.427 Feature Identifiers & Effects Log Page:May Support 00:23:26.427 NVMe-MI Commands & Effects Log Page: May Support 00:23:26.427 Data Area 4 for Telemetry Log: Not Supported 00:23:26.427 Error Log Page Entries Supported: 128 00:23:26.427 Keep Alive: Supported 00:23:26.427 Keep Alive Granularity: 10000 ms 00:23:26.427 00:23:26.427 NVM Command Set Attributes 00:23:26.427 ========================== 00:23:26.427 Submission Queue Entry Size 00:23:26.427 Max: 64 00:23:26.427 Min: 64 00:23:26.427 Completion Queue Entry Size 00:23:26.427 Max: 16 00:23:26.427 Min: 16 00:23:26.427 Number of Namespaces: 32 00:23:26.427 Compare Command: Supported 00:23:26.427 Write Uncorrectable Command: Not Supported 00:23:26.427 Dataset Management Command: Supported 00:23:26.427 Write Zeroes Command: Supported 00:23:26.427 Set Features Save Field: Not Supported 00:23:26.427 Reservations: Supported 00:23:26.427 Timestamp: Not Supported 00:23:26.427 Copy: Supported 00:23:26.427 Volatile Write Cache: Present 00:23:26.427 Atomic Write Unit (Normal): 1 00:23:26.427 Atomic Write Unit (PFail): 1 00:23:26.427 Atomic Compare & Write Unit: 1 00:23:26.427 Fused Compare & Write: Supported 00:23:26.427 Scatter-Gather List 00:23:26.427 SGL Command Set: Supported 00:23:26.427 SGL Keyed: Supported 00:23:26.427 SGL Bit Bucket Descriptor: Not Supported 00:23:26.427 SGL Metadata Pointer: Not Supported 00:23:26.427 Oversized SGL: Not Supported 00:23:26.427 SGL Metadata Address: Not Supported 00:23:26.427 SGL Offset: Supported 00:23:26.427 Transport SGL Data Block: Not Supported 00:23:26.427 Replay Protected Memory Block: Not Supported 00:23:26.427 00:23:26.427 Firmware Slot Information 00:23:26.427 ========================= 00:23:26.427 Active slot: 1 00:23:26.427 Slot 1 Firmware Revision: 24.01.1 00:23:26.427 00:23:26.427 00:23:26.427 Commands Supported and Effects 00:23:26.427 ============================== 00:23:26.427 Admin Commands 00:23:26.427 -------------- 00:23:26.427 Get Log Page (02h): Supported 00:23:26.427 Identify (06h): Supported 00:23:26.427 Abort (08h): Supported 00:23:26.427 Set Features (09h): Supported 00:23:26.427 Get Features (0Ah): Supported 00:23:26.427 Asynchronous Event Request (0Ch): Supported 00:23:26.427 Keep Alive (18h): Supported 00:23:26.427 I/O Commands 00:23:26.427 ------------ 00:23:26.427 Flush (00h): Supported LBA-Change 00:23:26.428 Write (01h): Supported LBA-Change 00:23:26.428 Read (02h): Supported 00:23:26.428 Compare (05h): Supported 00:23:26.428 Write Zeroes (08h): Supported LBA-Change 00:23:26.428 Dataset Management (09h): Supported LBA-Change 00:23:26.428 Copy (19h): Supported LBA-Change 00:23:26.428 Unknown (79h): Supported LBA-Change 00:23:26.428 Unknown (7Ah): Supported 00:23:26.428 00:23:26.428 Error Log 00:23:26.428 ========= 00:23:26.428 00:23:26.428 Arbitration 00:23:26.428 =========== 00:23:26.428 Arbitration Burst: 1 00:23:26.428 00:23:26.428 Power Management 00:23:26.428 ================ 00:23:26.428 Number of Power States: 1 00:23:26.428 Current Power State: Power State #0 00:23:26.428 Power State #0: 00:23:26.428 Max Power: 0.00 W 00:23:26.428 Non-Operational State: Operational 00:23:26.428 Entry Latency: Not Reported 00:23:26.428 Exit Latency: Not Reported 00:23:26.428 Relative Read Throughput: 0 00:23:26.428 Relative Read Latency: 0 00:23:26.428 Relative Write Throughput: 0 00:23:26.428 Relative Write Latency: 0 00:23:26.428 Idle Power: Not Reported 00:23:26.428 Active Power: Not Reported 00:23:26.428 Non-Operational Permissive Mode: Not Supported 00:23:26.428 00:23:26.428 Health Information 00:23:26.428 ================== 00:23:26.428 Critical Warnings: 00:23:26.428 Available Spare Space: OK 00:23:26.428 Temperature: OK 00:23:26.428 Device Reliability: OK 00:23:26.428 Read Only: No 00:23:26.428 Volatile Memory Backup: OK 00:23:26.428 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:26.428 Temperature Threshold: [2024-11-26 23:15:52.587503] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.591540] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.591549] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x17ffe10) 00:23:26.428 [2024-11-26 23:15:52.591560] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.428 [2024-11-26 23:15:52.591584] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18804d0, cid 7, qid 0 00:23:26.428 [2024-11-26 23:15:52.591714] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.428 [2024-11-26 23:15:52.591727] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.428 [2024-11-26 23:15:52.591734] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.591741] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18804d0) on tqpair=0x17ffe10 00:23:26.428 [2024-11-26 23:15:52.591782] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:26.428 [2024-11-26 23:15:52.591803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:26.428 [2024-11-26 23:15:52.591815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:26.428 [2024-11-26 23:15:52.591825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:26.428 [2024-11-26 23:15:52.591834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:26.428 [2024-11-26 23:15:52.591851] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.591859] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.591866] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.428 [2024-11-26 23:15:52.591877] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.428 [2024-11-26 23:15:52.591914] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.428 [2024-11-26 23:15:52.592075] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.428 [2024-11-26 23:15:52.592090] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.428 [2024-11-26 23:15:52.592097] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592103] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.428 [2024-11-26 23:15:52.592115] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592123] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592129] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.428 [2024-11-26 23:15:52.592140] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.428 [2024-11-26 23:15:52.592166] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.428 [2024-11-26 23:15:52.592251] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.428 [2024-11-26 23:15:52.592263] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.428 [2024-11-26 23:15:52.592269] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592276] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.428 [2024-11-26 23:15:52.592285] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:26.428 [2024-11-26 23:15:52.592292] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:26.428 [2024-11-26 23:15:52.592307] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592316] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592323] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.428 [2024-11-26 23:15:52.592333] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.428 [2024-11-26 23:15:52.592354] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.428 [2024-11-26 23:15:52.592430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.428 [2024-11-26 23:15:52.592444] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.428 [2024-11-26 23:15:52.592451] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592457] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.428 [2024-11-26 23:15:52.592475] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592490] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.428 [2024-11-26 23:15:52.592501] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.428 [2024-11-26 23:15:52.592521] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.428 [2024-11-26 23:15:52.592602] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.428 [2024-11-26 23:15:52.592616] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.428 [2024-11-26 23:15:52.592623] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592634] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.428 [2024-11-26 23:15:52.592652] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592661] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592668] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.428 [2024-11-26 23:15:52.592678] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.428 [2024-11-26 23:15:52.592699] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.428 [2024-11-26 23:15:52.592774] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.428 [2024-11-26 23:15:52.592788] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.428 [2024-11-26 23:15:52.592795] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592802] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.428 [2024-11-26 23:15:52.592819] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592828] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592834] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.428 [2024-11-26 23:15:52.592845] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.428 [2024-11-26 23:15:52.592866] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.428 [2024-11-26 23:15:52.592940] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.428 [2024-11-26 23:15:52.592954] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.428 [2024-11-26 23:15:52.592961] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592968] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.428 [2024-11-26 23:15:52.592985] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.592994] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.593000] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.428 [2024-11-26 23:15:52.593011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.428 [2024-11-26 23:15:52.593031] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.428 [2024-11-26 23:15:52.593105] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.428 [2024-11-26 23:15:52.593117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.428 [2024-11-26 23:15:52.593124] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.593131] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.428 [2024-11-26 23:15:52.593147] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.593156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.428 [2024-11-26 23:15:52.593163] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.593173] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.593193] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.593266] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.593278] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.593285] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593292] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.593313] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593322] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593329] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.593339] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.593361] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.593436] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.593450] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.593457] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593463] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.593481] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593489] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593496] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.593506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.593534] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.593609] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.593623] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.593630] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593636] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.593653] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593663] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593669] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.593679] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.593700] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.593776] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.593790] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.593796] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593803] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.593820] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593829] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593835] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.593846] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.593866] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.593940] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.593952] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.593959] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593965] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.593986] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.593995] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594002] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.594012] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.594033] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.594105] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.594119] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.594126] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594132] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.594149] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594158] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594165] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.594175] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.594196] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.594271] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.594285] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.594292] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594299] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.594316] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594325] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594331] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.594342] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.594362] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.594438] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.594450] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.594457] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594463] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.594480] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594489] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594495] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.594506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.594536] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.429 [2024-11-26 23:15:52.594608] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.429 [2024-11-26 23:15:52.594622] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.429 [2024-11-26 23:15:52.594628] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594635] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.429 [2024-11-26 23:15:52.594652] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594665] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.429 [2024-11-26 23:15:52.594672] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.429 [2024-11-26 23:15:52.594683] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.429 [2024-11-26 23:15:52.594704] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.430 [2024-11-26 23:15:52.594779] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.430 [2024-11-26 23:15:52.594793] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.430 [2024-11-26 23:15:52.594800] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.594806] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.430 [2024-11-26 23:15:52.594823] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.594832] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.594838] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.430 [2024-11-26 23:15:52.594848] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.430 [2024-11-26 23:15:52.594869] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.430 [2024-11-26 23:15:52.594936] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.430 [2024-11-26 23:15:52.594948] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.430 [2024-11-26 23:15:52.594955] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.594961] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.430 [2024-11-26 23:15:52.594978] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.594987] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.594994] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.430 [2024-11-26 23:15:52.595004] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.430 [2024-11-26 23:15:52.595024] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.430 [2024-11-26 23:15:52.595095] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.430 [2024-11-26 23:15:52.595107] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.430 [2024-11-26 23:15:52.595113] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595120] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.430 [2024-11-26 23:15:52.595137] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595146] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595152] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.430 [2024-11-26 23:15:52.595163] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.430 [2024-11-26 23:15:52.595183] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.430 [2024-11-26 23:15:52.595256] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.430 [2024-11-26 23:15:52.595267] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.430 [2024-11-26 23:15:52.595274] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595281] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.430 [2024-11-26 23:15:52.595297] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595306] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595317] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.430 [2024-11-26 23:15:52.595328] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.430 [2024-11-26 23:15:52.595349] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.430 [2024-11-26 23:15:52.595417] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.430 [2024-11-26 23:15:52.595429] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.430 [2024-11-26 23:15:52.595435] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595442] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.430 [2024-11-26 23:15:52.595458] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595467] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.595474] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.430 [2024-11-26 23:15:52.595484] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.430 [2024-11-26 23:15:52.595504] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.430 [2024-11-26 23:15:52.599538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.430 [2024-11-26 23:15:52.599555] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.430 [2024-11-26 23:15:52.599562] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.599569] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.430 [2024-11-26 23:15:52.599587] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.599596] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.599603] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17ffe10) 00:23:26.430 [2024-11-26 23:15:52.599613] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:26.430 [2024-11-26 23:15:52.599636] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x187ff50, cid 3, qid 0 00:23:26.430 [2024-11-26 23:15:52.599745] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:26.430 [2024-11-26 23:15:52.599759] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:26.430 [2024-11-26 23:15:52.599765] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:26.430 [2024-11-26 23:15:52.599772] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x187ff50) on tqpair=0x17ffe10 00:23:26.430 [2024-11-26 23:15:52.599785] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:23:26.430 0 Kelvin (-273 Celsius) 00:23:26.430 Available Spare: 0% 00:23:26.430 Available Spare Threshold: 0% 00:23:26.430 Life Percentage Used: 0% 00:23:26.430 Data Units Read: 0 00:23:26.430 Data Units Written: 0 00:23:26.430 Host Read Commands: 0 00:23:26.430 Host Write Commands: 0 00:23:26.430 Controller Busy Time: 0 minutes 00:23:26.430 Power Cycles: 0 00:23:26.430 Power On Hours: 0 hours 00:23:26.430 Unsafe Shutdowns: 0 00:23:26.430 Unrecoverable Media Errors: 0 00:23:26.430 Lifetime Error Log Entries: 0 00:23:26.430 Warning Temperature Time: 0 minutes 00:23:26.430 Critical Temperature Time: 0 minutes 00:23:26.430 00:23:26.430 Number of Queues 00:23:26.430 ================ 00:23:26.430 Number of I/O Submission Queues: 127 00:23:26.430 Number of I/O Completion Queues: 127 00:23:26.430 00:23:26.430 Active Namespaces 00:23:26.430 ================= 00:23:26.430 Namespace ID:1 00:23:26.430 Error Recovery Timeout: Unlimited 00:23:26.430 Command Set Identifier: NVM (00h) 00:23:26.430 Deallocate: Supported 00:23:26.430 Deallocated/Unwritten Error: Not Supported 00:23:26.430 Deallocated Read Value: Unknown 00:23:26.430 Deallocate in Write Zeroes: Not Supported 00:23:26.430 Deallocated Guard Field: 0xFFFF 00:23:26.430 Flush: Supported 00:23:26.430 Reservation: Supported 00:23:26.430 Namespace Sharing Capabilities: Multiple Controllers 00:23:26.430 Size (in LBAs): 131072 (0GiB) 00:23:26.430 Capacity (in LBAs): 131072 (0GiB) 00:23:26.430 Utilization (in LBAs): 131072 (0GiB) 00:23:26.430 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:26.430 EUI64: ABCDEF0123456789 00:23:26.430 UUID: fd6eadeb-02a5-45f9-9449-783bdfaa2c8b 00:23:26.430 Thin Provisioning: Not Supported 00:23:26.430 Per-NS Atomic Units: Yes 00:23:26.430 Atomic Boundary Size (Normal): 0 00:23:26.430 Atomic Boundary Size (PFail): 0 00:23:26.430 Atomic Boundary Offset: 0 00:23:26.430 Maximum Single Source Range Length: 65535 00:23:26.430 Maximum Copy Length: 65535 00:23:26.430 Maximum Source Range Count: 1 00:23:26.431 NGUID/EUI64 Never Reused: No 00:23:26.431 Namespace Write Protected: No 00:23:26.431 Number of LBA Formats: 1 00:23:26.431 Current LBA Format: LBA Format #00 00:23:26.431 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:26.431 00:23:26.431 23:15:52 -- host/identify.sh@51 -- # sync 00:23:26.431 23:15:52 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:26.431 23:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:26.431 23:15:52 -- common/autotest_common.sh@10 -- # set +x 00:23:26.431 23:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:26.431 23:15:52 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:26.431 23:15:52 -- host/identify.sh@56 -- # nvmftestfini 00:23:26.431 23:15:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:26.431 23:15:52 -- nvmf/common.sh@116 -- # sync 00:23:26.431 23:15:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:26.431 23:15:52 -- nvmf/common.sh@119 -- # set +e 00:23:26.431 23:15:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:26.431 23:15:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:26.431 rmmod nvme_tcp 00:23:26.431 rmmod nvme_fabrics 00:23:26.431 rmmod nvme_keyring 00:23:26.431 23:15:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:26.431 23:15:52 -- nvmf/common.sh@123 -- # set -e 00:23:26.431 23:15:52 -- nvmf/common.sh@124 -- # return 0 00:23:26.431 23:15:52 -- nvmf/common.sh@477 -- # '[' -n 281977 ']' 00:23:26.431 23:15:52 -- nvmf/common.sh@478 -- # killprocess 281977 00:23:26.431 23:15:52 -- common/autotest_common.sh@936 -- # '[' -z 281977 ']' 00:23:26.431 23:15:52 -- common/autotest_common.sh@940 -- # kill -0 281977 00:23:26.431 23:15:52 -- common/autotest_common.sh@941 -- # uname 00:23:26.431 23:15:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:26.431 23:15:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 281977 00:23:26.431 23:15:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:26.431 23:15:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:26.431 23:15:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 281977' 00:23:26.431 killing process with pid 281977 00:23:26.431 23:15:52 -- common/autotest_common.sh@955 -- # kill 281977 00:23:26.431 [2024-11-26 23:15:52.712606] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:26.431 23:15:52 -- common/autotest_common.sh@960 -- # wait 281977 00:23:26.689 23:15:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:26.689 23:15:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:26.689 23:15:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:26.689 23:15:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:26.689 23:15:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:26.689 23:15:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:26.689 23:15:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:26.689 23:15:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:29.221 23:15:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:29.221 00:23:29.221 real 0m6.248s 00:23:29.221 user 0m7.918s 00:23:29.221 sys 0m1.898s 00:23:29.221 23:15:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:29.221 23:15:55 -- common/autotest_common.sh@10 -- # set +x 00:23:29.221 ************************************ 00:23:29.221 END TEST nvmf_identify 00:23:29.221 ************************************ 00:23:29.221 23:15:55 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:29.221 23:15:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:29.221 23:15:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:29.221 23:15:55 -- common/autotest_common.sh@10 -- # set +x 00:23:29.221 ************************************ 00:23:29.221 START TEST nvmf_perf 00:23:29.221 ************************************ 00:23:29.221 23:15:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:29.221 * Looking for test storage... 00:23:29.221 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:29.221 23:15:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:29.221 23:15:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:29.221 23:15:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:29.221 23:15:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:29.221 23:15:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:29.221 23:15:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:29.221 23:15:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:29.221 23:15:55 -- scripts/common.sh@335 -- # IFS=.-: 00:23:29.221 23:15:55 -- scripts/common.sh@335 -- # read -ra ver1 00:23:29.221 23:15:55 -- scripts/common.sh@336 -- # IFS=.-: 00:23:29.221 23:15:55 -- scripts/common.sh@336 -- # read -ra ver2 00:23:29.221 23:15:55 -- scripts/common.sh@337 -- # local 'op=<' 00:23:29.221 23:15:55 -- scripts/common.sh@339 -- # ver1_l=2 00:23:29.221 23:15:55 -- scripts/common.sh@340 -- # ver2_l=1 00:23:29.221 23:15:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:29.221 23:15:55 -- scripts/common.sh@343 -- # case "$op" in 00:23:29.221 23:15:55 -- scripts/common.sh@344 -- # : 1 00:23:29.221 23:15:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:29.221 23:15:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:29.221 23:15:55 -- scripts/common.sh@364 -- # decimal 1 00:23:29.221 23:15:55 -- scripts/common.sh@352 -- # local d=1 00:23:29.221 23:15:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:29.221 23:15:55 -- scripts/common.sh@354 -- # echo 1 00:23:29.221 23:15:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:29.221 23:15:55 -- scripts/common.sh@365 -- # decimal 2 00:23:29.221 23:15:55 -- scripts/common.sh@352 -- # local d=2 00:23:29.221 23:15:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:29.221 23:15:55 -- scripts/common.sh@354 -- # echo 2 00:23:29.221 23:15:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:29.221 23:15:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:29.221 23:15:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:29.221 23:15:55 -- scripts/common.sh@367 -- # return 0 00:23:29.221 23:15:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:29.221 23:15:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:29.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.221 --rc genhtml_branch_coverage=1 00:23:29.221 --rc genhtml_function_coverage=1 00:23:29.221 --rc genhtml_legend=1 00:23:29.221 --rc geninfo_all_blocks=1 00:23:29.221 --rc geninfo_unexecuted_blocks=1 00:23:29.221 00:23:29.221 ' 00:23:29.221 23:15:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:29.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.221 --rc genhtml_branch_coverage=1 00:23:29.221 --rc genhtml_function_coverage=1 00:23:29.221 --rc genhtml_legend=1 00:23:29.221 --rc geninfo_all_blocks=1 00:23:29.221 --rc geninfo_unexecuted_blocks=1 00:23:29.221 00:23:29.221 ' 00:23:29.221 23:15:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:29.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.221 --rc genhtml_branch_coverage=1 00:23:29.221 --rc genhtml_function_coverage=1 00:23:29.221 --rc genhtml_legend=1 00:23:29.221 --rc geninfo_all_blocks=1 00:23:29.221 --rc geninfo_unexecuted_blocks=1 00:23:29.221 00:23:29.221 ' 00:23:29.221 23:15:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:29.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.221 --rc genhtml_branch_coverage=1 00:23:29.221 --rc genhtml_function_coverage=1 00:23:29.221 --rc genhtml_legend=1 00:23:29.221 --rc geninfo_all_blocks=1 00:23:29.221 --rc geninfo_unexecuted_blocks=1 00:23:29.221 00:23:29.221 ' 00:23:29.221 23:15:55 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:29.221 23:15:55 -- nvmf/common.sh@7 -- # uname -s 00:23:29.221 23:15:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:29.221 23:15:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:29.221 23:15:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:29.221 23:15:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:29.222 23:15:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:29.222 23:15:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:29.222 23:15:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:29.222 23:15:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:29.222 23:15:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:29.222 23:15:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:29.222 23:15:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:29.222 23:15:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:29.222 23:15:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:29.222 23:15:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:29.222 23:15:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:29.222 23:15:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:29.222 23:15:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:29.222 23:15:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:29.222 23:15:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:29.222 23:15:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:29.222 23:15:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:29.222 23:15:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:29.222 23:15:55 -- paths/export.sh@5 -- # export PATH 00:23:29.222 23:15:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:29.222 23:15:55 -- nvmf/common.sh@46 -- # : 0 00:23:29.222 23:15:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:29.222 23:15:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:29.222 23:15:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:29.222 23:15:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:29.222 23:15:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:29.222 23:15:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:29.222 23:15:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:29.222 23:15:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:29.222 23:15:55 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:29.222 23:15:55 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:29.222 23:15:55 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:29.222 23:15:55 -- host/perf.sh@17 -- # nvmftestinit 00:23:29.222 23:15:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:29.222 23:15:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:29.222 23:15:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:29.222 23:15:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:29.222 23:15:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:29.222 23:15:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:29.222 23:15:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:29.222 23:15:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:29.222 23:15:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:29.222 23:15:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:29.222 23:15:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:29.222 23:15:55 -- common/autotest_common.sh@10 -- # set +x 00:23:31.124 23:15:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:31.124 23:15:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:31.124 23:15:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:31.124 23:15:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:31.124 23:15:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:31.124 23:15:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:31.124 23:15:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:31.124 23:15:57 -- nvmf/common.sh@294 -- # net_devs=() 00:23:31.124 23:15:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:31.124 23:15:57 -- nvmf/common.sh@295 -- # e810=() 00:23:31.124 23:15:57 -- nvmf/common.sh@295 -- # local -ga e810 00:23:31.124 23:15:57 -- nvmf/common.sh@296 -- # x722=() 00:23:31.124 23:15:57 -- nvmf/common.sh@296 -- # local -ga x722 00:23:31.124 23:15:57 -- nvmf/common.sh@297 -- # mlx=() 00:23:31.124 23:15:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:31.124 23:15:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:31.124 23:15:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:31.124 23:15:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:31.124 23:15:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:31.124 23:15:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:31.124 23:15:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:31.124 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:31.124 23:15:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:31.124 23:15:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:31.124 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:31.124 23:15:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:31.124 23:15:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:31.124 23:15:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:31.124 23:15:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:31.124 23:15:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:31.124 23:15:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:31.124 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:31.124 23:15:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:31.124 23:15:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:31.124 23:15:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:31.124 23:15:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:31.124 23:15:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:31.124 23:15:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:31.124 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:31.124 23:15:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:31.124 23:15:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:31.124 23:15:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:31.124 23:15:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:31.124 23:15:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:31.124 23:15:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:31.124 23:15:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:31.124 23:15:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:31.124 23:15:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:31.124 23:15:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:31.124 23:15:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:31.124 23:15:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:31.124 23:15:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:31.124 23:15:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:31.124 23:15:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:31.124 23:15:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:31.124 23:15:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:31.124 23:15:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:31.124 23:15:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:31.124 23:15:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:31.124 23:15:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:31.124 23:15:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:31.124 23:15:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:31.124 23:15:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:31.124 23:15:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:31.124 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:31.124 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:23:31.124 00:23:31.124 --- 10.0.0.2 ping statistics --- 00:23:31.124 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:31.124 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:23:31.124 23:15:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:31.124 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:31.124 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.042 ms 00:23:31.124 00:23:31.124 --- 10.0.0.1 ping statistics --- 00:23:31.124 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:31.125 rtt min/avg/max/mdev = 0.042/0.042/0.042/0.000 ms 00:23:31.125 23:15:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:31.125 23:15:57 -- nvmf/common.sh@410 -- # return 0 00:23:31.125 23:15:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:31.125 23:15:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:31.125 23:15:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:31.125 23:15:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:31.125 23:15:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:31.125 23:15:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:31.125 23:15:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:31.125 23:15:57 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:31.125 23:15:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:31.125 23:15:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:31.125 23:15:57 -- common/autotest_common.sh@10 -- # set +x 00:23:31.125 23:15:57 -- nvmf/common.sh@469 -- # nvmfpid=284099 00:23:31.125 23:15:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:31.125 23:15:57 -- nvmf/common.sh@470 -- # waitforlisten 284099 00:23:31.125 23:15:57 -- common/autotest_common.sh@829 -- # '[' -z 284099 ']' 00:23:31.125 23:15:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:31.125 23:15:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:31.125 23:15:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:31.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:31.125 23:15:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:31.125 23:15:57 -- common/autotest_common.sh@10 -- # set +x 00:23:31.125 [2024-11-26 23:15:57.400228] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:31.125 [2024-11-26 23:15:57.400301] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:31.125 EAL: No free 2048 kB hugepages reported on node 1 00:23:31.125 [2024-11-26 23:15:57.474733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:31.383 [2024-11-26 23:15:57.593730] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:31.383 [2024-11-26 23:15:57.593906] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:31.383 [2024-11-26 23:15:57.593925] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:31.383 [2024-11-26 23:15:57.593939] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:31.383 [2024-11-26 23:15:57.594011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:31.383 [2024-11-26 23:15:57.594078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:31.383 [2024-11-26 23:15:57.594170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:31.383 [2024-11-26 23:15:57.594173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:32.314 23:15:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:32.314 23:15:58 -- common/autotest_common.sh@862 -- # return 0 00:23:32.314 23:15:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:32.314 23:15:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:32.314 23:15:58 -- common/autotest_common.sh@10 -- # set +x 00:23:32.314 23:15:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:32.314 23:15:58 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:32.314 23:15:58 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:35.595 23:16:01 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:35.595 23:16:01 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:35.595 23:16:01 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:35.595 23:16:01 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:35.855 23:16:02 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:35.855 23:16:02 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:35.855 23:16:02 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:35.855 23:16:02 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:35.855 23:16:02 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:36.112 [2024-11-26 23:16:02.409872] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:36.112 23:16:02 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:36.370 23:16:02 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:36.370 23:16:02 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:36.628 23:16:02 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:36.628 23:16:02 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:36.887 23:16:03 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:37.145 [2024-11-26 23:16:03.433755] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:37.145 23:16:03 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:37.403 23:16:03 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:37.403 23:16:03 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:37.403 23:16:03 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:37.403 23:16:03 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:38.778 Initializing NVMe Controllers 00:23:38.778 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:38.778 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:38.778 Initialization complete. Launching workers. 00:23:38.778 ======================================================== 00:23:38.778 Latency(us) 00:23:38.778 Device Information : IOPS MiB/s Average min max 00:23:38.778 PCIE (0000:88:00.0) NSID 1 from core 0: 85936.20 335.69 371.90 26.80 8246.34 00:23:38.778 ======================================================== 00:23:38.778 Total : 85936.20 335.69 371.90 26.80 8246.34 00:23:38.778 00:23:38.778 23:16:04 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:38.778 EAL: No free 2048 kB hugepages reported on node 1 00:23:40.151 Initializing NVMe Controllers 00:23:40.151 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:40.151 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:40.151 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:40.151 Initialization complete. Launching workers. 00:23:40.151 ======================================================== 00:23:40.151 Latency(us) 00:23:40.151 Device Information : IOPS MiB/s Average min max 00:23:40.151 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 91.00 0.36 11258.75 134.04 45787.07 00:23:40.151 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 57.00 0.22 17814.81 5716.61 50878.84 00:23:40.151 ======================================================== 00:23:40.151 Total : 148.00 0.58 13783.72 134.04 50878.84 00:23:40.151 00:23:40.151 23:16:06 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:40.151 EAL: No free 2048 kB hugepages reported on node 1 00:23:41.526 Initializing NVMe Controllers 00:23:41.526 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.526 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:41.526 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:41.526 Initialization complete. Launching workers. 00:23:41.526 ======================================================== 00:23:41.526 Latency(us) 00:23:41.526 Device Information : IOPS MiB/s Average min max 00:23:41.526 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8159.00 31.87 3922.80 689.42 8243.37 00:23:41.526 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3936.56 15.38 8160.85 6371.60 15622.15 00:23:41.526 ======================================================== 00:23:41.526 Total : 12095.56 47.25 5302.10 689.42 15622.15 00:23:41.526 00:23:41.526 23:16:07 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:41.526 23:16:07 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:41.526 23:16:07 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:41.526 EAL: No free 2048 kB hugepages reported on node 1 00:23:44.056 Initializing NVMe Controllers 00:23:44.056 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:44.056 Controller IO queue size 128, less than required. 00:23:44.056 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:44.056 Controller IO queue size 128, less than required. 00:23:44.056 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:44.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:44.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:44.056 Initialization complete. Launching workers. 00:23:44.056 ======================================================== 00:23:44.056 Latency(us) 00:23:44.056 Device Information : IOPS MiB/s Average min max 00:23:44.056 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1697.23 424.31 76617.28 49611.36 105116.37 00:23:44.056 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 604.19 151.05 221151.60 105403.96 382133.87 00:23:44.056 ======================================================== 00:23:44.056 Total : 2301.42 575.35 114561.85 49611.36 382133.87 00:23:44.056 00:23:44.056 23:16:10 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:44.056 EAL: No free 2048 kB hugepages reported on node 1 00:23:44.056 No valid NVMe controllers or AIO or URING devices found 00:23:44.056 Initializing NVMe Controllers 00:23:44.056 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:44.056 Controller IO queue size 128, less than required. 00:23:44.056 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:44.056 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:44.056 Controller IO queue size 128, less than required. 00:23:44.056 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:44.056 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:44.056 WARNING: Some requested NVMe devices were skipped 00:23:44.056 23:16:10 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:44.056 EAL: No free 2048 kB hugepages reported on node 1 00:23:46.585 Initializing NVMe Controllers 00:23:46.585 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:46.586 Controller IO queue size 128, less than required. 00:23:46.586 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:46.586 Controller IO queue size 128, less than required. 00:23:46.586 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:46.586 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:46.586 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:46.586 Initialization complete. Launching workers. 00:23:46.586 00:23:46.586 ==================== 00:23:46.586 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:46.586 TCP transport: 00:23:46.586 polls: 11289 00:23:46.586 idle_polls: 8320 00:23:46.586 sock_completions: 2969 00:23:46.586 nvme_completions: 5864 00:23:46.586 submitted_requests: 9082 00:23:46.586 queued_requests: 1 00:23:46.586 00:23:46.586 ==================== 00:23:46.586 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:46.586 TCP transport: 00:23:46.586 polls: 11911 00:23:46.586 idle_polls: 8584 00:23:46.586 sock_completions: 3327 00:23:46.586 nvme_completions: 6280 00:23:46.586 submitted_requests: 9574 00:23:46.586 queued_requests: 1 00:23:46.586 ======================================================== 00:23:46.586 Latency(us) 00:23:46.586 Device Information : IOPS MiB/s Average min max 00:23:46.586 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1526.97 381.74 85247.06 53012.71 140860.31 00:23:46.586 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1630.80 407.70 79355.86 42458.31 117749.82 00:23:46.586 ======================================================== 00:23:46.586 Total : 3157.77 789.44 82204.61 42458.31 140860.31 00:23:46.586 00:23:46.586 23:16:12 -- host/perf.sh@66 -- # sync 00:23:46.586 23:16:12 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:46.844 23:16:13 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:46.844 23:16:13 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:46.844 23:16:13 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:50.122 23:16:16 -- host/perf.sh@72 -- # ls_guid=bf837b3e-b91b-4df5-93de-ff54a67dc8ad 00:23:50.122 23:16:16 -- host/perf.sh@73 -- # get_lvs_free_mb bf837b3e-b91b-4df5-93de-ff54a67dc8ad 00:23:50.122 23:16:16 -- common/autotest_common.sh@1353 -- # local lvs_uuid=bf837b3e-b91b-4df5-93de-ff54a67dc8ad 00:23:50.122 23:16:16 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:50.122 23:16:16 -- common/autotest_common.sh@1355 -- # local fc 00:23:50.122 23:16:16 -- common/autotest_common.sh@1356 -- # local cs 00:23:50.122 23:16:16 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:50.379 23:16:16 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:50.379 { 00:23:50.379 "uuid": "bf837b3e-b91b-4df5-93de-ff54a67dc8ad", 00:23:50.379 "name": "lvs_0", 00:23:50.379 "base_bdev": "Nvme0n1", 00:23:50.379 "total_data_clusters": 238234, 00:23:50.379 "free_clusters": 238234, 00:23:50.379 "block_size": 512, 00:23:50.379 "cluster_size": 4194304 00:23:50.379 } 00:23:50.379 ]' 00:23:50.379 23:16:16 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="bf837b3e-b91b-4df5-93de-ff54a67dc8ad") .free_clusters' 00:23:50.379 23:16:16 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:50.379 23:16:16 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="bf837b3e-b91b-4df5-93de-ff54a67dc8ad") .cluster_size' 00:23:50.379 23:16:16 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:50.379 23:16:16 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:50.379 23:16:16 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:50.379 952936 00:23:50.379 23:16:16 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:50.379 23:16:16 -- host/perf.sh@78 -- # free_mb=20480 00:23:50.379 23:16:16 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u bf837b3e-b91b-4df5-93de-ff54a67dc8ad lbd_0 20480 00:23:50.944 23:16:17 -- host/perf.sh@80 -- # lb_guid=e02e4be2-e7ef-4485-97e3-fac5d3147e98 00:23:50.944 23:16:17 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore e02e4be2-e7ef-4485-97e3-fac5d3147e98 lvs_n_0 00:23:51.877 23:16:18 -- host/perf.sh@83 -- # ls_nested_guid=87e9efb7-b322-4df4-ad7a-4b115084184b 00:23:51.877 23:16:18 -- host/perf.sh@84 -- # get_lvs_free_mb 87e9efb7-b322-4df4-ad7a-4b115084184b 00:23:51.877 23:16:18 -- common/autotest_common.sh@1353 -- # local lvs_uuid=87e9efb7-b322-4df4-ad7a-4b115084184b 00:23:51.877 23:16:18 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:51.877 23:16:18 -- common/autotest_common.sh@1355 -- # local fc 00:23:51.877 23:16:18 -- common/autotest_common.sh@1356 -- # local cs 00:23:51.877 23:16:18 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:52.134 23:16:18 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:52.135 { 00:23:52.135 "uuid": "bf837b3e-b91b-4df5-93de-ff54a67dc8ad", 00:23:52.135 "name": "lvs_0", 00:23:52.135 "base_bdev": "Nvme0n1", 00:23:52.135 "total_data_clusters": 238234, 00:23:52.135 "free_clusters": 233114, 00:23:52.135 "block_size": 512, 00:23:52.135 "cluster_size": 4194304 00:23:52.135 }, 00:23:52.135 { 00:23:52.135 "uuid": "87e9efb7-b322-4df4-ad7a-4b115084184b", 00:23:52.135 "name": "lvs_n_0", 00:23:52.135 "base_bdev": "e02e4be2-e7ef-4485-97e3-fac5d3147e98", 00:23:52.135 "total_data_clusters": 5114, 00:23:52.135 "free_clusters": 5114, 00:23:52.135 "block_size": 512, 00:23:52.135 "cluster_size": 4194304 00:23:52.135 } 00:23:52.135 ]' 00:23:52.135 23:16:18 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="87e9efb7-b322-4df4-ad7a-4b115084184b") .free_clusters' 00:23:52.135 23:16:18 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:52.135 23:16:18 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="87e9efb7-b322-4df4-ad7a-4b115084184b") .cluster_size' 00:23:52.135 23:16:18 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:52.135 23:16:18 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:52.135 23:16:18 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:52.135 20456 00:23:52.135 23:16:18 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:52.135 23:16:18 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 87e9efb7-b322-4df4-ad7a-4b115084184b lbd_nest_0 20456 00:23:52.392 23:16:18 -- host/perf.sh@88 -- # lb_nested_guid=3276bdb9-b764-40b3-a606-e012ff28e400 00:23:52.392 23:16:18 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:52.649 23:16:18 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:52.649 23:16:18 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 3276bdb9-b764-40b3-a606-e012ff28e400 00:23:52.906 23:16:19 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:53.163 23:16:19 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:53.163 23:16:19 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:53.163 23:16:19 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:53.163 23:16:19 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:53.163 23:16:19 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:53.163 EAL: No free 2048 kB hugepages reported on node 1 00:24:05.356 Initializing NVMe Controllers 00:24:05.356 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:05.356 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:05.356 Initialization complete. Launching workers. 00:24:05.356 ======================================================== 00:24:05.356 Latency(us) 00:24:05.356 Device Information : IOPS MiB/s Average min max 00:24:05.356 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.90 0.02 21390.75 174.09 45838.24 00:24:05.356 ======================================================== 00:24:05.356 Total : 46.90 0.02 21390.75 174.09 45838.24 00:24:05.356 00:24:05.356 23:16:29 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:05.356 23:16:29 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:05.356 EAL: No free 2048 kB hugepages reported on node 1 00:24:15.320 Initializing NVMe Controllers 00:24:15.320 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:15.320 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:15.320 Initialization complete. Launching workers. 00:24:15.320 ======================================================== 00:24:15.320 Latency(us) 00:24:15.320 Device Information : IOPS MiB/s Average min max 00:24:15.320 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 78.60 9.82 12727.84 5154.94 47908.54 00:24:15.320 ======================================================== 00:24:15.320 Total : 78.60 9.82 12727.84 5154.94 47908.54 00:24:15.320 00:24:15.320 23:16:40 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:15.320 23:16:40 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:15.320 23:16:40 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:15.320 EAL: No free 2048 kB hugepages reported on node 1 00:24:25.298 Initializing NVMe Controllers 00:24:25.298 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:25.298 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:25.298 Initialization complete. Launching workers. 00:24:25.298 ======================================================== 00:24:25.298 Latency(us) 00:24:25.298 Device Information : IOPS MiB/s Average min max 00:24:25.298 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7306.48 3.57 4379.42 317.46 11167.78 00:24:25.298 ======================================================== 00:24:25.298 Total : 7306.48 3.57 4379.42 317.46 11167.78 00:24:25.298 00:24:25.298 23:16:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:25.298 23:16:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:25.298 EAL: No free 2048 kB hugepages reported on node 1 00:24:35.271 Initializing NVMe Controllers 00:24:35.271 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:35.271 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:35.271 Initialization complete. Launching workers. 00:24:35.271 ======================================================== 00:24:35.271 Latency(us) 00:24:35.271 Device Information : IOPS MiB/s Average min max 00:24:35.271 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4093.50 511.69 7818.05 653.78 15722.15 00:24:35.271 ======================================================== 00:24:35.271 Total : 4093.50 511.69 7818.05 653.78 15722.15 00:24:35.271 00:24:35.271 23:17:00 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:35.271 23:17:00 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:35.271 23:17:00 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:35.271 EAL: No free 2048 kB hugepages reported on node 1 00:24:45.282 Initializing NVMe Controllers 00:24:45.282 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:45.282 Controller IO queue size 128, less than required. 00:24:45.282 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:45.282 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:45.282 Initialization complete. Launching workers. 00:24:45.282 ======================================================== 00:24:45.282 Latency(us) 00:24:45.282 Device Information : IOPS MiB/s Average min max 00:24:45.282 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12094.13 5.91 10585.57 1799.23 24951.04 00:24:45.282 ======================================================== 00:24:45.282 Total : 12094.13 5.91 10585.57 1799.23 24951.04 00:24:45.282 00:24:45.282 23:17:11 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:45.282 23:17:11 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:45.282 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.248 Initializing NVMe Controllers 00:24:55.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:55.248 Controller IO queue size 128, less than required. 00:24:55.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:55.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:55.248 Initialization complete. Launching workers. 00:24:55.248 ======================================================== 00:24:55.248 Latency(us) 00:24:55.248 Device Information : IOPS MiB/s Average min max 00:24:55.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1170.90 146.36 109428.13 11085.05 231575.85 00:24:55.248 ======================================================== 00:24:55.248 Total : 1170.90 146.36 109428.13 11085.05 231575.85 00:24:55.248 00:24:55.248 23:17:21 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:55.248 23:17:21 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3276bdb9-b764-40b3-a606-e012ff28e400 00:24:56.180 23:17:22 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:56.438 23:17:22 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e02e4be2-e7ef-4485-97e3-fac5d3147e98 00:24:56.695 23:17:22 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:56.953 23:17:23 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:56.953 23:17:23 -- host/perf.sh@114 -- # nvmftestfini 00:24:56.953 23:17:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:56.953 23:17:23 -- nvmf/common.sh@116 -- # sync 00:24:56.953 23:17:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:56.953 23:17:23 -- nvmf/common.sh@119 -- # set +e 00:24:56.953 23:17:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:56.953 23:17:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:56.953 rmmod nvme_tcp 00:24:56.953 rmmod nvme_fabrics 00:24:56.953 rmmod nvme_keyring 00:24:56.953 23:17:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:56.953 23:17:23 -- nvmf/common.sh@123 -- # set -e 00:24:56.953 23:17:23 -- nvmf/common.sh@124 -- # return 0 00:24:56.953 23:17:23 -- nvmf/common.sh@477 -- # '[' -n 284099 ']' 00:24:56.953 23:17:23 -- nvmf/common.sh@478 -- # killprocess 284099 00:24:56.953 23:17:23 -- common/autotest_common.sh@936 -- # '[' -z 284099 ']' 00:24:56.953 23:17:23 -- common/autotest_common.sh@940 -- # kill -0 284099 00:24:56.953 23:17:23 -- common/autotest_common.sh@941 -- # uname 00:24:56.953 23:17:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:56.953 23:17:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 284099 00:24:56.953 23:17:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:56.953 23:17:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:56.953 23:17:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 284099' 00:24:56.953 killing process with pid 284099 00:24:56.953 23:17:23 -- common/autotest_common.sh@955 -- # kill 284099 00:24:56.953 23:17:23 -- common/autotest_common.sh@960 -- # wait 284099 00:24:58.851 23:17:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:58.851 23:17:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:58.851 23:17:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:58.851 23:17:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:58.851 23:17:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:58.851 23:17:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:58.851 23:17:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:58.851 23:17:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:00.753 23:17:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:00.753 00:25:00.753 real 1m31.873s 00:25:00.753 user 5m36.895s 00:25:00.753 sys 0m16.880s 00:25:00.753 23:17:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:00.753 23:17:26 -- common/autotest_common.sh@10 -- # set +x 00:25:00.753 ************************************ 00:25:00.753 END TEST nvmf_perf 00:25:00.753 ************************************ 00:25:00.753 23:17:26 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:00.753 23:17:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:00.753 23:17:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:00.753 23:17:26 -- common/autotest_common.sh@10 -- # set +x 00:25:00.753 ************************************ 00:25:00.753 START TEST nvmf_fio_host 00:25:00.753 ************************************ 00:25:00.753 23:17:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:00.753 * Looking for test storage... 00:25:00.753 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:00.753 23:17:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:00.753 23:17:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:00.753 23:17:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:00.753 23:17:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:00.753 23:17:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:00.753 23:17:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:00.753 23:17:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:00.753 23:17:27 -- scripts/common.sh@335 -- # IFS=.-: 00:25:00.753 23:17:27 -- scripts/common.sh@335 -- # read -ra ver1 00:25:00.753 23:17:27 -- scripts/common.sh@336 -- # IFS=.-: 00:25:00.753 23:17:27 -- scripts/common.sh@336 -- # read -ra ver2 00:25:00.753 23:17:27 -- scripts/common.sh@337 -- # local 'op=<' 00:25:00.753 23:17:27 -- scripts/common.sh@339 -- # ver1_l=2 00:25:00.753 23:17:27 -- scripts/common.sh@340 -- # ver2_l=1 00:25:00.753 23:17:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:00.753 23:17:27 -- scripts/common.sh@343 -- # case "$op" in 00:25:00.753 23:17:27 -- scripts/common.sh@344 -- # : 1 00:25:00.753 23:17:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:00.753 23:17:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:00.753 23:17:27 -- scripts/common.sh@364 -- # decimal 1 00:25:00.753 23:17:27 -- scripts/common.sh@352 -- # local d=1 00:25:00.753 23:17:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:00.753 23:17:27 -- scripts/common.sh@354 -- # echo 1 00:25:00.753 23:17:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:00.753 23:17:27 -- scripts/common.sh@365 -- # decimal 2 00:25:00.753 23:17:27 -- scripts/common.sh@352 -- # local d=2 00:25:00.753 23:17:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:00.753 23:17:27 -- scripts/common.sh@354 -- # echo 2 00:25:00.753 23:17:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:00.753 23:17:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:00.753 23:17:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:00.753 23:17:27 -- scripts/common.sh@367 -- # return 0 00:25:00.753 23:17:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:00.753 23:17:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:00.753 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.753 --rc genhtml_branch_coverage=1 00:25:00.753 --rc genhtml_function_coverage=1 00:25:00.753 --rc genhtml_legend=1 00:25:00.753 --rc geninfo_all_blocks=1 00:25:00.753 --rc geninfo_unexecuted_blocks=1 00:25:00.753 00:25:00.753 ' 00:25:00.753 23:17:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:00.753 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.753 --rc genhtml_branch_coverage=1 00:25:00.753 --rc genhtml_function_coverage=1 00:25:00.753 --rc genhtml_legend=1 00:25:00.753 --rc geninfo_all_blocks=1 00:25:00.753 --rc geninfo_unexecuted_blocks=1 00:25:00.753 00:25:00.753 ' 00:25:00.753 23:17:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:00.753 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.753 --rc genhtml_branch_coverage=1 00:25:00.753 --rc genhtml_function_coverage=1 00:25:00.753 --rc genhtml_legend=1 00:25:00.753 --rc geninfo_all_blocks=1 00:25:00.753 --rc geninfo_unexecuted_blocks=1 00:25:00.753 00:25:00.753 ' 00:25:00.753 23:17:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:00.753 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.753 --rc genhtml_branch_coverage=1 00:25:00.753 --rc genhtml_function_coverage=1 00:25:00.753 --rc genhtml_legend=1 00:25:00.753 --rc geninfo_all_blocks=1 00:25:00.753 --rc geninfo_unexecuted_blocks=1 00:25:00.753 00:25:00.753 ' 00:25:00.753 23:17:27 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:00.753 23:17:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:00.753 23:17:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:00.753 23:17:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:00.753 23:17:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.753 23:17:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.753 23:17:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.753 23:17:27 -- paths/export.sh@5 -- # export PATH 00:25:00.753 23:17:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.753 23:17:27 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:00.753 23:17:27 -- nvmf/common.sh@7 -- # uname -s 00:25:00.753 23:17:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:00.753 23:17:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:00.753 23:17:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:00.753 23:17:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:00.753 23:17:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:00.753 23:17:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:00.753 23:17:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:00.753 23:17:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:00.753 23:17:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:00.754 23:17:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:00.754 23:17:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:00.754 23:17:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:00.754 23:17:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:00.754 23:17:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:00.754 23:17:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:00.754 23:17:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:00.754 23:17:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:00.754 23:17:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:00.754 23:17:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:00.754 23:17:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.754 23:17:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.754 23:17:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.754 23:17:27 -- paths/export.sh@5 -- # export PATH 00:25:00.754 23:17:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.754 23:17:27 -- nvmf/common.sh@46 -- # : 0 00:25:00.754 23:17:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:00.754 23:17:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:00.754 23:17:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:00.754 23:17:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:00.754 23:17:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:00.754 23:17:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:00.754 23:17:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:00.754 23:17:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:01.013 23:17:27 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:01.013 23:17:27 -- host/fio.sh@14 -- # nvmftestinit 00:25:01.013 23:17:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:01.013 23:17:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:01.013 23:17:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:01.013 23:17:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:01.013 23:17:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:01.013 23:17:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:01.013 23:17:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:01.013 23:17:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:01.013 23:17:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:01.013 23:17:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:01.013 23:17:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:01.013 23:17:27 -- common/autotest_common.sh@10 -- # set +x 00:25:02.915 23:17:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:02.915 23:17:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:02.915 23:17:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:02.915 23:17:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:02.915 23:17:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:02.915 23:17:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:02.915 23:17:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:02.915 23:17:29 -- nvmf/common.sh@294 -- # net_devs=() 00:25:02.915 23:17:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:02.915 23:17:29 -- nvmf/common.sh@295 -- # e810=() 00:25:02.915 23:17:29 -- nvmf/common.sh@295 -- # local -ga e810 00:25:02.915 23:17:29 -- nvmf/common.sh@296 -- # x722=() 00:25:02.915 23:17:29 -- nvmf/common.sh@296 -- # local -ga x722 00:25:02.915 23:17:29 -- nvmf/common.sh@297 -- # mlx=() 00:25:02.915 23:17:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:02.915 23:17:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:02.915 23:17:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:02.915 23:17:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:02.915 23:17:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:02.915 23:17:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.915 23:17:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:02.915 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:02.915 23:17:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.915 23:17:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:02.915 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:02.915 23:17:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:02.915 23:17:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.915 23:17:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.915 23:17:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.915 23:17:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.915 23:17:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:02.915 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:02.915 23:17:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.915 23:17:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.915 23:17:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.915 23:17:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.915 23:17:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.915 23:17:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:02.915 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:02.915 23:17:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.915 23:17:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:02.915 23:17:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:02.915 23:17:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:02.915 23:17:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:02.915 23:17:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:02.915 23:17:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:02.915 23:17:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:02.915 23:17:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:02.915 23:17:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:02.915 23:17:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:02.915 23:17:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:02.915 23:17:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:02.915 23:17:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:02.915 23:17:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:02.915 23:17:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:02.915 23:17:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:02.915 23:17:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:02.915 23:17:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:02.915 23:17:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:02.915 23:17:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:02.915 23:17:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:02.915 23:17:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:02.915 23:17:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:03.174 23:17:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:03.174 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:03.174 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:25:03.174 00:25:03.174 --- 10.0.0.2 ping statistics --- 00:25:03.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:03.174 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:25:03.174 23:17:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:03.174 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:03.174 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:25:03.174 00:25:03.174 --- 10.0.0.1 ping statistics --- 00:25:03.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:03.174 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:25:03.174 23:17:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:03.174 23:17:29 -- nvmf/common.sh@410 -- # return 0 00:25:03.174 23:17:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:03.174 23:17:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:03.174 23:17:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:03.174 23:17:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:03.174 23:17:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:03.174 23:17:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:03.174 23:17:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:03.174 23:17:29 -- host/fio.sh@16 -- # [[ y != y ]] 00:25:03.174 23:17:29 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:25:03.174 23:17:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:03.174 23:17:29 -- common/autotest_common.sh@10 -- # set +x 00:25:03.174 23:17:29 -- host/fio.sh@24 -- # nvmfpid=296655 00:25:03.174 23:17:29 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:03.174 23:17:29 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:03.174 23:17:29 -- host/fio.sh@28 -- # waitforlisten 296655 00:25:03.174 23:17:29 -- common/autotest_common.sh@829 -- # '[' -z 296655 ']' 00:25:03.174 23:17:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:03.174 23:17:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:03.174 23:17:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:03.174 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:03.174 23:17:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:03.174 23:17:29 -- common/autotest_common.sh@10 -- # set +x 00:25:03.174 [2024-11-26 23:17:29.390937] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:03.174 [2024-11-26 23:17:29.391014] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:03.174 EAL: No free 2048 kB hugepages reported on node 1 00:25:03.174 [2024-11-26 23:17:29.458224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:03.432 [2024-11-26 23:17:29.571053] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:03.432 [2024-11-26 23:17:29.571198] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:03.432 [2024-11-26 23:17:29.571215] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:03.432 [2024-11-26 23:17:29.571229] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:03.432 [2024-11-26 23:17:29.571297] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:03.432 [2024-11-26 23:17:29.571341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:03.432 [2024-11-26 23:17:29.571399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:03.433 [2024-11-26 23:17:29.571402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:03.998 23:17:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:03.998 23:17:30 -- common/autotest_common.sh@862 -- # return 0 00:25:03.998 23:17:30 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:04.256 [2024-11-26 23:17:30.627940] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:04.514 23:17:30 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:25:04.514 23:17:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:04.514 23:17:30 -- common/autotest_common.sh@10 -- # set +x 00:25:04.514 23:17:30 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:25:04.774 Malloc1 00:25:04.774 23:17:30 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:05.032 23:17:31 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:05.289 23:17:31 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:05.547 [2024-11-26 23:17:31.692428] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:05.547 23:17:31 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:05.811 23:17:31 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:25:05.811 23:17:31 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:05.811 23:17:31 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:05.811 23:17:31 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:05.811 23:17:31 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:05.811 23:17:31 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:05.811 23:17:31 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.811 23:17:31 -- common/autotest_common.sh@1330 -- # shift 00:25:05.811 23:17:31 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:05.811 23:17:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:05.811 23:17:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.811 23:17:31 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:05.811 23:17:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:05.811 23:17:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:05.811 23:17:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:05.811 23:17:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:05.811 23:17:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.811 23:17:31 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:05.811 23:17:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:05.811 23:17:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:05.811 23:17:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:05.811 23:17:31 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:05.811 23:17:31 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:06.070 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:06.070 fio-3.35 00:25:06.070 Starting 1 thread 00:25:06.070 EAL: No free 2048 kB hugepages reported on node 1 00:25:08.614 00:25:08.614 test: (groupid=0, jobs=1): err= 0: pid=297032: Tue Nov 26 23:17:34 2024 00:25:08.614 read: IOPS=8964, BW=35.0MiB/s (36.7MB/s)(70.3MiB/2007msec) 00:25:08.614 slat (nsec): min=1898, max=171519, avg=2491.57, stdev=1852.49 00:25:08.614 clat (usec): min=2299, max=13712, avg=7869.09, stdev=613.54 00:25:08.614 lat (usec): min=2322, max=13714, avg=7871.58, stdev=613.40 00:25:08.614 clat percentiles (usec): 00:25:08.614 | 1.00th=[ 6456], 5.00th=[ 6915], 10.00th=[ 7111], 20.00th=[ 7373], 00:25:08.614 | 30.00th=[ 7570], 40.00th=[ 7767], 50.00th=[ 7898], 60.00th=[ 8029], 00:25:08.614 | 70.00th=[ 8160], 80.00th=[ 8356], 90.00th=[ 8586], 95.00th=[ 8848], 00:25:08.614 | 99.00th=[ 9241], 99.50th=[ 9372], 99.90th=[11076], 99.95th=[12518], 00:25:08.614 | 99.99th=[13698] 00:25:08.614 bw ( KiB/s): min=35016, max=36304, per=99.98%, avg=35850.00, stdev=574.27, samples=4 00:25:08.614 iops : min= 8754, max= 9076, avg=8962.50, stdev=143.57, samples=4 00:25:08.614 write: IOPS=8983, BW=35.1MiB/s (36.8MB/s)(70.4MiB/2007msec); 0 zone resets 00:25:08.614 slat (usec): min=2, max=132, avg= 2.64, stdev= 1.39 00:25:08.614 clat (usec): min=1739, max=12575, avg=6356.45, stdev=552.60 00:25:08.614 lat (usec): min=1747, max=12578, avg=6359.09, stdev=552.56 00:25:08.614 clat percentiles (usec): 00:25:08.614 | 1.00th=[ 5145], 5.00th=[ 5538], 10.00th=[ 5735], 20.00th=[ 5932], 00:25:08.614 | 30.00th=[ 6128], 40.00th=[ 6259], 50.00th=[ 6325], 60.00th=[ 6456], 00:25:08.614 | 70.00th=[ 6587], 80.00th=[ 6783], 90.00th=[ 6980], 95.00th=[ 7111], 00:25:08.614 | 99.00th=[ 7504], 99.50th=[ 7701], 99.90th=[10945], 99.95th=[11863], 00:25:08.614 | 99.99th=[12518] 00:25:08.614 bw ( KiB/s): min=35640, max=36136, per=100.00%, avg=35936.00, stdev=240.62, samples=4 00:25:08.614 iops : min= 8910, max= 9034, avg=8984.00, stdev=60.16, samples=4 00:25:08.614 lat (msec) : 2=0.02%, 4=0.11%, 10=99.70%, 20=0.17% 00:25:08.614 cpu : usr=63.81%, sys=34.25%, ctx=73, majf=0, minf=41 00:25:08.614 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:08.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:08.614 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:08.614 issued rwts: total=17991,18029,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:08.614 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:08.614 00:25:08.614 Run status group 0 (all jobs): 00:25:08.614 READ: bw=35.0MiB/s (36.7MB/s), 35.0MiB/s-35.0MiB/s (36.7MB/s-36.7MB/s), io=70.3MiB (73.7MB), run=2007-2007msec 00:25:08.614 WRITE: bw=35.1MiB/s (36.8MB/s), 35.1MiB/s-35.1MiB/s (36.8MB/s-36.8MB/s), io=70.4MiB (73.8MB), run=2007-2007msec 00:25:08.614 23:17:34 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:08.614 23:17:34 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:08.614 23:17:34 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:08.614 23:17:34 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:08.614 23:17:34 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:08.614 23:17:34 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.614 23:17:34 -- common/autotest_common.sh@1330 -- # shift 00:25:08.614 23:17:34 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:08.614 23:17:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:08.614 23:17:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.614 23:17:34 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:08.614 23:17:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:08.614 23:17:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:08.614 23:17:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:08.614 23:17:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:08.614 23:17:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.614 23:17:34 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:08.614 23:17:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:08.614 23:17:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:08.614 23:17:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:08.614 23:17:34 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:08.614 23:17:34 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:08.614 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:08.614 fio-3.35 00:25:08.614 Starting 1 thread 00:25:08.614 EAL: No free 2048 kB hugepages reported on node 1 00:25:11.146 00:25:11.146 test: (groupid=0, jobs=1): err= 0: pid=297502: Tue Nov 26 23:17:37 2024 00:25:11.146 read: IOPS=8874, BW=139MiB/s (145MB/s)(278MiB/2006msec) 00:25:11.146 slat (usec): min=2, max=111, avg= 3.79, stdev= 2.03 00:25:11.146 clat (usec): min=1986, max=15972, avg=8490.55, stdev=2111.23 00:25:11.146 lat (usec): min=1989, max=15975, avg=8494.34, stdev=2111.26 00:25:11.146 clat percentiles (usec): 00:25:11.146 | 1.00th=[ 4490], 5.00th=[ 5276], 10.00th=[ 5800], 20.00th=[ 6587], 00:25:11.146 | 30.00th=[ 7242], 40.00th=[ 7832], 50.00th=[ 8455], 60.00th=[ 9110], 00:25:11.146 | 70.00th=[ 9634], 80.00th=[10159], 90.00th=[11076], 95.00th=[12125], 00:25:11.146 | 99.00th=[14222], 99.50th=[14877], 99.90th=[15795], 99.95th=[15795], 00:25:11.146 | 99.99th=[15926] 00:25:11.146 bw ( KiB/s): min=65760, max=78912, per=49.88%, avg=70824.00, stdev=6086.42, samples=4 00:25:11.146 iops : min= 4110, max= 4932, avg=4426.50, stdev=380.40, samples=4 00:25:11.146 write: IOPS=5157, BW=80.6MiB/s (84.5MB/s)(144MiB/1789msec); 0 zone resets 00:25:11.146 slat (usec): min=30, max=142, avg=34.35, stdev= 5.79 00:25:11.146 clat (usec): min=4220, max=18572, avg=10636.51, stdev=1835.84 00:25:11.146 lat (usec): min=4252, max=18604, avg=10670.86, stdev=1835.88 00:25:11.146 clat percentiles (usec): 00:25:11.146 | 1.00th=[ 7308], 5.00th=[ 8094], 10.00th=[ 8586], 20.00th=[ 9110], 00:25:11.146 | 30.00th=[ 9634], 40.00th=[ 9896], 50.00th=[10290], 60.00th=[10683], 00:25:11.146 | 70.00th=[11338], 80.00th=[12125], 90.00th=[13304], 95.00th=[14353], 00:25:11.146 | 99.00th=[15401], 99.50th=[15795], 99.90th=[16909], 99.95th=[17433], 00:25:11.146 | 99.99th=[18482] 00:25:11.146 bw ( KiB/s): min=69440, max=80352, per=89.45%, avg=73816.00, stdev=4919.01, samples=4 00:25:11.146 iops : min= 4340, max= 5022, avg=4613.50, stdev=307.44, samples=4 00:25:11.146 lat (msec) : 2=0.01%, 4=0.22%, 10=64.97%, 20=34.80% 00:25:11.146 cpu : usr=77.87%, sys=20.94%, ctx=34, majf=0, minf=71 00:25:11.146 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:25:11.146 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:11.146 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:11.146 issued rwts: total=17803,9227,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:11.146 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:11.146 00:25:11.146 Run status group 0 (all jobs): 00:25:11.146 READ: bw=139MiB/s (145MB/s), 139MiB/s-139MiB/s (145MB/s-145MB/s), io=278MiB (292MB), run=2006-2006msec 00:25:11.146 WRITE: bw=80.6MiB/s (84.5MB/s), 80.6MiB/s-80.6MiB/s (84.5MB/s-84.5MB/s), io=144MiB (151MB), run=1789-1789msec 00:25:11.146 23:17:37 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:11.146 23:17:37 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:11.146 23:17:37 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:11.146 23:17:37 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:11.146 23:17:37 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:11.146 23:17:37 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:11.146 23:17:37 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:11.146 23:17:37 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:11.146 23:17:37 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:11.146 23:17:37 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:11.146 23:17:37 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:11.146 23:17:37 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:14.421 Nvme0n1 00:25:14.421 23:17:40 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:17.697 23:17:43 -- host/fio.sh@53 -- # ls_guid=3c21c0e7-85fe-4e94-883d-9fc7a04c1164 00:25:17.697 23:17:43 -- host/fio.sh@54 -- # get_lvs_free_mb 3c21c0e7-85fe-4e94-883d-9fc7a04c1164 00:25:17.697 23:17:43 -- common/autotest_common.sh@1353 -- # local lvs_uuid=3c21c0e7-85fe-4e94-883d-9fc7a04c1164 00:25:17.697 23:17:43 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:17.697 23:17:43 -- common/autotest_common.sh@1355 -- # local fc 00:25:17.697 23:17:43 -- common/autotest_common.sh@1356 -- # local cs 00:25:17.697 23:17:43 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:17.697 23:17:43 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:17.697 { 00:25:17.697 "uuid": "3c21c0e7-85fe-4e94-883d-9fc7a04c1164", 00:25:17.697 "name": "lvs_0", 00:25:17.697 "base_bdev": "Nvme0n1", 00:25:17.697 "total_data_clusters": 930, 00:25:17.697 "free_clusters": 930, 00:25:17.697 "block_size": 512, 00:25:17.697 "cluster_size": 1073741824 00:25:17.697 } 00:25:17.697 ]' 00:25:17.697 23:17:43 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="3c21c0e7-85fe-4e94-883d-9fc7a04c1164") .free_clusters' 00:25:17.697 23:17:43 -- common/autotest_common.sh@1358 -- # fc=930 00:25:17.697 23:17:43 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="3c21c0e7-85fe-4e94-883d-9fc7a04c1164") .cluster_size' 00:25:17.697 23:17:43 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:17.697 23:17:43 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:17.697 23:17:43 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:17.697 952320 00:25:17.697 23:17:43 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:17.955 4787dec2-cee3-4624-8755-ee24e27a46d4 00:25:17.955 23:17:44 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:18.213 23:17:44 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:18.471 23:17:44 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:18.729 23:17:44 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.729 23:17:44 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.729 23:17:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:18.729 23:17:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:18.729 23:17:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:18.729 23:17:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.729 23:17:44 -- common/autotest_common.sh@1330 -- # shift 00:25:18.729 23:17:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:18.729 23:17:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:18.729 23:17:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.729 23:17:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:18.729 23:17:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:18.729 23:17:45 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:18.729 23:17:45 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:18.729 23:17:45 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:18.729 23:17:45 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.729 23:17:45 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:18.729 23:17:45 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:18.729 23:17:45 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:18.729 23:17:45 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:18.729 23:17:45 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:18.729 23:17:45 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.987 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:18.987 fio-3.35 00:25:18.987 Starting 1 thread 00:25:18.987 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.514 00:25:21.514 test: (groupid=0, jobs=1): err= 0: pid=298819: Tue Nov 26 23:17:47 2024 00:25:21.514 read: IOPS=6310, BW=24.6MiB/s (25.8MB/s)(49.5MiB/2007msec) 00:25:21.514 slat (usec): min=2, max=134, avg= 2.80, stdev= 2.02 00:25:21.514 clat (usec): min=783, max=170543, avg=11111.06, stdev=11376.13 00:25:21.514 lat (usec): min=786, max=170578, avg=11113.86, stdev=11376.34 00:25:21.514 clat percentiles (msec): 00:25:21.514 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:25:21.514 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:25:21.514 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 12], 00:25:21.514 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:21.514 | 99.99th=[ 171] 00:25:21.514 bw ( KiB/s): min=17752, max=27944, per=99.83%, avg=25200.00, stdev=4968.84, samples=4 00:25:21.514 iops : min= 4438, max= 6986, avg=6300.00, stdev=1242.21, samples=4 00:25:21.514 write: IOPS=6303, BW=24.6MiB/s (25.8MB/s)(49.4MiB/2007msec); 0 zone resets 00:25:21.514 slat (nsec): min=2180, max=92605, avg=2936.86, stdev=1701.94 00:25:21.514 clat (usec): min=239, max=168841, avg=9060.14, stdev=10667.39 00:25:21.514 lat (usec): min=242, max=168846, avg=9063.07, stdev=10667.58 00:25:21.514 clat percentiles (msec): 00:25:21.514 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:25:21.514 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:25:21.514 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:25:21.514 | 99.00th=[ 11], 99.50th=[ 14], 99.90th=[ 169], 99.95th=[ 169], 00:25:21.514 | 99.99th=[ 169] 00:25:21.514 bw ( KiB/s): min=18728, max=27344, per=99.86%, avg=25178.00, stdev=4300.02, samples=4 00:25:21.514 iops : min= 4682, max= 6836, avg=6294.50, stdev=1075.00, samples=4 00:25:21.514 lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01% 00:25:21.514 lat (msec) : 2=0.02%, 4=0.15%, 10=67.08%, 20=32.22%, 250=0.51% 00:25:21.514 cpu : usr=58.42%, sys=40.18%, ctx=97, majf=0, minf=41 00:25:21.514 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:21.514 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:21.514 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:21.514 issued rwts: total=12665,12651,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:21.514 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:21.514 00:25:21.514 Run status group 0 (all jobs): 00:25:21.514 READ: bw=24.6MiB/s (25.8MB/s), 24.6MiB/s-24.6MiB/s (25.8MB/s-25.8MB/s), io=49.5MiB (51.9MB), run=2007-2007msec 00:25:21.514 WRITE: bw=24.6MiB/s (25.8MB/s), 24.6MiB/s-24.6MiB/s (25.8MB/s-25.8MB/s), io=49.4MiB (51.8MB), run=2007-2007msec 00:25:21.514 23:17:47 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:21.773 23:17:47 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:22.706 23:17:49 -- host/fio.sh@64 -- # ls_nested_guid=8c022e96-fe1e-4508-8386-2e9c8abc3b8d 00:25:22.706 23:17:49 -- host/fio.sh@65 -- # get_lvs_free_mb 8c022e96-fe1e-4508-8386-2e9c8abc3b8d 00:25:22.706 23:17:49 -- common/autotest_common.sh@1353 -- # local lvs_uuid=8c022e96-fe1e-4508-8386-2e9c8abc3b8d 00:25:22.706 23:17:49 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:22.706 23:17:49 -- common/autotest_common.sh@1355 -- # local fc 00:25:22.706 23:17:49 -- common/autotest_common.sh@1356 -- # local cs 00:25:22.706 23:17:49 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:22.969 23:17:49 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:22.969 { 00:25:22.969 "uuid": "3c21c0e7-85fe-4e94-883d-9fc7a04c1164", 00:25:22.969 "name": "lvs_0", 00:25:22.969 "base_bdev": "Nvme0n1", 00:25:22.969 "total_data_clusters": 930, 00:25:22.969 "free_clusters": 0, 00:25:22.969 "block_size": 512, 00:25:22.969 "cluster_size": 1073741824 00:25:22.969 }, 00:25:22.969 { 00:25:22.969 "uuid": "8c022e96-fe1e-4508-8386-2e9c8abc3b8d", 00:25:22.969 "name": "lvs_n_0", 00:25:22.969 "base_bdev": "4787dec2-cee3-4624-8755-ee24e27a46d4", 00:25:22.969 "total_data_clusters": 237847, 00:25:22.969 "free_clusters": 237847, 00:25:22.969 "block_size": 512, 00:25:22.969 "cluster_size": 4194304 00:25:22.969 } 00:25:22.969 ]' 00:25:22.969 23:17:49 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="8c022e96-fe1e-4508-8386-2e9c8abc3b8d") .free_clusters' 00:25:23.226 23:17:49 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:23.226 23:17:49 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="8c022e96-fe1e-4508-8386-2e9c8abc3b8d") .cluster_size' 00:25:23.226 23:17:49 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:23.226 23:17:49 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:23.226 23:17:49 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:23.226 951388 00:25:23.226 23:17:49 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:23.791 2b82ea34-4bc0-434c-9d4d-5a8cff323ff0 00:25:23.791 23:17:50 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:24.048 23:17:50 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:24.307 23:17:50 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:24.565 23:17:50 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:24.565 23:17:50 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:24.565 23:17:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:24.565 23:17:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:24.565 23:17:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:24.565 23:17:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:24.565 23:17:50 -- common/autotest_common.sh@1330 -- # shift 00:25:24.565 23:17:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:24.565 23:17:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:24.565 23:17:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:24.565 23:17:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:24.565 23:17:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:24.565 23:17:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:24.565 23:17:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:24.565 23:17:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:24.565 23:17:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:24.565 23:17:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:24.565 23:17:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:24.565 23:17:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:24.565 23:17:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:24.565 23:17:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:24.565 23:17:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:24.823 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:24.823 fio-3.35 00:25:24.823 Starting 1 thread 00:25:24.823 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.350 00:25:27.350 test: (groupid=0, jobs=1): err= 0: pid=299577: Tue Nov 26 23:17:53 2024 00:25:27.350 read: IOPS=5397, BW=21.1MiB/s (22.1MB/s)(43.2MiB/2050msec) 00:25:27.350 slat (nsec): min=1845, max=178332, avg=2545.67, stdev=2552.89 00:25:27.350 clat (usec): min=7401, max=62294, avg=12946.76, stdev=3967.93 00:25:27.350 lat (usec): min=7407, max=62296, avg=12949.30, stdev=3967.91 00:25:27.350 clat percentiles (usec): 00:25:27.350 | 1.00th=[ 9896], 5.00th=[10683], 10.00th=[11076], 20.00th=[11600], 00:25:27.350 | 30.00th=[11994], 40.00th=[12387], 50.00th=[12649], 60.00th=[12911], 00:25:27.350 | 70.00th=[13173], 80.00th=[13566], 90.00th=[14222], 95.00th=[14615], 00:25:27.350 | 99.00th=[17171], 99.50th=[55313], 99.90th=[62129], 99.95th=[62129], 00:25:27.350 | 99.99th=[62129] 00:25:27.350 bw ( KiB/s): min=20472, max=22680, per=100.00%, avg=21966.00, stdev=1036.99, samples=4 00:25:27.350 iops : min= 5118, max= 5670, avg=5491.50, stdev=259.25, samples=4 00:25:27.350 write: IOPS=5360, BW=20.9MiB/s (22.0MB/s)(42.9MiB/2050msec); 0 zone resets 00:25:27.350 slat (nsec): min=1978, max=154639, avg=2679.36, stdev=2030.57 00:25:27.350 clat (usec): min=3840, max=59018, avg=10619.24, stdev=3013.17 00:25:27.350 lat (usec): min=3847, max=59020, avg=10621.92, stdev=3013.18 00:25:27.350 clat percentiles (usec): 00:25:27.350 | 1.00th=[ 8160], 5.00th=[ 8979], 10.00th=[ 9241], 20.00th=[ 9634], 00:25:27.350 | 30.00th=[ 9896], 40.00th=[10159], 50.00th=[10421], 60.00th=[10683], 00:25:27.350 | 70.00th=[10945], 80.00th=[11207], 90.00th=[11600], 95.00th=[11994], 00:25:27.350 | 99.00th=[13435], 99.50th=[16712], 99.90th=[57410], 99.95th=[58983], 00:25:27.350 | 99.99th=[58983] 00:25:27.350 bw ( KiB/s): min=21408, max=22272, per=100.00%, avg=21886.00, stdev=383.35, samples=4 00:25:27.350 iops : min= 5352, max= 5568, avg=5471.50, stdev=95.84, samples=4 00:25:27.350 lat (msec) : 4=0.01%, 10=16.33%, 20=83.01%, 50=0.06%, 100=0.58% 00:25:27.350 cpu : usr=59.74%, sys=38.99%, ctx=125, majf=0, minf=41 00:25:27.350 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:27.350 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:27.350 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:27.350 issued rwts: total=11064,10989,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:27.350 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:27.350 00:25:27.350 Run status group 0 (all jobs): 00:25:27.350 READ: bw=21.1MiB/s (22.1MB/s), 21.1MiB/s-21.1MiB/s (22.1MB/s-22.1MB/s), io=43.2MiB (45.3MB), run=2050-2050msec 00:25:27.350 WRITE: bw=20.9MiB/s (22.0MB/s), 20.9MiB/s-20.9MiB/s (22.0MB/s-22.0MB/s), io=42.9MiB (45.0MB), run=2050-2050msec 00:25:27.350 23:17:53 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:27.608 23:17:53 -- host/fio.sh@74 -- # sync 00:25:27.608 23:17:53 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:31.791 23:17:57 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:31.791 23:17:57 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:35.066 23:18:00 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:35.066 23:18:01 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:36.964 23:18:02 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:36.964 23:18:02 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:36.964 23:18:02 -- host/fio.sh@86 -- # nvmftestfini 00:25:36.964 23:18:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:36.964 23:18:02 -- nvmf/common.sh@116 -- # sync 00:25:36.964 23:18:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:36.964 23:18:02 -- nvmf/common.sh@119 -- # set +e 00:25:36.964 23:18:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:36.964 23:18:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:36.964 rmmod nvme_tcp 00:25:36.964 rmmod nvme_fabrics 00:25:36.964 rmmod nvme_keyring 00:25:36.964 23:18:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:36.964 23:18:03 -- nvmf/common.sh@123 -- # set -e 00:25:36.964 23:18:03 -- nvmf/common.sh@124 -- # return 0 00:25:36.964 23:18:03 -- nvmf/common.sh@477 -- # '[' -n 296655 ']' 00:25:36.964 23:18:03 -- nvmf/common.sh@478 -- # killprocess 296655 00:25:36.964 23:18:03 -- common/autotest_common.sh@936 -- # '[' -z 296655 ']' 00:25:36.964 23:18:03 -- common/autotest_common.sh@940 -- # kill -0 296655 00:25:36.964 23:18:03 -- common/autotest_common.sh@941 -- # uname 00:25:36.964 23:18:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:36.964 23:18:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 296655 00:25:36.964 23:18:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:36.964 23:18:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:36.964 23:18:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 296655' 00:25:36.964 killing process with pid 296655 00:25:36.964 23:18:03 -- common/autotest_common.sh@955 -- # kill 296655 00:25:36.964 23:18:03 -- common/autotest_common.sh@960 -- # wait 296655 00:25:37.222 23:18:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:37.222 23:18:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:37.223 23:18:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:37.223 23:18:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:37.223 23:18:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:37.223 23:18:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:37.223 23:18:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:37.223 23:18:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:39.125 23:18:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:39.125 00:25:39.125 real 0m38.426s 00:25:39.125 user 2m26.841s 00:25:39.125 sys 0m7.402s 00:25:39.125 23:18:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:39.125 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:25:39.125 ************************************ 00:25:39.125 END TEST nvmf_fio_host 00:25:39.125 ************************************ 00:25:39.125 23:18:05 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:39.125 23:18:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:39.125 23:18:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:39.125 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:25:39.125 ************************************ 00:25:39.125 START TEST nvmf_failover 00:25:39.125 ************************************ 00:25:39.125 23:18:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:39.125 * Looking for test storage... 00:25:39.125 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:39.125 23:18:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:39.125 23:18:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:39.125 23:18:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:39.385 23:18:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:39.385 23:18:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:39.385 23:18:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:39.385 23:18:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:39.385 23:18:05 -- scripts/common.sh@335 -- # IFS=.-: 00:25:39.385 23:18:05 -- scripts/common.sh@335 -- # read -ra ver1 00:25:39.385 23:18:05 -- scripts/common.sh@336 -- # IFS=.-: 00:25:39.385 23:18:05 -- scripts/common.sh@336 -- # read -ra ver2 00:25:39.385 23:18:05 -- scripts/common.sh@337 -- # local 'op=<' 00:25:39.385 23:18:05 -- scripts/common.sh@339 -- # ver1_l=2 00:25:39.385 23:18:05 -- scripts/common.sh@340 -- # ver2_l=1 00:25:39.385 23:18:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:39.385 23:18:05 -- scripts/common.sh@343 -- # case "$op" in 00:25:39.385 23:18:05 -- scripts/common.sh@344 -- # : 1 00:25:39.385 23:18:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:39.385 23:18:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:39.385 23:18:05 -- scripts/common.sh@364 -- # decimal 1 00:25:39.385 23:18:05 -- scripts/common.sh@352 -- # local d=1 00:25:39.385 23:18:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:39.385 23:18:05 -- scripts/common.sh@354 -- # echo 1 00:25:39.385 23:18:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:39.385 23:18:05 -- scripts/common.sh@365 -- # decimal 2 00:25:39.385 23:18:05 -- scripts/common.sh@352 -- # local d=2 00:25:39.385 23:18:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:39.385 23:18:05 -- scripts/common.sh@354 -- # echo 2 00:25:39.385 23:18:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:39.385 23:18:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:39.385 23:18:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:39.385 23:18:05 -- scripts/common.sh@367 -- # return 0 00:25:39.385 23:18:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:39.385 23:18:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:39.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.385 --rc genhtml_branch_coverage=1 00:25:39.385 --rc genhtml_function_coverage=1 00:25:39.385 --rc genhtml_legend=1 00:25:39.385 --rc geninfo_all_blocks=1 00:25:39.385 --rc geninfo_unexecuted_blocks=1 00:25:39.385 00:25:39.385 ' 00:25:39.385 23:18:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:39.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.385 --rc genhtml_branch_coverage=1 00:25:39.385 --rc genhtml_function_coverage=1 00:25:39.385 --rc genhtml_legend=1 00:25:39.385 --rc geninfo_all_blocks=1 00:25:39.385 --rc geninfo_unexecuted_blocks=1 00:25:39.385 00:25:39.385 ' 00:25:39.385 23:18:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:39.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.385 --rc genhtml_branch_coverage=1 00:25:39.385 --rc genhtml_function_coverage=1 00:25:39.385 --rc genhtml_legend=1 00:25:39.385 --rc geninfo_all_blocks=1 00:25:39.385 --rc geninfo_unexecuted_blocks=1 00:25:39.385 00:25:39.385 ' 00:25:39.385 23:18:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:39.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.385 --rc genhtml_branch_coverage=1 00:25:39.385 --rc genhtml_function_coverage=1 00:25:39.385 --rc genhtml_legend=1 00:25:39.385 --rc geninfo_all_blocks=1 00:25:39.385 --rc geninfo_unexecuted_blocks=1 00:25:39.385 00:25:39.385 ' 00:25:39.385 23:18:05 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:39.385 23:18:05 -- nvmf/common.sh@7 -- # uname -s 00:25:39.385 23:18:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:39.385 23:18:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:39.385 23:18:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:39.385 23:18:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:39.385 23:18:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:39.385 23:18:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:39.385 23:18:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:39.385 23:18:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:39.385 23:18:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:39.385 23:18:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:39.385 23:18:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:39.385 23:18:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:39.385 23:18:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:39.385 23:18:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:39.385 23:18:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:39.385 23:18:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:39.385 23:18:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:39.385 23:18:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:39.385 23:18:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:39.385 23:18:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.385 23:18:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.385 23:18:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.385 23:18:05 -- paths/export.sh@5 -- # export PATH 00:25:39.385 23:18:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.385 23:18:05 -- nvmf/common.sh@46 -- # : 0 00:25:39.385 23:18:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:39.385 23:18:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:39.386 23:18:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:39.386 23:18:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:39.386 23:18:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:39.386 23:18:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:39.386 23:18:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:39.386 23:18:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:39.386 23:18:05 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:39.386 23:18:05 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:39.386 23:18:05 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:39.386 23:18:05 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:39.386 23:18:05 -- host/failover.sh@18 -- # nvmftestinit 00:25:39.386 23:18:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:39.386 23:18:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:39.386 23:18:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:39.386 23:18:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:39.386 23:18:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:39.386 23:18:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.386 23:18:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.386 23:18:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:39.386 23:18:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:39.386 23:18:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:39.386 23:18:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:39.386 23:18:05 -- common/autotest_common.sh@10 -- # set +x 00:25:41.286 23:18:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:41.286 23:18:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:41.286 23:18:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:41.286 23:18:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:41.286 23:18:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:41.286 23:18:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:41.286 23:18:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:41.286 23:18:07 -- nvmf/common.sh@294 -- # net_devs=() 00:25:41.286 23:18:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:41.286 23:18:07 -- nvmf/common.sh@295 -- # e810=() 00:25:41.286 23:18:07 -- nvmf/common.sh@295 -- # local -ga e810 00:25:41.286 23:18:07 -- nvmf/common.sh@296 -- # x722=() 00:25:41.286 23:18:07 -- nvmf/common.sh@296 -- # local -ga x722 00:25:41.286 23:18:07 -- nvmf/common.sh@297 -- # mlx=() 00:25:41.286 23:18:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:41.286 23:18:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:41.286 23:18:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:41.286 23:18:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:41.287 23:18:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:41.287 23:18:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:41.287 23:18:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:41.287 23:18:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:41.287 23:18:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:41.287 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:41.287 23:18:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:41.287 23:18:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:41.287 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:41.287 23:18:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:41.287 23:18:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:41.287 23:18:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:41.287 23:18:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:41.287 23:18:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:41.287 23:18:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:41.287 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:41.287 23:18:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:41.287 23:18:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:41.287 23:18:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:41.287 23:18:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:41.287 23:18:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:41.287 23:18:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:41.287 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:41.287 23:18:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:41.287 23:18:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:41.287 23:18:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:41.287 23:18:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:41.287 23:18:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:41.287 23:18:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:41.287 23:18:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:41.287 23:18:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:41.287 23:18:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:41.287 23:18:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:41.287 23:18:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:41.287 23:18:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:41.287 23:18:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:41.287 23:18:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:41.287 23:18:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:41.287 23:18:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:41.287 23:18:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:41.287 23:18:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:41.546 23:18:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:41.546 23:18:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:41.546 23:18:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:41.546 23:18:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:41.546 23:18:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:41.546 23:18:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:41.546 23:18:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:41.546 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:41.546 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.306 ms 00:25:41.546 00:25:41.546 --- 10.0.0.2 ping statistics --- 00:25:41.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.546 rtt min/avg/max/mdev = 0.306/0.306/0.306/0.000 ms 00:25:41.546 23:18:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:41.546 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:41.546 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:25:41.546 00:25:41.546 --- 10.0.0.1 ping statistics --- 00:25:41.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.546 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:25:41.546 23:18:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:41.546 23:18:07 -- nvmf/common.sh@410 -- # return 0 00:25:41.546 23:18:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:41.546 23:18:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:41.546 23:18:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:41.546 23:18:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:41.546 23:18:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:41.546 23:18:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:41.546 23:18:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:41.546 23:18:07 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:41.546 23:18:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:41.546 23:18:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:41.546 23:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:41.546 23:18:07 -- nvmf/common.sh@469 -- # nvmfpid=303431 00:25:41.546 23:18:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:41.546 23:18:07 -- nvmf/common.sh@470 -- # waitforlisten 303431 00:25:41.546 23:18:07 -- common/autotest_common.sh@829 -- # '[' -z 303431 ']' 00:25:41.546 23:18:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:41.546 23:18:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:41.546 23:18:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:41.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:41.546 23:18:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:41.546 23:18:07 -- common/autotest_common.sh@10 -- # set +x 00:25:41.546 [2024-11-26 23:18:07.906273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:41.546 [2024-11-26 23:18:07.906374] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:41.804 EAL: No free 2048 kB hugepages reported on node 1 00:25:41.804 [2024-11-26 23:18:07.974801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:41.804 [2024-11-26 23:18:08.081772] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:41.804 [2024-11-26 23:18:08.081947] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:41.804 [2024-11-26 23:18:08.081964] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:41.804 [2024-11-26 23:18:08.081975] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:41.804 [2024-11-26 23:18:08.082062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:41.804 [2024-11-26 23:18:08.082105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:41.804 [2024-11-26 23:18:08.082109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:42.737 23:18:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:42.737 23:18:08 -- common/autotest_common.sh@862 -- # return 0 00:25:42.737 23:18:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:42.737 23:18:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:42.737 23:18:08 -- common/autotest_common.sh@10 -- # set +x 00:25:42.737 23:18:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:42.737 23:18:08 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:42.993 [2024-11-26 23:18:09.134931] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:42.993 23:18:09 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:43.250 Malloc0 00:25:43.250 23:18:09 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:43.508 23:18:09 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:43.767 23:18:09 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:44.025 [2024-11-26 23:18:10.177559] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:44.025 23:18:10 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:44.283 [2024-11-26 23:18:10.430233] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:44.283 23:18:10 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:44.541 [2024-11-26 23:18:10.691151] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:44.541 23:18:10 -- host/failover.sh@31 -- # bdevperf_pid=303935 00:25:44.541 23:18:10 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:44.541 23:18:10 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:44.541 23:18:10 -- host/failover.sh@34 -- # waitforlisten 303935 /var/tmp/bdevperf.sock 00:25:44.541 23:18:10 -- common/autotest_common.sh@829 -- # '[' -z 303935 ']' 00:25:44.541 23:18:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:44.541 23:18:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:44.541 23:18:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:44.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:44.541 23:18:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:44.541 23:18:10 -- common/autotest_common.sh@10 -- # set +x 00:25:45.477 23:18:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:45.477 23:18:11 -- common/autotest_common.sh@862 -- # return 0 00:25:45.477 23:18:11 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:45.735 NVMe0n1 00:25:45.735 23:18:12 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:46.300 00:25:46.300 23:18:12 -- host/failover.sh@39 -- # run_test_pid=304202 00:25:46.300 23:18:12 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:46.300 23:18:12 -- host/failover.sh@41 -- # sleep 1 00:25:47.234 23:18:13 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:47.492 [2024-11-26 23:18:13.643323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.492 [2024-11-26 23:18:13.643722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.643995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 [2024-11-26 23:18:13.644096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb6cb0 is same with the state(5) to be set 00:25:47.493 23:18:13 -- host/failover.sh@45 -- # sleep 3 00:25:50.776 23:18:16 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:50.776 00:25:50.776 23:18:16 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:51.035 [2024-11-26 23:18:17.225135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 [2024-11-26 23:18:17.225567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb83a0 is same with the state(5) to be set 00:25:51.035 23:18:17 -- host/failover.sh@50 -- # sleep 3 00:25:54.534 23:18:20 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:54.534 [2024-11-26 23:18:20.484892] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:54.534 23:18:20 -- host/failover.sh@55 -- # sleep 1 00:25:55.160 23:18:21 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:55.420 [2024-11-26 23:18:21.797422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.797991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.420 [2024-11-26 23:18:21.798003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcb8a80 is same with the state(5) to be set 00:25:55.678 23:18:21 -- host/failover.sh@59 -- # wait 304202 00:26:02.246 0 00:26:02.246 23:18:27 -- host/failover.sh@61 -- # killprocess 303935 00:26:02.246 23:18:27 -- common/autotest_common.sh@936 -- # '[' -z 303935 ']' 00:26:02.246 23:18:27 -- common/autotest_common.sh@940 -- # kill -0 303935 00:26:02.246 23:18:27 -- common/autotest_common.sh@941 -- # uname 00:26:02.246 23:18:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:02.246 23:18:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 303935 00:26:02.246 23:18:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:02.246 23:18:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:02.246 23:18:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 303935' 00:26:02.246 killing process with pid 303935 00:26:02.246 23:18:27 -- common/autotest_common.sh@955 -- # kill 303935 00:26:02.246 23:18:27 -- common/autotest_common.sh@960 -- # wait 303935 00:26:02.246 23:18:27 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:02.246 [2024-11-26 23:18:10.750126] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:02.246 [2024-11-26 23:18:10.750238] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid303935 ] 00:26:02.246 EAL: No free 2048 kB hugepages reported on node 1 00:26:02.246 [2024-11-26 23:18:10.813639] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:02.246 [2024-11-26 23:18:10.921718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:02.246 Running I/O for 15 seconds... 00:26:02.246 [2024-11-26 23:18:13.644403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:116768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.246 [2024-11-26 23:18:13.644444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.246 [2024-11-26 23:18:13.644473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:116776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.246 [2024-11-26 23:18:13.644490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.246 [2024-11-26 23:18:13.644507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:116280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.246 [2024-11-26 23:18:13.644522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.246 [2024-11-26 23:18:13.644547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.246 [2024-11-26 23:18:13.644562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.246 [2024-11-26 23:18:13.644577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:116304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:116312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:116328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:116336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:116344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:116352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:116808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:116832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:116848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:116872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:116880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.644971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:116896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.644984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:116904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:116920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:116928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:116952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:116360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:116368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:116440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:116464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:116984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:117008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:117032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:117048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:117056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:116472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:116496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:116504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:116528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.247 [2024-11-26 23:18:13.645765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:116544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.247 [2024-11-26 23:18:13.645779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.645794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:116552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.645808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.645822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:116584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.645850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.645866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:117064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.645879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.645895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:117072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.645907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.645922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:117080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.645938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.645953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:117088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.645966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.645981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:117096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.645994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:117104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:117112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:117128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:117136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:117144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:117152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:117160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:117168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:117176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:117184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:117200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:117208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:117216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:117224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:117232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:116600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:116608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:116624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:116648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:116656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:117240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:117248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:117256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:117264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:117272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:117280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.248 [2024-11-26 23:18:13.646920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.248 [2024-11-26 23:18:13.646935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:117288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.248 [2024-11-26 23:18:13.646954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.646969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.646982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.646997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:117312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:117320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.647068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:117336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.647124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:117344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:117352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.647180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:117360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.647207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:116680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:116688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:116696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:116704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:116728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:116736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:116744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:116752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:117368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.647464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:117376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.647491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:117384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.647518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:117392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.647575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:117400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:117408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:117416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:117424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:117432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:116760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:116784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:116800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:116816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:116856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:116864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.647984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:116888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.647997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.648012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:117448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.648025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.648039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:117456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.249 [2024-11-26 23:18:13.648052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.648066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:116936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.648078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.648093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:116968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.249 [2024-11-26 23:18:13.648106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.249 [2024-11-26 23:18:13.648120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:116976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:13.648133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:116992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:13.648160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:13.648192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:117016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:13.648219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:117024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:13.648247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x165e6a0 is same with the state(5) to be set 00:26:02.250 [2024-11-26 23:18:13.648283] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:02.250 [2024-11-26 23:18:13.648294] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:02.250 [2024-11-26 23:18:13.648306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117040 len:8 PRP1 0x0 PRP2 0x0 00:26:02.250 [2024-11-26 23:18:13.648318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648377] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x165e6a0 was disconnected and freed. reset controller. 00:26:02.250 [2024-11-26 23:18:13.648403] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:02.250 [2024-11-26 23:18:13.648457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.250 [2024-11-26 23:18:13.648477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648492] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.250 [2024-11-26 23:18:13.648506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648519] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.250 [2024-11-26 23:18:13.648545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648560] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.250 [2024-11-26 23:18:13.648573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:13.648587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.250 [2024-11-26 23:18:13.650989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.250 [2024-11-26 23:18:13.651027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x163f870 (9): Bad file descriptor 00:26:02.250 [2024-11-26 23:18:13.762945] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:02.250 [2024-11-26 23:18:17.225679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:2664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.225755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:2688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.225790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:2696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.225819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:2704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.225848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:2720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.225876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:2744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.225905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:2752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.225947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:2768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.225973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:2792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.225985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:2816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:2216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:2232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:2248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:2264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:2272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:2280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:2328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:2824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:2832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:2352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:2392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:2400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:2416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:2480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.250 [2024-11-26 23:18:17.226460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:2504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.250 [2024-11-26 23:18:17.226476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.226505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:2864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.226556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:2872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.226587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:2880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:2888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.226643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:2904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:2912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:2920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:2928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:2936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.226811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:2944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:2952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:2960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.226939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:2976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.226965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.226980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:2984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.226992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:2992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:3000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.227045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:3008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.227072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:3016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.227099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.227157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:3040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.227186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:3048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:3056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:3064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.251 [2024-11-26 23:18:17.227271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:3072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:3080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:3088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:3096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:3104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.251 [2024-11-26 23:18:17.227417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:3112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.251 [2024-11-26 23:18:17.227430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.227456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:3128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:3136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:3144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:3152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.227591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:3160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.227619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:3168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:3176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.227676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:3184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:3192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:3200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.227758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:3208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:3216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:3224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:3232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.227881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.227908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:3256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.227965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.227979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:3264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.227991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:3280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.228045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:2512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:2528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:2560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:2568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:2616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:2640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:3288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:3296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:3304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.228338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:3312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:3320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.228391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:3336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:3344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.228476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:3352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.228503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:3360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.252 [2024-11-26 23:18:17.228554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.252 [2024-11-26 23:18:17.228568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:3368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.252 [2024-11-26 23:18:17.228581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:3376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.253 [2024-11-26 23:18:17.228608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:3384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.228635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:3392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.228667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:3400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.228695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:3408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.228723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:3416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.228750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:3424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.253 [2024-11-26 23:18:17.228777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:3432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.253 [2024-11-26 23:18:17.228804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:3440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.253 [2024-11-26 23:18:17.228847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:3448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.228874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:3456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.253 [2024-11-26 23:18:17.228900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:3464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.253 [2024-11-26 23:18:17.228934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:3472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.228960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.228979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:3480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.228992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:3488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:2656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:2672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:2680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:2712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:2728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:2736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:2760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:2776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:2800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:2808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:2840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.253 [2024-11-26 23:18:17.229342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x164bd10 is same with the state(5) to be set 00:26:02.253 [2024-11-26 23:18:17.229379] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:02.253 [2024-11-26 23:18:17.229390] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:02.253 [2024-11-26 23:18:17.229400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2848 len:8 PRP1 0x0 PRP2 0x0 00:26:02.253 [2024-11-26 23:18:17.229417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229474] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x164bd10 was disconnected and freed. reset controller. 00:26:02.253 [2024-11-26 23:18:17.229491] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:26:02.253 [2024-11-26 23:18:17.229544] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.253 [2024-11-26 23:18:17.229564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229580] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.253 [2024-11-26 23:18:17.229599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229622] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.253 [2024-11-26 23:18:17.229636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.253 [2024-11-26 23:18:17.229662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:17.229676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.253 [2024-11-26 23:18:17.229728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x163f870 (9): Bad file descriptor 00:26:02.253 [2024-11-26 23:18:17.231937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.253 [2024-11-26 23:18:17.385806] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:02.253 [2024-11-26 23:18:21.797822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.253 [2024-11-26 23:18:21.797866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:21.797885] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.253 [2024-11-26 23:18:21.797900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:21.797914] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.253 [2024-11-26 23:18:21.797929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.253 [2024-11-26 23:18:21.797943] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:02.253 [2024-11-26 23:18:21.797956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.797971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x163f870 is same with the state(5) to be set 00:26:02.254 [2024-11-26 23:18:21.798114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:10392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:10408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:9744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:9752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:9776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:9800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:9848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:9856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:10440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:10448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:10480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:10496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:10520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:10528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:10552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:10560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:10568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:9904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:9936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:9944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:9952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:9968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:9984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:10008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.798974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:10016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.798987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.254 [2024-11-26 23:18:21.799015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:10608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.799042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:10616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.799070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.799097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:10632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.799124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:10640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.254 [2024-11-26 23:18:21.799152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:10648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.254 [2024-11-26 23:18:21.799179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:10656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.254 [2024-11-26 23:18:21.799206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.254 [2024-11-26 23:18:21.799233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:10672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.254 [2024-11-26 23:18:21.799260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.254 [2024-11-26 23:18:21.799279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:10680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.799292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:10688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:10696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:10712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:10720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.799428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:10728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.799456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:10032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:10048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:10072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:10088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:10096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:10104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:10112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:10736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:10744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.799767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:10752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.799796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:10760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.799840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:10776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:10784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:10792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.799980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.799994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:10160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.800007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:10176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.800039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:10200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.800067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:10208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.800095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:10240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.800123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:10248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.800151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:10256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.800178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:10800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.255 [2024-11-26 23:18:21.800206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:10808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.800233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:10816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.800261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:10824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.255 [2024-11-26 23:18:21.800289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.255 [2024-11-26 23:18:21.800303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:10832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:10272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:10312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:10320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:10336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:10352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:10360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:10840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:10848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:10856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:10864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:10880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:10888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:10904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:10912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:10920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.800900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:10928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:10936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:10944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.800983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.800997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:10952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.801010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.801025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:10960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.801037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.801052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:10968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.256 [2024-11-26 23:18:21.801065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.801079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:10976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.801092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.801107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:10984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.801120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.801138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:10992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.801152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.801167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:11000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.801180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.801194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:11008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.256 [2024-11-26 23:18:21.801207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.256 [2024-11-26 23:18:21.801222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:11016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.257 [2024-11-26 23:18:21.801235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:11024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.257 [2024-11-26 23:18:21.801262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:10376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:10384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:10400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:10416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:10424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:10432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:10456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:10464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:11032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.257 [2024-11-26 23:18:21.801520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:11040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:11048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:11064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:02.257 [2024-11-26 23:18:21.801658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:11072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:10472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:10504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:10512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:10536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:10544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:10576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:02.257 [2024-11-26 23:18:21.801909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.801923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1662630 is same with the state(5) to be set 00:26:02.257 [2024-11-26 23:18:21.801940] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:02.257 [2024-11-26 23:18:21.801950] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:02.257 [2024-11-26 23:18:21.801961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10592 len:8 PRP1 0x0 PRP2 0x0 00:26:02.257 [2024-11-26 23:18:21.801973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:02.257 [2024-11-26 23:18:21.802038] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1662630 was disconnected and freed. reset controller. 00:26:02.257 [2024-11-26 23:18:21.802056] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:26:02.257 [2024-11-26 23:18:21.802089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.257 [2024-11-26 23:18:21.804188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.257 [2024-11-26 23:18:21.804231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x163f870 (9): Bad file descriptor 00:26:02.257 [2024-11-26 23:18:21.838955] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:02.257 00:26:02.257 Latency(us) 00:26:02.257 [2024-11-26T22:18:28.651Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:02.257 [2024-11-26T22:18:28.651Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:02.257 Verification LBA range: start 0x0 length 0x4000 00:26:02.257 NVMe0n1 : 15.01 12648.75 49.41 1164.12 0.00 9250.00 612.88 16505.36 00:26:02.257 [2024-11-26T22:18:28.651Z] =================================================================================================================== 00:26:02.257 [2024-11-26T22:18:28.651Z] Total : 12648.75 49.41 1164.12 0.00 9250.00 612.88 16505.36 00:26:02.257 Received shutdown signal, test time was about 15.000000 seconds 00:26:02.257 00:26:02.257 Latency(us) 00:26:02.257 [2024-11-26T22:18:28.651Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:02.257 [2024-11-26T22:18:28.651Z] =================================================================================================================== 00:26:02.257 [2024-11-26T22:18:28.651Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:02.257 23:18:27 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:26:02.257 23:18:27 -- host/failover.sh@65 -- # count=3 00:26:02.257 23:18:27 -- host/failover.sh@67 -- # (( count != 3 )) 00:26:02.257 23:18:27 -- host/failover.sh@73 -- # bdevperf_pid=306132 00:26:02.257 23:18:27 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:26:02.257 23:18:27 -- host/failover.sh@75 -- # waitforlisten 306132 /var/tmp/bdevperf.sock 00:26:02.257 23:18:27 -- common/autotest_common.sh@829 -- # '[' -z 306132 ']' 00:26:02.257 23:18:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:02.257 23:18:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:02.257 23:18:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:02.257 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:02.257 23:18:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:02.257 23:18:27 -- common/autotest_common.sh@10 -- # set +x 00:26:02.515 23:18:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:02.515 23:18:28 -- common/autotest_common.sh@862 -- # return 0 00:26:02.515 23:18:28 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:02.773 [2024-11-26 23:18:29.090187] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:02.773 23:18:29 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:03.030 [2024-11-26 23:18:29.342918] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:26:03.030 23:18:29 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:03.595 NVMe0n1 00:26:03.595 23:18:29 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:03.854 00:26:03.854 23:18:30 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:04.419 00:26:04.419 23:18:30 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:04.419 23:18:30 -- host/failover.sh@82 -- # grep -q NVMe0 00:26:04.678 23:18:30 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:04.936 23:18:31 -- host/failover.sh@87 -- # sleep 3 00:26:08.214 23:18:34 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:08.214 23:18:34 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:08.214 23:18:34 -- host/failover.sh@90 -- # run_test_pid=306863 00:26:08.214 23:18:34 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:08.214 23:18:34 -- host/failover.sh@92 -- # wait 306863 00:26:09.588 0 00:26:09.588 23:18:35 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:09.588 [2024-11-26 23:18:27.891798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:09.588 [2024-11-26 23:18:27.891913] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid306132 ] 00:26:09.588 EAL: No free 2048 kB hugepages reported on node 1 00:26:09.588 [2024-11-26 23:18:27.951395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:09.588 [2024-11-26 23:18:28.055385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:09.588 [2024-11-26 23:18:31.162296] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:09.588 [2024-11-26 23:18:31.162377] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.588 [2024-11-26 23:18:31.162400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.588 [2024-11-26 23:18:31.162432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.588 [2024-11-26 23:18:31.162456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.588 [2024-11-26 23:18:31.162470] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.588 [2024-11-26 23:18:31.162484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.588 [2024-11-26 23:18:31.162498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.588 [2024-11-26 23:18:31.162511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.588 [2024-11-26 23:18:31.162533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:09.588 [2024-11-26 23:18:31.162607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:09.588 [2024-11-26 23:18:31.162638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x249f870 (9): Bad file descriptor 00:26:09.588 [2024-11-26 23:18:31.172368] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:09.588 Running I/O for 1 seconds... 00:26:09.588 00:26:09.588 Latency(us) 00:26:09.588 [2024-11-26T22:18:35.982Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:09.588 [2024-11-26T22:18:35.982Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:09.588 Verification LBA range: start 0x0 length 0x4000 00:26:09.588 NVMe0n1 : 1.01 12640.87 49.38 0.00 0.00 10083.06 1377.47 15728.64 00:26:09.588 [2024-11-26T22:18:35.982Z] =================================================================================================================== 00:26:09.588 [2024-11-26T22:18:35.982Z] Total : 12640.87 49.38 0.00 0.00 10083.06 1377.47 15728.64 00:26:09.588 23:18:35 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:09.588 23:18:35 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:09.588 23:18:35 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:09.845 23:18:36 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:09.846 23:18:36 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:10.113 23:18:36 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:10.370 23:18:36 -- host/failover.sh@101 -- # sleep 3 00:26:13.669 23:18:39 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:13.669 23:18:39 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:13.669 23:18:39 -- host/failover.sh@108 -- # killprocess 306132 00:26:13.669 23:18:39 -- common/autotest_common.sh@936 -- # '[' -z 306132 ']' 00:26:13.669 23:18:39 -- common/autotest_common.sh@940 -- # kill -0 306132 00:26:13.669 23:18:39 -- common/autotest_common.sh@941 -- # uname 00:26:13.669 23:18:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:13.669 23:18:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 306132 00:26:13.669 23:18:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:13.669 23:18:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:13.669 23:18:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 306132' 00:26:13.669 killing process with pid 306132 00:26:13.669 23:18:39 -- common/autotest_common.sh@955 -- # kill 306132 00:26:13.669 23:18:39 -- common/autotest_common.sh@960 -- # wait 306132 00:26:13.928 23:18:40 -- host/failover.sh@110 -- # sync 00:26:13.928 23:18:40 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:14.187 23:18:40 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:14.187 23:18:40 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:14.187 23:18:40 -- host/failover.sh@116 -- # nvmftestfini 00:26:14.187 23:18:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:14.187 23:18:40 -- nvmf/common.sh@116 -- # sync 00:26:14.187 23:18:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:14.187 23:18:40 -- nvmf/common.sh@119 -- # set +e 00:26:14.187 23:18:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:14.187 23:18:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:14.187 rmmod nvme_tcp 00:26:14.187 rmmod nvme_fabrics 00:26:14.187 rmmod nvme_keyring 00:26:14.187 23:18:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:14.187 23:18:40 -- nvmf/common.sh@123 -- # set -e 00:26:14.187 23:18:40 -- nvmf/common.sh@124 -- # return 0 00:26:14.187 23:18:40 -- nvmf/common.sh@477 -- # '[' -n 303431 ']' 00:26:14.187 23:18:40 -- nvmf/common.sh@478 -- # killprocess 303431 00:26:14.187 23:18:40 -- common/autotest_common.sh@936 -- # '[' -z 303431 ']' 00:26:14.187 23:18:40 -- common/autotest_common.sh@940 -- # kill -0 303431 00:26:14.187 23:18:40 -- common/autotest_common.sh@941 -- # uname 00:26:14.187 23:18:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:14.187 23:18:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 303431 00:26:14.187 23:18:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:14.187 23:18:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:14.187 23:18:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 303431' 00:26:14.187 killing process with pid 303431 00:26:14.187 23:18:40 -- common/autotest_common.sh@955 -- # kill 303431 00:26:14.187 23:18:40 -- common/autotest_common.sh@960 -- # wait 303431 00:26:14.754 23:18:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:14.754 23:18:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:14.754 23:18:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:14.754 23:18:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:14.754 23:18:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:14.754 23:18:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:14.754 23:18:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:14.754 23:18:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:16.658 23:18:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:16.658 00:26:16.658 real 0m37.474s 00:26:16.658 user 2m11.793s 00:26:16.658 sys 0m6.247s 00:26:16.658 23:18:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:16.658 23:18:42 -- common/autotest_common.sh@10 -- # set +x 00:26:16.658 ************************************ 00:26:16.658 END TEST nvmf_failover 00:26:16.658 ************************************ 00:26:16.658 23:18:42 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:16.658 23:18:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:16.658 23:18:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:16.658 23:18:42 -- common/autotest_common.sh@10 -- # set +x 00:26:16.658 ************************************ 00:26:16.658 START TEST nvmf_discovery 00:26:16.658 ************************************ 00:26:16.658 23:18:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:16.658 * Looking for test storage... 00:26:16.658 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:16.658 23:18:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:16.658 23:18:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:16.658 23:18:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:16.918 23:18:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:16.918 23:18:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:16.918 23:18:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:16.918 23:18:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:16.918 23:18:43 -- scripts/common.sh@335 -- # IFS=.-: 00:26:16.918 23:18:43 -- scripts/common.sh@335 -- # read -ra ver1 00:26:16.918 23:18:43 -- scripts/common.sh@336 -- # IFS=.-: 00:26:16.918 23:18:43 -- scripts/common.sh@336 -- # read -ra ver2 00:26:16.918 23:18:43 -- scripts/common.sh@337 -- # local 'op=<' 00:26:16.918 23:18:43 -- scripts/common.sh@339 -- # ver1_l=2 00:26:16.918 23:18:43 -- scripts/common.sh@340 -- # ver2_l=1 00:26:16.918 23:18:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:16.918 23:18:43 -- scripts/common.sh@343 -- # case "$op" in 00:26:16.918 23:18:43 -- scripts/common.sh@344 -- # : 1 00:26:16.918 23:18:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:16.918 23:18:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:16.918 23:18:43 -- scripts/common.sh@364 -- # decimal 1 00:26:16.918 23:18:43 -- scripts/common.sh@352 -- # local d=1 00:26:16.918 23:18:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:16.918 23:18:43 -- scripts/common.sh@354 -- # echo 1 00:26:16.918 23:18:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:16.918 23:18:43 -- scripts/common.sh@365 -- # decimal 2 00:26:16.918 23:18:43 -- scripts/common.sh@352 -- # local d=2 00:26:16.918 23:18:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:16.918 23:18:43 -- scripts/common.sh@354 -- # echo 2 00:26:16.918 23:18:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:16.918 23:18:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:16.918 23:18:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:16.918 23:18:43 -- scripts/common.sh@367 -- # return 0 00:26:16.918 23:18:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:16.918 23:18:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:16.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:16.918 --rc genhtml_branch_coverage=1 00:26:16.918 --rc genhtml_function_coverage=1 00:26:16.918 --rc genhtml_legend=1 00:26:16.918 --rc geninfo_all_blocks=1 00:26:16.918 --rc geninfo_unexecuted_blocks=1 00:26:16.918 00:26:16.918 ' 00:26:16.918 23:18:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:16.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:16.918 --rc genhtml_branch_coverage=1 00:26:16.918 --rc genhtml_function_coverage=1 00:26:16.918 --rc genhtml_legend=1 00:26:16.918 --rc geninfo_all_blocks=1 00:26:16.918 --rc geninfo_unexecuted_blocks=1 00:26:16.918 00:26:16.918 ' 00:26:16.918 23:18:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:16.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:16.918 --rc genhtml_branch_coverage=1 00:26:16.918 --rc genhtml_function_coverage=1 00:26:16.918 --rc genhtml_legend=1 00:26:16.918 --rc geninfo_all_blocks=1 00:26:16.918 --rc geninfo_unexecuted_blocks=1 00:26:16.918 00:26:16.918 ' 00:26:16.918 23:18:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:16.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:16.918 --rc genhtml_branch_coverage=1 00:26:16.918 --rc genhtml_function_coverage=1 00:26:16.918 --rc genhtml_legend=1 00:26:16.918 --rc geninfo_all_blocks=1 00:26:16.918 --rc geninfo_unexecuted_blocks=1 00:26:16.918 00:26:16.918 ' 00:26:16.918 23:18:43 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:16.918 23:18:43 -- nvmf/common.sh@7 -- # uname -s 00:26:16.918 23:18:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:16.918 23:18:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:16.918 23:18:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:16.918 23:18:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:16.918 23:18:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:16.918 23:18:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:16.918 23:18:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:16.918 23:18:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:16.918 23:18:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:16.918 23:18:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:16.918 23:18:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:16.918 23:18:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:16.918 23:18:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:16.918 23:18:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:16.918 23:18:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:16.918 23:18:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:16.918 23:18:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:16.918 23:18:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:16.918 23:18:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:16.918 23:18:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:16.918 23:18:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:16.918 23:18:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:16.918 23:18:43 -- paths/export.sh@5 -- # export PATH 00:26:16.918 23:18:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:16.918 23:18:43 -- nvmf/common.sh@46 -- # : 0 00:26:16.918 23:18:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:16.918 23:18:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:16.918 23:18:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:16.918 23:18:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:16.918 23:18:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:16.918 23:18:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:16.918 23:18:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:16.918 23:18:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:16.918 23:18:43 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:16.918 23:18:43 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:16.918 23:18:43 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:16.919 23:18:43 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:16.919 23:18:43 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:16.919 23:18:43 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:16.919 23:18:43 -- host/discovery.sh@25 -- # nvmftestinit 00:26:16.919 23:18:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:16.919 23:18:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:16.919 23:18:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:16.919 23:18:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:16.919 23:18:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:16.919 23:18:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:16.919 23:18:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:16.919 23:18:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:16.919 23:18:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:16.919 23:18:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:16.919 23:18:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:16.919 23:18:43 -- common/autotest_common.sh@10 -- # set +x 00:26:18.823 23:18:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:18.823 23:18:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:18.823 23:18:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:18.823 23:18:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:18.823 23:18:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:18.823 23:18:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:18.823 23:18:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:18.823 23:18:45 -- nvmf/common.sh@294 -- # net_devs=() 00:26:18.823 23:18:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:18.823 23:18:45 -- nvmf/common.sh@295 -- # e810=() 00:26:18.823 23:18:45 -- nvmf/common.sh@295 -- # local -ga e810 00:26:18.823 23:18:45 -- nvmf/common.sh@296 -- # x722=() 00:26:18.823 23:18:45 -- nvmf/common.sh@296 -- # local -ga x722 00:26:18.823 23:18:45 -- nvmf/common.sh@297 -- # mlx=() 00:26:18.823 23:18:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:18.823 23:18:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:18.823 23:18:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:18.823 23:18:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:18.823 23:18:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:18.823 23:18:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:18.823 23:18:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:18.823 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:18.823 23:18:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:18.823 23:18:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:18.823 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:18.823 23:18:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:18.823 23:18:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:18.823 23:18:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:18.823 23:18:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:18.823 23:18:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:18.823 23:18:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:18.823 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:18.823 23:18:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:18.823 23:18:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:18.823 23:18:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:18.823 23:18:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:18.823 23:18:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:18.823 23:18:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:18.823 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:18.823 23:18:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:18.823 23:18:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:18.823 23:18:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:18.823 23:18:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:18.823 23:18:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:18.823 23:18:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:18.823 23:18:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:18.823 23:18:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:18.823 23:18:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:18.823 23:18:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:18.823 23:18:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:18.823 23:18:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:18.824 23:18:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:18.824 23:18:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:18.824 23:18:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:18.824 23:18:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:18.824 23:18:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:18.824 23:18:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:19.086 23:18:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:19.086 23:18:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:19.086 23:18:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:19.086 23:18:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:19.086 23:18:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:19.086 23:18:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:19.086 23:18:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:19.086 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:19.086 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:26:19.086 00:26:19.086 --- 10.0.0.2 ping statistics --- 00:26:19.086 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:19.086 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:26:19.086 23:18:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:19.086 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:19.086 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.065 ms 00:26:19.086 00:26:19.086 --- 10.0.0.1 ping statistics --- 00:26:19.086 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:19.086 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:26:19.086 23:18:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:19.086 23:18:45 -- nvmf/common.sh@410 -- # return 0 00:26:19.086 23:18:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:19.086 23:18:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:19.086 23:18:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:19.086 23:18:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:19.086 23:18:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:19.086 23:18:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:19.086 23:18:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:19.086 23:18:45 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:19.086 23:18:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:19.086 23:18:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:19.086 23:18:45 -- common/autotest_common.sh@10 -- # set +x 00:26:19.086 23:18:45 -- nvmf/common.sh@469 -- # nvmfpid=309599 00:26:19.086 23:18:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:19.086 23:18:45 -- nvmf/common.sh@470 -- # waitforlisten 309599 00:26:19.086 23:18:45 -- common/autotest_common.sh@829 -- # '[' -z 309599 ']' 00:26:19.086 23:18:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:19.086 23:18:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:19.086 23:18:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:19.086 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:19.086 23:18:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:19.086 23:18:45 -- common/autotest_common.sh@10 -- # set +x 00:26:19.086 [2024-11-26 23:18:45.395689] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:19.086 [2024-11-26 23:18:45.395778] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:19.086 EAL: No free 2048 kB hugepages reported on node 1 00:26:19.086 [2024-11-26 23:18:45.461338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:19.344 [2024-11-26 23:18:45.566728] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:19.344 [2024-11-26 23:18:45.566877] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:19.344 [2024-11-26 23:18:45.566895] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:19.344 [2024-11-26 23:18:45.566908] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:19.344 [2024-11-26 23:18:45.566933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:20.279 23:18:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:20.279 23:18:46 -- common/autotest_common.sh@862 -- # return 0 00:26:20.279 23:18:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:20.279 23:18:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:20.279 23:18:46 -- common/autotest_common.sh@10 -- # set +x 00:26:20.279 23:18:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:20.279 23:18:46 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:20.279 23:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.279 23:18:46 -- common/autotest_common.sh@10 -- # set +x 00:26:20.279 [2024-11-26 23:18:46.429226] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:20.279 23:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.279 23:18:46 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:20.279 23:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.279 23:18:46 -- common/autotest_common.sh@10 -- # set +x 00:26:20.279 [2024-11-26 23:18:46.437408] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:20.279 23:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.279 23:18:46 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:20.279 23:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.279 23:18:46 -- common/autotest_common.sh@10 -- # set +x 00:26:20.279 null0 00:26:20.279 23:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.279 23:18:46 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:20.279 23:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.279 23:18:46 -- common/autotest_common.sh@10 -- # set +x 00:26:20.279 null1 00:26:20.279 23:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.279 23:18:46 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:20.279 23:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.279 23:18:46 -- common/autotest_common.sh@10 -- # set +x 00:26:20.279 23:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.279 23:18:46 -- host/discovery.sh@45 -- # hostpid=309757 00:26:20.279 23:18:46 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:20.279 23:18:46 -- host/discovery.sh@46 -- # waitforlisten 309757 /tmp/host.sock 00:26:20.279 23:18:46 -- common/autotest_common.sh@829 -- # '[' -z 309757 ']' 00:26:20.279 23:18:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:20.279 23:18:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:20.279 23:18:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:20.279 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:20.279 23:18:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:20.279 23:18:46 -- common/autotest_common.sh@10 -- # set +x 00:26:20.279 [2024-11-26 23:18:46.502935] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:20.279 [2024-11-26 23:18:46.502997] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid309757 ] 00:26:20.279 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.279 [2024-11-26 23:18:46.564487] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:20.538 [2024-11-26 23:18:46.679204] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:20.538 [2024-11-26 23:18:46.679373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:21.472 23:18:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:21.472 23:18:47 -- common/autotest_common.sh@862 -- # return 0 00:26:21.472 23:18:47 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:21.472 23:18:47 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@72 -- # notify_id=0 00:26:21.472 23:18:47 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # sort 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # xargs 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:21.472 23:18:47 -- host/discovery.sh@79 -- # get_bdev_list 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # sort 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # xargs 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:21.472 23:18:47 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # sort 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # xargs 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:21.472 23:18:47 -- host/discovery.sh@83 -- # get_bdev_list 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # sort 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # xargs 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:21.472 23:18:47 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # sort 00:26:21.472 23:18:47 -- host/discovery.sh@59 -- # xargs 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:21.472 23:18:47 -- host/discovery.sh@87 -- # get_bdev_list 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:21.472 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.472 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # sort 00:26:21.472 23:18:47 -- host/discovery.sh@55 -- # xargs 00:26:21.472 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.472 23:18:47 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:21.473 23:18:47 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:21.473 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.473 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.473 [2024-11-26 23:18:47.777120] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:21.473 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.473 23:18:47 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:21.473 23:18:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:21.473 23:18:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:21.473 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.473 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.473 23:18:47 -- host/discovery.sh@59 -- # sort 00:26:21.473 23:18:47 -- host/discovery.sh@59 -- # xargs 00:26:21.473 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.473 23:18:47 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:21.473 23:18:47 -- host/discovery.sh@93 -- # get_bdev_list 00:26:21.473 23:18:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:21.473 23:18:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:21.473 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.473 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.473 23:18:47 -- host/discovery.sh@55 -- # sort 00:26:21.473 23:18:47 -- host/discovery.sh@55 -- # xargs 00:26:21.473 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.473 23:18:47 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:21.473 23:18:47 -- host/discovery.sh@94 -- # get_notification_count 00:26:21.473 23:18:47 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:21.473 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.473 23:18:47 -- host/discovery.sh@74 -- # jq '. | length' 00:26:21.473 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.730 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.730 23:18:47 -- host/discovery.sh@74 -- # notification_count=0 00:26:21.730 23:18:47 -- host/discovery.sh@75 -- # notify_id=0 00:26:21.730 23:18:47 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:21.730 23:18:47 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:21.730 23:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.730 23:18:47 -- common/autotest_common.sh@10 -- # set +x 00:26:21.730 23:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.730 23:18:47 -- host/discovery.sh@100 -- # sleep 1 00:26:22.295 [2024-11-26 23:18:48.589690] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:22.295 [2024-11-26 23:18:48.589721] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:22.295 [2024-11-26 23:18:48.589757] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:22.295 [2024-11-26 23:18:48.677061] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:22.553 [2024-11-26 23:18:48.780992] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:22.553 [2024-11-26 23:18:48.781019] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:22.553 23:18:48 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:22.553 23:18:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:22.553 23:18:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:22.553 23:18:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.553 23:18:48 -- common/autotest_common.sh@10 -- # set +x 00:26:22.553 23:18:48 -- host/discovery.sh@59 -- # sort 00:26:22.553 23:18:48 -- host/discovery.sh@59 -- # xargs 00:26:22.553 23:18:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.811 23:18:48 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:22.811 23:18:48 -- host/discovery.sh@102 -- # get_bdev_list 00:26:22.811 23:18:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.811 23:18:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.811 23:18:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.811 23:18:48 -- host/discovery.sh@55 -- # sort 00:26:22.811 23:18:48 -- common/autotest_common.sh@10 -- # set +x 00:26:22.811 23:18:48 -- host/discovery.sh@55 -- # xargs 00:26:22.811 23:18:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.811 23:18:48 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:22.811 23:18:48 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:22.811 23:18:48 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:22.811 23:18:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.811 23:18:48 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:22.811 23:18:48 -- common/autotest_common.sh@10 -- # set +x 00:26:22.811 23:18:48 -- host/discovery.sh@63 -- # sort -n 00:26:22.811 23:18:48 -- host/discovery.sh@63 -- # xargs 00:26:22.811 23:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.811 23:18:49 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:22.811 23:18:49 -- host/discovery.sh@104 -- # get_notification_count 00:26:22.811 23:18:49 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:22.811 23:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.811 23:18:49 -- common/autotest_common.sh@10 -- # set +x 00:26:22.811 23:18:49 -- host/discovery.sh@74 -- # jq '. | length' 00:26:22.811 23:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.811 23:18:49 -- host/discovery.sh@74 -- # notification_count=1 00:26:22.811 23:18:49 -- host/discovery.sh@75 -- # notify_id=1 00:26:22.811 23:18:49 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:22.811 23:18:49 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:22.811 23:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.811 23:18:49 -- common/autotest_common.sh@10 -- # set +x 00:26:22.811 23:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.811 23:18:49 -- host/discovery.sh@109 -- # sleep 1 00:26:23.745 23:18:50 -- host/discovery.sh@110 -- # get_bdev_list 00:26:23.745 23:18:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:23.745 23:18:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:23.745 23:18:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.745 23:18:50 -- common/autotest_common.sh@10 -- # set +x 00:26:23.745 23:18:50 -- host/discovery.sh@55 -- # sort 00:26:23.745 23:18:50 -- host/discovery.sh@55 -- # xargs 00:26:23.745 23:18:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.745 23:18:50 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:23.745 23:18:50 -- host/discovery.sh@111 -- # get_notification_count 00:26:23.745 23:18:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:23.745 23:18:50 -- host/discovery.sh@74 -- # jq '. | length' 00:26:23.745 23:18:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.745 23:18:50 -- common/autotest_common.sh@10 -- # set +x 00:26:24.003 23:18:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.004 23:18:50 -- host/discovery.sh@74 -- # notification_count=1 00:26:24.004 23:18:50 -- host/discovery.sh@75 -- # notify_id=2 00:26:24.004 23:18:50 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:24.004 23:18:50 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:24.004 23:18:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.004 23:18:50 -- common/autotest_common.sh@10 -- # set +x 00:26:24.004 [2024-11-26 23:18:50.176388] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:24.004 [2024-11-26 23:18:50.177030] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:24.004 [2024-11-26 23:18:50.177073] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:24.004 23:18:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.004 23:18:50 -- host/discovery.sh@117 -- # sleep 1 00:26:24.004 [2024-11-26 23:18:50.263257] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:24.004 [2024-11-26 23:18:50.324910] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:24.004 [2024-11-26 23:18:50.324933] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:24.004 [2024-11-26 23:18:50.324941] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:24.936 23:18:51 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:24.936 23:18:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:24.936 23:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.936 23:18:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:24.936 23:18:51 -- common/autotest_common.sh@10 -- # set +x 00:26:24.936 23:18:51 -- host/discovery.sh@59 -- # sort 00:26:24.936 23:18:51 -- host/discovery.sh@59 -- # xargs 00:26:24.936 23:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.936 23:18:51 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:24.936 23:18:51 -- host/discovery.sh@119 -- # get_bdev_list 00:26:24.936 23:18:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.936 23:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.936 23:18:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:24.936 23:18:51 -- common/autotest_common.sh@10 -- # set +x 00:26:24.936 23:18:51 -- host/discovery.sh@55 -- # sort 00:26:24.936 23:18:51 -- host/discovery.sh@55 -- # xargs 00:26:24.936 23:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.936 23:18:51 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:24.936 23:18:51 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:24.936 23:18:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:24.936 23:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.937 23:18:51 -- common/autotest_common.sh@10 -- # set +x 00:26:24.937 23:18:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:24.937 23:18:51 -- host/discovery.sh@63 -- # sort -n 00:26:24.937 23:18:51 -- host/discovery.sh@63 -- # xargs 00:26:24.937 23:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.937 23:18:51 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:24.937 23:18:51 -- host/discovery.sh@121 -- # get_notification_count 00:26:24.937 23:18:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:24.937 23:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.937 23:18:51 -- host/discovery.sh@74 -- # jq '. | length' 00:26:24.937 23:18:51 -- common/autotest_common.sh@10 -- # set +x 00:26:24.937 23:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.195 23:18:51 -- host/discovery.sh@74 -- # notification_count=0 00:26:25.195 23:18:51 -- host/discovery.sh@75 -- # notify_id=2 00:26:25.195 23:18:51 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:25.195 23:18:51 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:25.195 23:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.195 23:18:51 -- common/autotest_common.sh@10 -- # set +x 00:26:25.195 [2024-11-26 23:18:51.344285] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:25.195 [2024-11-26 23:18:51.344328] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:25.195 [2024-11-26 23:18:51.344435] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:25.195 [2024-11-26 23:18:51.344467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:25.195 [2024-11-26 23:18:51.344493] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:25.195 [2024-11-26 23:18:51.344508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:25.195 [2024-11-26 23:18:51.344523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:25.195 [2024-11-26 23:18:51.344547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:25.195 [2024-11-26 23:18:51.344578] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:25.195 [2024-11-26 23:18:51.344592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:25.195 [2024-11-26 23:18:51.344605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa44810 is same with the state(5) to be set 00:26:25.195 23:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.195 23:18:51 -- host/discovery.sh@127 -- # sleep 1 00:26:25.195 [2024-11-26 23:18:51.354432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa44810 (9): Bad file descriptor 00:26:25.195 [2024-11-26 23:18:51.364481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:25.195 [2024-11-26 23:18:51.364700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.195 [2024-11-26 23:18:51.364839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.195 [2024-11-26 23:18:51.364866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa44810 with addr=10.0.0.2, port=4420 00:26:25.195 [2024-11-26 23:18:51.364882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa44810 is same with the state(5) to be set 00:26:25.195 [2024-11-26 23:18:51.364921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa44810 (9): Bad file descriptor 00:26:25.195 [2024-11-26 23:18:51.364960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:25.195 [2024-11-26 23:18:51.364979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:25.195 [2024-11-26 23:18:51.364997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:25.195 [2024-11-26 23:18:51.365019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:25.195 [2024-11-26 23:18:51.374583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:25.195 [2024-11-26 23:18:51.374841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.195 [2024-11-26 23:18:51.374975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.195 [2024-11-26 23:18:51.375005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa44810 with addr=10.0.0.2, port=4420 00:26:25.195 [2024-11-26 23:18:51.375022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa44810 is same with the state(5) to be set 00:26:25.195 [2024-11-26 23:18:51.375048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa44810 (9): Bad file descriptor 00:26:25.195 [2024-11-26 23:18:51.375071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:25.195 [2024-11-26 23:18:51.375093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:25.195 [2024-11-26 23:18:51.375109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:25.195 [2024-11-26 23:18:51.375130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:25.195 [2024-11-26 23:18:51.384653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:25.195 [2024-11-26 23:18:51.384789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.195 [2024-11-26 23:18:51.384929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.195 [2024-11-26 23:18:51.384972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa44810 with addr=10.0.0.2, port=4420 00:26:25.195 [2024-11-26 23:18:51.384988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa44810 is same with the state(5) to be set 00:26:25.195 [2024-11-26 23:18:51.385010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa44810 (9): Bad file descriptor 00:26:25.195 [2024-11-26 23:18:51.385042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:25.196 [2024-11-26 23:18:51.385058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:25.196 [2024-11-26 23:18:51.385072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:25.196 [2024-11-26 23:18:51.385091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:25.196 [2024-11-26 23:18:51.394735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:25.196 [2024-11-26 23:18:51.394996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.196 [2024-11-26 23:18:51.395128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.196 [2024-11-26 23:18:51.395157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa44810 with addr=10.0.0.2, port=4420 00:26:25.196 [2024-11-26 23:18:51.395174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa44810 is same with the state(5) to be set 00:26:25.196 [2024-11-26 23:18:51.395199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa44810 (9): Bad file descriptor 00:26:25.196 [2024-11-26 23:18:51.395221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:25.196 [2024-11-26 23:18:51.395236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:25.196 [2024-11-26 23:18:51.395251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:25.196 [2024-11-26 23:18:51.395272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:25.196 [2024-11-26 23:18:51.404810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:25.196 [2024-11-26 23:18:51.405008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.196 [2024-11-26 23:18:51.405471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.196 [2024-11-26 23:18:51.405500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa44810 with addr=10.0.0.2, port=4420 00:26:25.196 [2024-11-26 23:18:51.405517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa44810 is same with the state(5) to be set 00:26:25.196 [2024-11-26 23:18:51.405563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa44810 (9): Bad file descriptor 00:26:25.196 [2024-11-26 23:18:51.405606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:25.196 [2024-11-26 23:18:51.405640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:25.196 [2024-11-26 23:18:51.405659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:25.196 [2024-11-26 23:18:51.405679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:25.196 [2024-11-26 23:18:51.414911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:25.196 [2024-11-26 23:18:51.415056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.196 [2024-11-26 23:18:51.415151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.196 [2024-11-26 23:18:51.415182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa44810 with addr=10.0.0.2, port=4420 00:26:25.196 [2024-11-26 23:18:51.415200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa44810 is same with the state(5) to be set 00:26:25.196 [2024-11-26 23:18:51.415224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa44810 (9): Bad file descriptor 00:26:25.196 [2024-11-26 23:18:51.415247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:25.196 [2024-11-26 23:18:51.415262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:25.196 [2024-11-26 23:18:51.415277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:25.196 [2024-11-26 23:18:51.415309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:25.196 [2024-11-26 23:18:51.424990] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:25.196 [2024-11-26 23:18:51.425237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.196 [2024-11-26 23:18:51.425332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.196 [2024-11-26 23:18:51.425357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa44810 with addr=10.0.0.2, port=4420 00:26:25.196 [2024-11-26 23:18:51.425374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa44810 is same with the state(5) to be set 00:26:25.196 [2024-11-26 23:18:51.425395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa44810 (9): Bad file descriptor 00:26:25.196 [2024-11-26 23:18:51.425416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:25.196 [2024-11-26 23:18:51.425430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:25.196 [2024-11-26 23:18:51.425443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:25.196 [2024-11-26 23:18:51.425462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:25.196 [2024-11-26 23:18:51.430696] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:25.196 [2024-11-26 23:18:51.430725] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:26.131 23:18:52 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:26.131 23:18:52 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:26.131 23:18:52 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:26.131 23:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.131 23:18:52 -- host/discovery.sh@59 -- # sort 00:26:26.131 23:18:52 -- common/autotest_common.sh@10 -- # set +x 00:26:26.131 23:18:52 -- host/discovery.sh@59 -- # xargs 00:26:26.131 23:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.131 23:18:52 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:26.131 23:18:52 -- host/discovery.sh@129 -- # get_bdev_list 00:26:26.131 23:18:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.131 23:18:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:26.131 23:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.131 23:18:52 -- common/autotest_common.sh@10 -- # set +x 00:26:26.131 23:18:52 -- host/discovery.sh@55 -- # sort 00:26:26.131 23:18:52 -- host/discovery.sh@55 -- # xargs 00:26:26.131 23:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.131 23:18:52 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:26.131 23:18:52 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:26.131 23:18:52 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:26.131 23:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.131 23:18:52 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:26.131 23:18:52 -- common/autotest_common.sh@10 -- # set +x 00:26:26.131 23:18:52 -- host/discovery.sh@63 -- # sort -n 00:26:26.131 23:18:52 -- host/discovery.sh@63 -- # xargs 00:26:26.131 23:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.131 23:18:52 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:26.131 23:18:52 -- host/discovery.sh@131 -- # get_notification_count 00:26:26.131 23:18:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:26.131 23:18:52 -- host/discovery.sh@74 -- # jq '. | length' 00:26:26.131 23:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.131 23:18:52 -- common/autotest_common.sh@10 -- # set +x 00:26:26.131 23:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.131 23:18:52 -- host/discovery.sh@74 -- # notification_count=0 00:26:26.131 23:18:52 -- host/discovery.sh@75 -- # notify_id=2 00:26:26.131 23:18:52 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:26.131 23:18:52 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:26.131 23:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.131 23:18:52 -- common/autotest_common.sh@10 -- # set +x 00:26:26.389 23:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.389 23:18:52 -- host/discovery.sh@135 -- # sleep 1 00:26:27.324 23:18:53 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:27.324 23:18:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:27.324 23:18:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:27.324 23:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.324 23:18:53 -- host/discovery.sh@59 -- # sort 00:26:27.324 23:18:53 -- common/autotest_common.sh@10 -- # set +x 00:26:27.324 23:18:53 -- host/discovery.sh@59 -- # xargs 00:26:27.324 23:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.324 23:18:53 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:27.324 23:18:53 -- host/discovery.sh@137 -- # get_bdev_list 00:26:27.324 23:18:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.324 23:18:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:27.324 23:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.324 23:18:53 -- common/autotest_common.sh@10 -- # set +x 00:26:27.324 23:18:53 -- host/discovery.sh@55 -- # sort 00:26:27.324 23:18:53 -- host/discovery.sh@55 -- # xargs 00:26:27.324 23:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.324 23:18:53 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:27.324 23:18:53 -- host/discovery.sh@138 -- # get_notification_count 00:26:27.324 23:18:53 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:27.324 23:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.324 23:18:53 -- host/discovery.sh@74 -- # jq '. | length' 00:26:27.324 23:18:53 -- common/autotest_common.sh@10 -- # set +x 00:26:27.324 23:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.324 23:18:53 -- host/discovery.sh@74 -- # notification_count=2 00:26:27.324 23:18:53 -- host/discovery.sh@75 -- # notify_id=4 00:26:27.324 23:18:53 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:27.324 23:18:53 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:27.324 23:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.324 23:18:53 -- common/autotest_common.sh@10 -- # set +x 00:26:28.700 [2024-11-26 23:18:54.724656] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:28.700 [2024-11-26 23:18:54.724680] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:28.700 [2024-11-26 23:18:54.724704] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:28.700 [2024-11-26 23:18:54.812023] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:28.700 [2024-11-26 23:18:54.879018] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:28.700 [2024-11-26 23:18:54.879060] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:28.700 23:18:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.700 23:18:54 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:28.700 23:18:54 -- common/autotest_common.sh@650 -- # local es=0 00:26:28.700 23:18:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:28.700 23:18:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:28.700 23:18:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:28.700 23:18:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:28.700 23:18:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:28.700 23:18:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:28.700 23:18:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.700 23:18:54 -- common/autotest_common.sh@10 -- # set +x 00:26:28.700 request: 00:26:28.700 { 00:26:28.700 "name": "nvme", 00:26:28.700 "trtype": "tcp", 00:26:28.700 "traddr": "10.0.0.2", 00:26:28.700 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:28.700 "adrfam": "ipv4", 00:26:28.700 "trsvcid": "8009", 00:26:28.700 "wait_for_attach": true, 00:26:28.700 "method": "bdev_nvme_start_discovery", 00:26:28.700 "req_id": 1 00:26:28.700 } 00:26:28.700 Got JSON-RPC error response 00:26:28.700 response: 00:26:28.700 { 00:26:28.700 "code": -17, 00:26:28.700 "message": "File exists" 00:26:28.700 } 00:26:28.700 23:18:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:28.700 23:18:54 -- common/autotest_common.sh@653 -- # es=1 00:26:28.700 23:18:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:28.700 23:18:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:28.700 23:18:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:28.700 23:18:54 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:28.700 23:18:54 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:28.700 23:18:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.700 23:18:54 -- common/autotest_common.sh@10 -- # set +x 00:26:28.700 23:18:54 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:28.700 23:18:54 -- host/discovery.sh@67 -- # sort 00:26:28.700 23:18:54 -- host/discovery.sh@67 -- # xargs 00:26:28.700 23:18:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.700 23:18:54 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:28.700 23:18:54 -- host/discovery.sh@147 -- # get_bdev_list 00:26:28.700 23:18:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.700 23:18:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.700 23:18:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:28.700 23:18:54 -- host/discovery.sh@55 -- # sort 00:26:28.700 23:18:54 -- common/autotest_common.sh@10 -- # set +x 00:26:28.700 23:18:54 -- host/discovery.sh@55 -- # xargs 00:26:28.700 23:18:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.700 23:18:54 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:28.700 23:18:54 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:28.700 23:18:54 -- common/autotest_common.sh@650 -- # local es=0 00:26:28.701 23:18:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:28.701 23:18:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:28.701 23:18:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:28.701 23:18:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:28.701 23:18:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:28.701 23:18:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:28.701 23:18:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.701 23:18:54 -- common/autotest_common.sh@10 -- # set +x 00:26:28.701 request: 00:26:28.701 { 00:26:28.701 "name": "nvme_second", 00:26:28.701 "trtype": "tcp", 00:26:28.701 "traddr": "10.0.0.2", 00:26:28.701 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:28.701 "adrfam": "ipv4", 00:26:28.701 "trsvcid": "8009", 00:26:28.701 "wait_for_attach": true, 00:26:28.701 "method": "bdev_nvme_start_discovery", 00:26:28.701 "req_id": 1 00:26:28.701 } 00:26:28.701 Got JSON-RPC error response 00:26:28.701 response: 00:26:28.701 { 00:26:28.701 "code": -17, 00:26:28.701 "message": "File exists" 00:26:28.701 } 00:26:28.701 23:18:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:28.701 23:18:54 -- common/autotest_common.sh@653 -- # es=1 00:26:28.701 23:18:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:28.701 23:18:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:28.701 23:18:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:28.701 23:18:54 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:28.701 23:18:54 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:28.701 23:18:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.701 23:18:54 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:28.701 23:18:54 -- common/autotest_common.sh@10 -- # set +x 00:26:28.701 23:18:54 -- host/discovery.sh@67 -- # sort 00:26:28.701 23:18:54 -- host/discovery.sh@67 -- # xargs 00:26:28.701 23:18:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.701 23:18:55 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:28.701 23:18:55 -- host/discovery.sh@153 -- # get_bdev_list 00:26:28.701 23:18:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.701 23:18:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:28.701 23:18:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.701 23:18:55 -- common/autotest_common.sh@10 -- # set +x 00:26:28.701 23:18:55 -- host/discovery.sh@55 -- # sort 00:26:28.701 23:18:55 -- host/discovery.sh@55 -- # xargs 00:26:28.701 23:18:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.701 23:18:55 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:28.701 23:18:55 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:28.701 23:18:55 -- common/autotest_common.sh@650 -- # local es=0 00:26:28.701 23:18:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:28.701 23:18:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:28.701 23:18:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:28.701 23:18:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:28.701 23:18:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:28.701 23:18:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:28.701 23:18:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.701 23:18:55 -- common/autotest_common.sh@10 -- # set +x 00:26:30.075 [2024-11-26 23:18:56.071364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:30.076 [2024-11-26 23:18:56.071533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:30.076 [2024-11-26 23:18:56.071580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa683d0 with addr=10.0.0.2, port=8010 00:26:30.076 [2024-11-26 23:18:56.071609] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:30.076 [2024-11-26 23:18:56.071626] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:30.076 [2024-11-26 23:18:56.071639] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:31.009 [2024-11-26 23:18:57.073793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:31.009 [2024-11-26 23:18:57.074004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:31.009 [2024-11-26 23:18:57.074032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa34d30 with addr=10.0.0.2, port=8010 00:26:31.009 [2024-11-26 23:18:57.074052] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:31.009 [2024-11-26 23:18:57.074065] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:31.009 [2024-11-26 23:18:57.074079] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:31.943 [2024-11-26 23:18:58.076029] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:31.943 request: 00:26:31.943 { 00:26:31.943 "name": "nvme_second", 00:26:31.943 "trtype": "tcp", 00:26:31.943 "traddr": "10.0.0.2", 00:26:31.943 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:31.943 "adrfam": "ipv4", 00:26:31.943 "trsvcid": "8010", 00:26:31.943 "attach_timeout_ms": 3000, 00:26:31.943 "method": "bdev_nvme_start_discovery", 00:26:31.943 "req_id": 1 00:26:31.943 } 00:26:31.943 Got JSON-RPC error response 00:26:31.943 response: 00:26:31.943 { 00:26:31.943 "code": -110, 00:26:31.943 "message": "Connection timed out" 00:26:31.943 } 00:26:31.943 23:18:58 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:31.943 23:18:58 -- common/autotest_common.sh@653 -- # es=1 00:26:31.943 23:18:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:31.943 23:18:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:31.943 23:18:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:31.943 23:18:58 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:31.943 23:18:58 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:31.943 23:18:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.943 23:18:58 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:31.943 23:18:58 -- common/autotest_common.sh@10 -- # set +x 00:26:31.943 23:18:58 -- host/discovery.sh@67 -- # sort 00:26:31.943 23:18:58 -- host/discovery.sh@67 -- # xargs 00:26:31.943 23:18:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.943 23:18:58 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:31.943 23:18:58 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:31.943 23:18:58 -- host/discovery.sh@162 -- # kill 309757 00:26:31.943 23:18:58 -- host/discovery.sh@163 -- # nvmftestfini 00:26:31.943 23:18:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:31.943 23:18:58 -- nvmf/common.sh@116 -- # sync 00:26:31.943 23:18:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:31.943 23:18:58 -- nvmf/common.sh@119 -- # set +e 00:26:31.943 23:18:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:31.943 23:18:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:31.943 rmmod nvme_tcp 00:26:31.943 rmmod nvme_fabrics 00:26:31.943 rmmod nvme_keyring 00:26:31.943 23:18:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:31.943 23:18:58 -- nvmf/common.sh@123 -- # set -e 00:26:31.943 23:18:58 -- nvmf/common.sh@124 -- # return 0 00:26:31.943 23:18:58 -- nvmf/common.sh@477 -- # '[' -n 309599 ']' 00:26:31.943 23:18:58 -- nvmf/common.sh@478 -- # killprocess 309599 00:26:31.943 23:18:58 -- common/autotest_common.sh@936 -- # '[' -z 309599 ']' 00:26:31.943 23:18:58 -- common/autotest_common.sh@940 -- # kill -0 309599 00:26:31.943 23:18:58 -- common/autotest_common.sh@941 -- # uname 00:26:31.943 23:18:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:31.943 23:18:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 309599 00:26:31.943 23:18:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:31.943 23:18:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:31.943 23:18:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 309599' 00:26:31.943 killing process with pid 309599 00:26:31.943 23:18:58 -- common/autotest_common.sh@955 -- # kill 309599 00:26:31.943 23:18:58 -- common/autotest_common.sh@960 -- # wait 309599 00:26:32.202 23:18:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:32.202 23:18:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:32.202 23:18:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:32.202 23:18:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:32.202 23:18:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:32.202 23:18:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:32.202 23:18:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:32.202 23:18:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:34.737 23:19:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:34.737 00:26:34.737 real 0m17.561s 00:26:34.737 user 0m27.136s 00:26:34.737 sys 0m2.959s 00:26:34.737 23:19:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:34.737 23:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.737 ************************************ 00:26:34.737 END TEST nvmf_discovery 00:26:34.737 ************************************ 00:26:34.737 23:19:00 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:34.737 23:19:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:34.737 23:19:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:34.737 23:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.737 ************************************ 00:26:34.737 START TEST nvmf_discovery_remove_ifc 00:26:34.737 ************************************ 00:26:34.737 23:19:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:34.737 * Looking for test storage... 00:26:34.737 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:34.737 23:19:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:34.737 23:19:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:34.737 23:19:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:34.737 23:19:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:34.737 23:19:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:34.737 23:19:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:34.737 23:19:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:34.737 23:19:00 -- scripts/common.sh@335 -- # IFS=.-: 00:26:34.737 23:19:00 -- scripts/common.sh@335 -- # read -ra ver1 00:26:34.737 23:19:00 -- scripts/common.sh@336 -- # IFS=.-: 00:26:34.737 23:19:00 -- scripts/common.sh@336 -- # read -ra ver2 00:26:34.737 23:19:00 -- scripts/common.sh@337 -- # local 'op=<' 00:26:34.737 23:19:00 -- scripts/common.sh@339 -- # ver1_l=2 00:26:34.737 23:19:00 -- scripts/common.sh@340 -- # ver2_l=1 00:26:34.737 23:19:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:34.737 23:19:00 -- scripts/common.sh@343 -- # case "$op" in 00:26:34.737 23:19:00 -- scripts/common.sh@344 -- # : 1 00:26:34.737 23:19:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:34.737 23:19:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:34.737 23:19:00 -- scripts/common.sh@364 -- # decimal 1 00:26:34.737 23:19:00 -- scripts/common.sh@352 -- # local d=1 00:26:34.737 23:19:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:34.737 23:19:00 -- scripts/common.sh@354 -- # echo 1 00:26:34.737 23:19:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:34.737 23:19:00 -- scripts/common.sh@365 -- # decimal 2 00:26:34.737 23:19:00 -- scripts/common.sh@352 -- # local d=2 00:26:34.737 23:19:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:34.737 23:19:00 -- scripts/common.sh@354 -- # echo 2 00:26:34.737 23:19:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:34.737 23:19:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:34.737 23:19:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:34.737 23:19:00 -- scripts/common.sh@367 -- # return 0 00:26:34.737 23:19:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:34.737 23:19:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:34.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:34.737 --rc genhtml_branch_coverage=1 00:26:34.737 --rc genhtml_function_coverage=1 00:26:34.737 --rc genhtml_legend=1 00:26:34.737 --rc geninfo_all_blocks=1 00:26:34.737 --rc geninfo_unexecuted_blocks=1 00:26:34.737 00:26:34.737 ' 00:26:34.737 23:19:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:34.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:34.737 --rc genhtml_branch_coverage=1 00:26:34.737 --rc genhtml_function_coverage=1 00:26:34.737 --rc genhtml_legend=1 00:26:34.737 --rc geninfo_all_blocks=1 00:26:34.737 --rc geninfo_unexecuted_blocks=1 00:26:34.737 00:26:34.737 ' 00:26:34.737 23:19:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:34.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:34.737 --rc genhtml_branch_coverage=1 00:26:34.737 --rc genhtml_function_coverage=1 00:26:34.737 --rc genhtml_legend=1 00:26:34.737 --rc geninfo_all_blocks=1 00:26:34.737 --rc geninfo_unexecuted_blocks=1 00:26:34.737 00:26:34.737 ' 00:26:34.737 23:19:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:34.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:34.737 --rc genhtml_branch_coverage=1 00:26:34.737 --rc genhtml_function_coverage=1 00:26:34.737 --rc genhtml_legend=1 00:26:34.738 --rc geninfo_all_blocks=1 00:26:34.738 --rc geninfo_unexecuted_blocks=1 00:26:34.738 00:26:34.738 ' 00:26:34.738 23:19:00 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:34.738 23:19:00 -- nvmf/common.sh@7 -- # uname -s 00:26:34.738 23:19:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:34.738 23:19:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:34.738 23:19:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:34.738 23:19:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:34.738 23:19:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:34.738 23:19:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:34.738 23:19:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:34.738 23:19:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:34.738 23:19:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:34.738 23:19:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:34.738 23:19:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:34.738 23:19:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:34.738 23:19:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:34.738 23:19:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:34.738 23:19:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:34.738 23:19:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:34.738 23:19:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:34.738 23:19:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:34.738 23:19:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:34.738 23:19:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:34.738 23:19:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:34.738 23:19:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:34.738 23:19:00 -- paths/export.sh@5 -- # export PATH 00:26:34.738 23:19:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:34.738 23:19:00 -- nvmf/common.sh@46 -- # : 0 00:26:34.738 23:19:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:34.738 23:19:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:34.738 23:19:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:34.738 23:19:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:34.738 23:19:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:34.738 23:19:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:34.738 23:19:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:34.738 23:19:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:34.738 23:19:00 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:34.738 23:19:00 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:34.738 23:19:00 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:34.738 23:19:00 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:34.738 23:19:00 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:34.738 23:19:00 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:34.738 23:19:00 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:34.738 23:19:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:34.738 23:19:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:34.738 23:19:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:34.738 23:19:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:34.738 23:19:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:34.738 23:19:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:34.738 23:19:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:34.738 23:19:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:34.738 23:19:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:34.738 23:19:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:34.738 23:19:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:34.738 23:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:36.640 23:19:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:36.640 23:19:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:36.640 23:19:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:36.641 23:19:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:36.641 23:19:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:36.641 23:19:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:36.641 23:19:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:36.641 23:19:02 -- nvmf/common.sh@294 -- # net_devs=() 00:26:36.641 23:19:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:36.641 23:19:02 -- nvmf/common.sh@295 -- # e810=() 00:26:36.641 23:19:02 -- nvmf/common.sh@295 -- # local -ga e810 00:26:36.641 23:19:02 -- nvmf/common.sh@296 -- # x722=() 00:26:36.641 23:19:02 -- nvmf/common.sh@296 -- # local -ga x722 00:26:36.641 23:19:02 -- nvmf/common.sh@297 -- # mlx=() 00:26:36.641 23:19:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:36.641 23:19:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:36.641 23:19:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:36.641 23:19:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:36.641 23:19:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:36.641 23:19:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:36.641 23:19:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:36.641 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:36.641 23:19:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:36.641 23:19:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:36.641 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:36.641 23:19:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:36.641 23:19:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:36.641 23:19:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:36.641 23:19:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:36.641 23:19:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:36.641 23:19:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:36.641 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:36.641 23:19:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:36.641 23:19:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:36.641 23:19:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:36.641 23:19:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:36.641 23:19:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:36.641 23:19:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:36.641 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:36.641 23:19:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:36.641 23:19:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:36.641 23:19:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:36.641 23:19:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:36.641 23:19:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:36.641 23:19:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:36.641 23:19:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:36.641 23:19:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:36.641 23:19:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:36.641 23:19:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:36.641 23:19:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:36.641 23:19:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:36.641 23:19:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:36.641 23:19:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:36.641 23:19:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:36.641 23:19:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:36.641 23:19:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:36.641 23:19:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:36.641 23:19:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:36.641 23:19:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:36.641 23:19:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:36.641 23:19:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:36.641 23:19:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:36.641 23:19:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:36.641 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:36.641 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:26:36.641 00:26:36.641 --- 10.0.0.2 ping statistics --- 00:26:36.641 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:36.641 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:26:36.641 23:19:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:36.641 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:36.641 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:26:36.641 00:26:36.641 --- 10.0.0.1 ping statistics --- 00:26:36.641 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:36.641 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:26:36.641 23:19:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:36.641 23:19:02 -- nvmf/common.sh@410 -- # return 0 00:26:36.641 23:19:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:36.641 23:19:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:36.641 23:19:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:36.641 23:19:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:36.641 23:19:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:36.641 23:19:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:36.641 23:19:02 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:36.641 23:19:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:36.641 23:19:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:36.641 23:19:02 -- common/autotest_common.sh@10 -- # set +x 00:26:36.641 23:19:02 -- nvmf/common.sh@469 -- # nvmfpid=313312 00:26:36.641 23:19:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:36.641 23:19:02 -- nvmf/common.sh@470 -- # waitforlisten 313312 00:26:36.641 23:19:02 -- common/autotest_common.sh@829 -- # '[' -z 313312 ']' 00:26:36.641 23:19:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:36.641 23:19:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:36.641 23:19:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:36.641 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:36.641 23:19:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:36.641 23:19:02 -- common/autotest_common.sh@10 -- # set +x 00:26:36.641 [2024-11-26 23:19:03.013879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:36.641 [2024-11-26 23:19:03.013962] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:36.900 EAL: No free 2048 kB hugepages reported on node 1 00:26:36.900 [2024-11-26 23:19:03.080621] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:36.900 [2024-11-26 23:19:03.188578] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:36.900 [2024-11-26 23:19:03.188744] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:36.900 [2024-11-26 23:19:03.188761] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:36.900 [2024-11-26 23:19:03.188773] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:36.900 [2024-11-26 23:19:03.188800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:37.834 23:19:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:37.834 23:19:03 -- common/autotest_common.sh@862 -- # return 0 00:26:37.834 23:19:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:37.834 23:19:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:37.834 23:19:03 -- common/autotest_common.sh@10 -- # set +x 00:26:37.834 23:19:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:37.834 23:19:04 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:37.834 23:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.834 23:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:37.834 [2024-11-26 23:19:04.020805] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:37.834 [2024-11-26 23:19:04.029020] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:37.834 null0 00:26:37.834 [2024-11-26 23:19:04.060978] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:37.834 23:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.834 23:19:04 -- host/discovery_remove_ifc.sh@59 -- # hostpid=313456 00:26:37.834 23:19:04 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:37.834 23:19:04 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 313456 /tmp/host.sock 00:26:37.834 23:19:04 -- common/autotest_common.sh@829 -- # '[' -z 313456 ']' 00:26:37.834 23:19:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:37.834 23:19:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:37.834 23:19:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:37.834 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:37.834 23:19:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:37.834 23:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:37.834 [2024-11-26 23:19:04.122970] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:37.834 [2024-11-26 23:19:04.123041] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid313456 ] 00:26:37.834 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.834 [2024-11-26 23:19:04.181921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:38.093 [2024-11-26 23:19:04.289304] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:38.093 [2024-11-26 23:19:04.289457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:38.093 23:19:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:38.093 23:19:04 -- common/autotest_common.sh@862 -- # return 0 00:26:38.093 23:19:04 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:38.094 23:19:04 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:38.094 23:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.094 23:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:38.094 23:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.094 23:19:04 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:38.094 23:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.094 23:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:38.094 23:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.094 23:19:04 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:38.094 23:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.094 23:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:39.468 [2024-11-26 23:19:05.508661] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:39.468 [2024-11-26 23:19:05.508692] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:39.468 [2024-11-26 23:19:05.508716] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:39.468 [2024-11-26 23:19:05.595006] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:39.468 [2024-11-26 23:19:05.780085] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:39.468 [2024-11-26 23:19:05.780141] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:39.468 [2024-11-26 23:19:05.780182] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:39.468 [2024-11-26 23:19:05.780209] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:39.468 [2024-11-26 23:19:05.780238] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:39.468 23:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.468 23:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.468 23:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.468 [2024-11-26 23:19:05.786850] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x109ed40 was disconnected and freed. delete nvme_qpair. 00:26:39.468 23:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:39.468 23:19:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.725 23:19:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.725 23:19:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.725 23:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.725 23:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:39.725 23:19:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.725 23:19:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.725 23:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.726 23:19:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:39.726 23:19:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:40.659 23:19:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:40.659 23:19:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:40.659 23:19:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:40.659 23:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.659 23:19:06 -- common/autotest_common.sh@10 -- # set +x 00:26:40.659 23:19:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:40.659 23:19:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:40.659 23:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.659 23:19:06 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:40.659 23:19:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:41.591 23:19:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.591 23:19:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.591 23:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.591 23:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:41.591 23:19:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.591 23:19:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.591 23:19:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.591 23:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.848 23:19:07 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:41.849 23:19:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.782 23:19:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:42.782 23:19:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:42.782 23:19:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:42.782 23:19:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.782 23:19:08 -- common/autotest_common.sh@10 -- # set +x 00:26:42.782 23:19:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:42.782 23:19:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:42.782 23:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.782 23:19:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:42.782 23:19:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:43.712 23:19:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.712 23:19:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.712 23:19:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.712 23:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.712 23:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:43.712 23:19:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.712 23:19:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:43.712 23:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:43.712 23:19:10 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:43.712 23:19:10 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:45.086 23:19:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:45.086 23:19:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:45.086 23:19:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:45.086 23:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.086 23:19:11 -- common/autotest_common.sh@10 -- # set +x 00:26:45.086 23:19:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:45.086 23:19:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:45.086 23:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.086 23:19:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:45.086 23:19:11 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:45.086 [2024-11-26 23:19:11.221188] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:45.086 [2024-11-26 23:19:11.221263] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.086 [2024-11-26 23:19:11.221298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.086 [2024-11-26 23:19:11.221318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.086 [2024-11-26 23:19:11.221334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.086 [2024-11-26 23:19:11.221349] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.086 [2024-11-26 23:19:11.221364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.086 [2024-11-26 23:19:11.221380] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.086 [2024-11-26 23:19:11.221395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.086 [2024-11-26 23:19:11.221411] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.086 [2024-11-26 23:19:11.221426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.086 [2024-11-26 23:19:11.221441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1065430 is same with the state(5) to be set 00:26:45.086 [2024-11-26 23:19:11.231208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1065430 (9): Bad file descriptor 00:26:45.086 [2024-11-26 23:19:11.241256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:46.020 23:19:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:46.020 23:19:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:46.020 23:19:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:46.020 23:19:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.020 23:19:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:46.020 23:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:46.020 23:19:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:46.020 [2024-11-26 23:19:12.276554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:46.956 [2024-11-26 23:19:13.300564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:46.956 [2024-11-26 23:19:13.300621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1065430 with addr=10.0.0.2, port=4420 00:26:46.956 [2024-11-26 23:19:13.300650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1065430 is same with the state(5) to be set 00:26:46.956 [2024-11-26 23:19:13.300689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:46.956 [2024-11-26 23:19:13.300707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:46.956 [2024-11-26 23:19:13.300722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:46.956 [2024-11-26 23:19:13.300740] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:46.956 [2024-11-26 23:19:13.301174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1065430 (9): Bad file descriptor 00:26:46.956 [2024-11-26 23:19:13.301220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.956 [2024-11-26 23:19:13.301267] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:46.956 [2024-11-26 23:19:13.301307] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.956 [2024-11-26 23:19:13.301331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.956 [2024-11-26 23:19:13.301362] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.956 [2024-11-26 23:19:13.301378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.956 [2024-11-26 23:19:13.301394] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.956 [2024-11-26 23:19:13.301409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.956 [2024-11-26 23:19:13.301425] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.956 [2024-11-26 23:19:13.301440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.956 [2024-11-26 23:19:13.301455] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.956 [2024-11-26 23:19:13.301470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.956 [2024-11-26 23:19:13.301485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:46.956 [2024-11-26 23:19:13.301688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1065840 (9): Bad file descriptor 00:26:46.956 [2024-11-26 23:19:13.302708] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:46.956 [2024-11-26 23:19:13.302730] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:46.956 23:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.956 23:19:13 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:46.956 23:19:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:48.327 23:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:48.327 23:19:14 -- common/autotest_common.sh@10 -- # set +x 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:48.327 23:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:48.327 23:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:48.327 23:19:14 -- common/autotest_common.sh@10 -- # set +x 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:48.327 23:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:48.327 23:19:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:49.261 [2024-11-26 23:19:15.356173] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:49.261 [2024-11-26 23:19:15.356215] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:49.261 [2024-11-26 23:19:15.356242] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:49.261 23:19:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:49.261 23:19:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:49.261 23:19:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:49.261 23:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.261 23:19:15 -- common/autotest_common.sh@10 -- # set +x 00:26:49.261 23:19:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:49.261 23:19:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:49.261 [2024-11-26 23:19:15.442489] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:49.261 23:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.261 23:19:15 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:49.261 23:19:15 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:49.261 [2024-11-26 23:19:15.504363] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:49.261 [2024-11-26 23:19:15.504417] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:49.261 [2024-11-26 23:19:15.504455] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:49.261 [2024-11-26 23:19:15.504481] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:49.261 [2024-11-26 23:19:15.504496] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:49.261 [2024-11-26 23:19:15.512928] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1073ef0 was disconnected and freed. delete nvme_qpair. 00:26:50.194 23:19:16 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:50.195 23:19:16 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:50.195 23:19:16 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:50.195 23:19:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:50.195 23:19:16 -- common/autotest_common.sh@10 -- # set +x 00:26:50.195 23:19:16 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:50.195 23:19:16 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:50.195 23:19:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:50.195 23:19:16 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:50.195 23:19:16 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:50.195 23:19:16 -- host/discovery_remove_ifc.sh@90 -- # killprocess 313456 00:26:50.195 23:19:16 -- common/autotest_common.sh@936 -- # '[' -z 313456 ']' 00:26:50.195 23:19:16 -- common/autotest_common.sh@940 -- # kill -0 313456 00:26:50.195 23:19:16 -- common/autotest_common.sh@941 -- # uname 00:26:50.195 23:19:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:50.195 23:19:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 313456 00:26:50.195 23:19:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:50.195 23:19:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:50.195 23:19:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 313456' 00:26:50.195 killing process with pid 313456 00:26:50.195 23:19:16 -- common/autotest_common.sh@955 -- # kill 313456 00:26:50.195 23:19:16 -- common/autotest_common.sh@960 -- # wait 313456 00:26:50.453 23:19:16 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:50.453 23:19:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:50.453 23:19:16 -- nvmf/common.sh@116 -- # sync 00:26:50.453 23:19:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:50.453 23:19:16 -- nvmf/common.sh@119 -- # set +e 00:26:50.453 23:19:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:50.453 23:19:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:50.453 rmmod nvme_tcp 00:26:50.711 rmmod nvme_fabrics 00:26:50.711 rmmod nvme_keyring 00:26:50.711 23:19:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:50.711 23:19:16 -- nvmf/common.sh@123 -- # set -e 00:26:50.711 23:19:16 -- nvmf/common.sh@124 -- # return 0 00:26:50.711 23:19:16 -- nvmf/common.sh@477 -- # '[' -n 313312 ']' 00:26:50.711 23:19:16 -- nvmf/common.sh@478 -- # killprocess 313312 00:26:50.711 23:19:16 -- common/autotest_common.sh@936 -- # '[' -z 313312 ']' 00:26:50.711 23:19:16 -- common/autotest_common.sh@940 -- # kill -0 313312 00:26:50.711 23:19:16 -- common/autotest_common.sh@941 -- # uname 00:26:50.711 23:19:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:50.711 23:19:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 313312 00:26:50.711 23:19:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:50.711 23:19:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:50.711 23:19:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 313312' 00:26:50.711 killing process with pid 313312 00:26:50.711 23:19:16 -- common/autotest_common.sh@955 -- # kill 313312 00:26:50.711 23:19:16 -- common/autotest_common.sh@960 -- # wait 313312 00:26:50.970 23:19:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:50.970 23:19:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:50.970 23:19:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:50.970 23:19:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:50.970 23:19:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:50.970 23:19:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:50.970 23:19:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:50.970 23:19:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:52.871 23:19:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:52.871 00:26:52.871 real 0m18.684s 00:26:52.871 user 0m25.820s 00:26:52.871 sys 0m3.063s 00:26:52.871 23:19:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:52.871 23:19:19 -- common/autotest_common.sh@10 -- # set +x 00:26:52.871 ************************************ 00:26:52.871 END TEST nvmf_discovery_remove_ifc 00:26:52.871 ************************************ 00:26:52.871 23:19:19 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:52.871 23:19:19 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:52.871 23:19:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:52.871 23:19:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:52.871 23:19:19 -- common/autotest_common.sh@10 -- # set +x 00:26:52.871 ************************************ 00:26:52.871 START TEST nvmf_digest 00:26:52.871 ************************************ 00:26:52.871 23:19:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:53.129 * Looking for test storage... 00:26:53.129 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:53.129 23:19:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:53.129 23:19:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:53.129 23:19:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:53.129 23:19:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:53.129 23:19:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:53.129 23:19:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:53.129 23:19:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:53.129 23:19:19 -- scripts/common.sh@335 -- # IFS=.-: 00:26:53.129 23:19:19 -- scripts/common.sh@335 -- # read -ra ver1 00:26:53.129 23:19:19 -- scripts/common.sh@336 -- # IFS=.-: 00:26:53.129 23:19:19 -- scripts/common.sh@336 -- # read -ra ver2 00:26:53.129 23:19:19 -- scripts/common.sh@337 -- # local 'op=<' 00:26:53.129 23:19:19 -- scripts/common.sh@339 -- # ver1_l=2 00:26:53.129 23:19:19 -- scripts/common.sh@340 -- # ver2_l=1 00:26:53.129 23:19:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:53.129 23:19:19 -- scripts/common.sh@343 -- # case "$op" in 00:26:53.129 23:19:19 -- scripts/common.sh@344 -- # : 1 00:26:53.129 23:19:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:53.129 23:19:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:53.129 23:19:19 -- scripts/common.sh@364 -- # decimal 1 00:26:53.129 23:19:19 -- scripts/common.sh@352 -- # local d=1 00:26:53.129 23:19:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:53.129 23:19:19 -- scripts/common.sh@354 -- # echo 1 00:26:53.129 23:19:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:53.129 23:19:19 -- scripts/common.sh@365 -- # decimal 2 00:26:53.129 23:19:19 -- scripts/common.sh@352 -- # local d=2 00:26:53.129 23:19:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:53.129 23:19:19 -- scripts/common.sh@354 -- # echo 2 00:26:53.129 23:19:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:53.129 23:19:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:53.129 23:19:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:53.129 23:19:19 -- scripts/common.sh@367 -- # return 0 00:26:53.129 23:19:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:53.129 23:19:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:53.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:53.129 --rc genhtml_branch_coverage=1 00:26:53.129 --rc genhtml_function_coverage=1 00:26:53.129 --rc genhtml_legend=1 00:26:53.129 --rc geninfo_all_blocks=1 00:26:53.129 --rc geninfo_unexecuted_blocks=1 00:26:53.129 00:26:53.129 ' 00:26:53.129 23:19:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:53.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:53.129 --rc genhtml_branch_coverage=1 00:26:53.129 --rc genhtml_function_coverage=1 00:26:53.129 --rc genhtml_legend=1 00:26:53.129 --rc geninfo_all_blocks=1 00:26:53.129 --rc geninfo_unexecuted_blocks=1 00:26:53.129 00:26:53.129 ' 00:26:53.129 23:19:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:53.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:53.129 --rc genhtml_branch_coverage=1 00:26:53.129 --rc genhtml_function_coverage=1 00:26:53.129 --rc genhtml_legend=1 00:26:53.129 --rc geninfo_all_blocks=1 00:26:53.129 --rc geninfo_unexecuted_blocks=1 00:26:53.129 00:26:53.129 ' 00:26:53.129 23:19:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:53.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:53.129 --rc genhtml_branch_coverage=1 00:26:53.129 --rc genhtml_function_coverage=1 00:26:53.129 --rc genhtml_legend=1 00:26:53.129 --rc geninfo_all_blocks=1 00:26:53.129 --rc geninfo_unexecuted_blocks=1 00:26:53.129 00:26:53.129 ' 00:26:53.129 23:19:19 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:53.129 23:19:19 -- nvmf/common.sh@7 -- # uname -s 00:26:53.129 23:19:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:53.129 23:19:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:53.129 23:19:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:53.129 23:19:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:53.129 23:19:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:53.129 23:19:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:53.129 23:19:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:53.129 23:19:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:53.129 23:19:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:53.129 23:19:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:53.129 23:19:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:53.129 23:19:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:53.129 23:19:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:53.129 23:19:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:53.129 23:19:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:53.129 23:19:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:53.129 23:19:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:53.129 23:19:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:53.129 23:19:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:53.129 23:19:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:53.129 23:19:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:53.129 23:19:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:53.129 23:19:19 -- paths/export.sh@5 -- # export PATH 00:26:53.129 23:19:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:53.129 23:19:19 -- nvmf/common.sh@46 -- # : 0 00:26:53.129 23:19:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:53.129 23:19:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:53.130 23:19:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:53.130 23:19:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:53.130 23:19:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:53.130 23:19:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:53.130 23:19:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:53.130 23:19:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:53.130 23:19:19 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:53.130 23:19:19 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:53.130 23:19:19 -- host/digest.sh@16 -- # runtime=2 00:26:53.130 23:19:19 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:53.130 23:19:19 -- host/digest.sh@132 -- # nvmftestinit 00:26:53.130 23:19:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:53.130 23:19:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:53.130 23:19:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:53.130 23:19:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:53.130 23:19:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:53.130 23:19:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:53.130 23:19:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:53.130 23:19:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:53.130 23:19:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:53.130 23:19:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:53.130 23:19:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:53.130 23:19:19 -- common/autotest_common.sh@10 -- # set +x 00:26:55.660 23:19:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:55.660 23:19:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:55.660 23:19:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:55.660 23:19:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:55.660 23:19:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:55.660 23:19:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:55.660 23:19:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:55.660 23:19:21 -- nvmf/common.sh@294 -- # net_devs=() 00:26:55.660 23:19:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:55.660 23:19:21 -- nvmf/common.sh@295 -- # e810=() 00:26:55.660 23:19:21 -- nvmf/common.sh@295 -- # local -ga e810 00:26:55.660 23:19:21 -- nvmf/common.sh@296 -- # x722=() 00:26:55.660 23:19:21 -- nvmf/common.sh@296 -- # local -ga x722 00:26:55.660 23:19:21 -- nvmf/common.sh@297 -- # mlx=() 00:26:55.660 23:19:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:55.660 23:19:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:55.660 23:19:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:55.660 23:19:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:55.660 23:19:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:55.660 23:19:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:55.660 23:19:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:55.660 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:55.660 23:19:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:55.660 23:19:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:55.660 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:55.660 23:19:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:55.660 23:19:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:55.660 23:19:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:55.660 23:19:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:55.660 23:19:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:55.660 23:19:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:55.660 23:19:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:55.660 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:55.660 23:19:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:55.660 23:19:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:55.660 23:19:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:55.660 23:19:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:55.660 23:19:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:55.660 23:19:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:55.660 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:55.661 23:19:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:55.661 23:19:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:55.661 23:19:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:55.661 23:19:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:55.661 23:19:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:55.661 23:19:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:55.661 23:19:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:55.661 23:19:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:55.661 23:19:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:55.661 23:19:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:55.661 23:19:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:55.661 23:19:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:55.661 23:19:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:55.661 23:19:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:55.661 23:19:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:55.661 23:19:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:55.661 23:19:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:55.661 23:19:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:55.661 23:19:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:55.661 23:19:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:55.661 23:19:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:55.661 23:19:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:55.661 23:19:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:55.661 23:19:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:55.661 23:19:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:55.661 23:19:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:55.661 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:55.661 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.420 ms 00:26:55.661 00:26:55.661 --- 10.0.0.2 ping statistics --- 00:26:55.661 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:55.661 rtt min/avg/max/mdev = 0.420/0.420/0.420/0.000 ms 00:26:55.661 23:19:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:55.661 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:55.661 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:26:55.661 00:26:55.661 --- 10.0.0.1 ping statistics --- 00:26:55.661 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:55.661 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:26:55.661 23:19:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:55.661 23:19:21 -- nvmf/common.sh@410 -- # return 0 00:26:55.661 23:19:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:55.661 23:19:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:55.661 23:19:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:55.661 23:19:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:55.661 23:19:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:55.661 23:19:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:55.661 23:19:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:55.661 23:19:21 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:55.661 23:19:21 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:55.661 23:19:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:55.661 23:19:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:55.661 23:19:21 -- common/autotest_common.sh@10 -- # set +x 00:26:55.661 ************************************ 00:26:55.661 START TEST nvmf_digest_clean 00:26:55.661 ************************************ 00:26:55.661 23:19:21 -- common/autotest_common.sh@1114 -- # run_digest 00:26:55.661 23:19:21 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:55.661 23:19:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:55.661 23:19:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:55.661 23:19:21 -- common/autotest_common.sh@10 -- # set +x 00:26:55.661 23:19:21 -- nvmf/common.sh@469 -- # nvmfpid=317036 00:26:55.661 23:19:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:55.661 23:19:21 -- nvmf/common.sh@470 -- # waitforlisten 317036 00:26:55.661 23:19:21 -- common/autotest_common.sh@829 -- # '[' -z 317036 ']' 00:26:55.661 23:19:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:55.661 23:19:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:55.661 23:19:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:55.661 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:55.661 23:19:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:55.661 23:19:21 -- common/autotest_common.sh@10 -- # set +x 00:26:55.661 [2024-11-26 23:19:21.803959] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:55.661 [2024-11-26 23:19:21.804031] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:55.661 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.661 [2024-11-26 23:19:21.871134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:55.661 [2024-11-26 23:19:21.980522] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:55.661 [2024-11-26 23:19:21.980696] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:55.661 [2024-11-26 23:19:21.980713] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:55.661 [2024-11-26 23:19:21.980726] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:55.661 [2024-11-26 23:19:21.980754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:55.661 23:19:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:55.661 23:19:22 -- common/autotest_common.sh@862 -- # return 0 00:26:55.661 23:19:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:55.661 23:19:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:55.661 23:19:22 -- common/autotest_common.sh@10 -- # set +x 00:26:55.661 23:19:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:55.661 23:19:22 -- host/digest.sh@120 -- # common_target_config 00:26:55.661 23:19:22 -- host/digest.sh@43 -- # rpc_cmd 00:26:55.661 23:19:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.661 23:19:22 -- common/autotest_common.sh@10 -- # set +x 00:26:55.919 null0 00:26:55.919 [2024-11-26 23:19:22.164863] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:55.919 [2024-11-26 23:19:22.189102] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:55.919 23:19:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.919 23:19:22 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:55.919 23:19:22 -- host/digest.sh@77 -- # local rw bs qd 00:26:55.919 23:19:22 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:55.919 23:19:22 -- host/digest.sh@80 -- # rw=randread 00:26:55.919 23:19:22 -- host/digest.sh@80 -- # bs=4096 00:26:55.919 23:19:22 -- host/digest.sh@80 -- # qd=128 00:26:55.919 23:19:22 -- host/digest.sh@82 -- # bperfpid=317064 00:26:55.919 23:19:22 -- host/digest.sh@83 -- # waitforlisten 317064 /var/tmp/bperf.sock 00:26:55.919 23:19:22 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:55.919 23:19:22 -- common/autotest_common.sh@829 -- # '[' -z 317064 ']' 00:26:55.919 23:19:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:55.919 23:19:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:55.919 23:19:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:55.919 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:55.920 23:19:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:55.920 23:19:22 -- common/autotest_common.sh@10 -- # set +x 00:26:55.920 [2024-11-26 23:19:22.232303] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:55.920 [2024-11-26 23:19:22.232365] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid317064 ] 00:26:55.920 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.920 [2024-11-26 23:19:22.295861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.178 [2024-11-26 23:19:22.409876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:56.178 23:19:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:56.178 23:19:22 -- common/autotest_common.sh@862 -- # return 0 00:26:56.178 23:19:22 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:56.178 23:19:22 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:56.178 23:19:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:56.745 23:19:22 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:56.745 23:19:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.004 nvme0n1 00:26:57.004 23:19:23 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:57.004 23:19:23 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:57.004 Running I/O for 2 seconds... 00:26:59.529 00:26:59.529 Latency(us) 00:26:59.529 [2024-11-26T22:19:25.923Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.529 [2024-11-26T22:19:25.923Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:59.529 nvme0n1 : 2.01 16595.73 64.83 0.00 0.00 7706.11 3616.62 17961.72 00:26:59.529 [2024-11-26T22:19:25.923Z] =================================================================================================================== 00:26:59.529 [2024-11-26T22:19:25.923Z] Total : 16595.73 64.83 0.00 0.00 7706.11 3616.62 17961.72 00:26:59.529 0 00:26:59.529 23:19:25 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:59.529 23:19:25 -- host/digest.sh@92 -- # get_accel_stats 00:26:59.529 23:19:25 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:59.529 23:19:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:59.529 23:19:25 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:59.529 | select(.opcode=="crc32c") 00:26:59.529 | "\(.module_name) \(.executed)"' 00:26:59.529 23:19:25 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:59.529 23:19:25 -- host/digest.sh@93 -- # exp_module=software 00:26:59.529 23:19:25 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:59.529 23:19:25 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:59.529 23:19:25 -- host/digest.sh@97 -- # killprocess 317064 00:26:59.529 23:19:25 -- common/autotest_common.sh@936 -- # '[' -z 317064 ']' 00:26:59.529 23:19:25 -- common/autotest_common.sh@940 -- # kill -0 317064 00:26:59.529 23:19:25 -- common/autotest_common.sh@941 -- # uname 00:26:59.529 23:19:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:59.529 23:19:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 317064 00:26:59.529 23:19:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:59.529 23:19:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:59.529 23:19:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 317064' 00:26:59.529 killing process with pid 317064 00:26:59.529 23:19:25 -- common/autotest_common.sh@955 -- # kill 317064 00:26:59.529 Received shutdown signal, test time was about 2.000000 seconds 00:26:59.529 00:26:59.529 Latency(us) 00:26:59.529 [2024-11-26T22:19:25.923Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.529 [2024-11-26T22:19:25.923Z] =================================================================================================================== 00:26:59.529 [2024-11-26T22:19:25.923Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:59.529 23:19:25 -- common/autotest_common.sh@960 -- # wait 317064 00:26:59.787 23:19:25 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:59.787 23:19:25 -- host/digest.sh@77 -- # local rw bs qd 00:26:59.787 23:19:25 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:59.787 23:19:25 -- host/digest.sh@80 -- # rw=randread 00:26:59.787 23:19:25 -- host/digest.sh@80 -- # bs=131072 00:26:59.787 23:19:25 -- host/digest.sh@80 -- # qd=16 00:26:59.787 23:19:25 -- host/digest.sh@82 -- # bperfpid=317605 00:26:59.787 23:19:25 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:59.787 23:19:25 -- host/digest.sh@83 -- # waitforlisten 317605 /var/tmp/bperf.sock 00:26:59.787 23:19:25 -- common/autotest_common.sh@829 -- # '[' -z 317605 ']' 00:26:59.787 23:19:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:59.787 23:19:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:59.787 23:19:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:59.787 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:59.787 23:19:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:59.787 23:19:25 -- common/autotest_common.sh@10 -- # set +x 00:26:59.787 [2024-11-26 23:19:25.991858] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:59.787 [2024-11-26 23:19:25.991937] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid317605 ] 00:26:59.787 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:59.787 Zero copy mechanism will not be used. 00:26:59.787 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.787 [2024-11-26 23:19:26.052864] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:59.787 [2024-11-26 23:19:26.166311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:00.045 23:19:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:00.045 23:19:26 -- common/autotest_common.sh@862 -- # return 0 00:27:00.045 23:19:26 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:00.045 23:19:26 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:00.045 23:19:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:00.303 23:19:26 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:00.303 23:19:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:00.561 nvme0n1 00:27:00.561 23:19:26 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:00.561 23:19:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:00.818 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:00.819 Zero copy mechanism will not be used. 00:27:00.819 Running I/O for 2 seconds... 00:27:02.718 00:27:02.718 Latency(us) 00:27:02.718 [2024-11-26T22:19:29.112Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:02.718 [2024-11-26T22:19:29.112Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:02.718 nvme0n1 : 2.00 6445.06 805.63 0.00 0.00 2478.76 679.63 6359.42 00:27:02.718 [2024-11-26T22:19:29.112Z] =================================================================================================================== 00:27:02.718 [2024-11-26T22:19:29.112Z] Total : 6445.06 805.63 0.00 0.00 2478.76 679.63 6359.42 00:27:02.718 0 00:27:02.718 23:19:29 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:02.718 23:19:29 -- host/digest.sh@92 -- # get_accel_stats 00:27:02.718 23:19:29 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:02.718 23:19:29 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:02.718 | select(.opcode=="crc32c") 00:27:02.718 | "\(.module_name) \(.executed)"' 00:27:02.718 23:19:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:03.282 23:19:29 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:03.282 23:19:29 -- host/digest.sh@93 -- # exp_module=software 00:27:03.282 23:19:29 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:03.282 23:19:29 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:03.282 23:19:29 -- host/digest.sh@97 -- # killprocess 317605 00:27:03.282 23:19:29 -- common/autotest_common.sh@936 -- # '[' -z 317605 ']' 00:27:03.282 23:19:29 -- common/autotest_common.sh@940 -- # kill -0 317605 00:27:03.282 23:19:29 -- common/autotest_common.sh@941 -- # uname 00:27:03.282 23:19:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:03.282 23:19:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 317605 00:27:03.282 23:19:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:03.282 23:19:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:03.282 23:19:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 317605' 00:27:03.282 killing process with pid 317605 00:27:03.282 23:19:29 -- common/autotest_common.sh@955 -- # kill 317605 00:27:03.282 Received shutdown signal, test time was about 2.000000 seconds 00:27:03.282 00:27:03.282 Latency(us) 00:27:03.282 [2024-11-26T22:19:29.676Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:03.282 [2024-11-26T22:19:29.676Z] =================================================================================================================== 00:27:03.282 [2024-11-26T22:19:29.676Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:03.282 23:19:29 -- common/autotest_common.sh@960 -- # wait 317605 00:27:03.540 23:19:29 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:27:03.540 23:19:29 -- host/digest.sh@77 -- # local rw bs qd 00:27:03.540 23:19:29 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:03.540 23:19:29 -- host/digest.sh@80 -- # rw=randwrite 00:27:03.540 23:19:29 -- host/digest.sh@80 -- # bs=4096 00:27:03.540 23:19:29 -- host/digest.sh@80 -- # qd=128 00:27:03.540 23:19:29 -- host/digest.sh@82 -- # bperfpid=318030 00:27:03.540 23:19:29 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:27:03.540 23:19:29 -- host/digest.sh@83 -- # waitforlisten 318030 /var/tmp/bperf.sock 00:27:03.540 23:19:29 -- common/autotest_common.sh@829 -- # '[' -z 318030 ']' 00:27:03.540 23:19:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:03.540 23:19:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:03.540 23:19:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:03.540 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:03.540 23:19:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:03.540 23:19:29 -- common/autotest_common.sh@10 -- # set +x 00:27:03.540 [2024-11-26 23:19:29.725165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:03.540 [2024-11-26 23:19:29.725255] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid318030 ] 00:27:03.540 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.540 [2024-11-26 23:19:29.783190] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:03.540 [2024-11-26 23:19:29.889594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:03.798 23:19:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:03.798 23:19:29 -- common/autotest_common.sh@862 -- # return 0 00:27:03.798 23:19:29 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:03.798 23:19:29 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:03.798 23:19:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:04.056 23:19:30 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:04.056 23:19:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:04.315 nvme0n1 00:27:04.315 23:19:30 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:04.315 23:19:30 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:04.573 Running I/O for 2 seconds... 00:27:06.473 00:27:06.473 Latency(us) 00:27:06.473 [2024-11-26T22:19:32.867Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:06.473 [2024-11-26T22:19:32.867Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:06.473 nvme0n1 : 2.01 20322.15 79.38 0.00 0.00 6284.82 2560.76 15243.19 00:27:06.473 [2024-11-26T22:19:32.867Z] =================================================================================================================== 00:27:06.473 [2024-11-26T22:19:32.867Z] Total : 20322.15 79.38 0.00 0.00 6284.82 2560.76 15243.19 00:27:06.473 0 00:27:06.473 23:19:32 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:06.473 23:19:32 -- host/digest.sh@92 -- # get_accel_stats 00:27:06.473 23:19:32 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:06.473 23:19:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:06.473 23:19:32 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:06.473 | select(.opcode=="crc32c") 00:27:06.473 | "\(.module_name) \(.executed)"' 00:27:06.731 23:19:33 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:06.731 23:19:33 -- host/digest.sh@93 -- # exp_module=software 00:27:06.731 23:19:33 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:06.731 23:19:33 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:06.731 23:19:33 -- host/digest.sh@97 -- # killprocess 318030 00:27:06.731 23:19:33 -- common/autotest_common.sh@936 -- # '[' -z 318030 ']' 00:27:06.731 23:19:33 -- common/autotest_common.sh@940 -- # kill -0 318030 00:27:06.731 23:19:33 -- common/autotest_common.sh@941 -- # uname 00:27:06.731 23:19:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:06.731 23:19:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 318030 00:27:06.989 23:19:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:06.989 23:19:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:06.989 23:19:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 318030' 00:27:06.989 killing process with pid 318030 00:27:06.989 23:19:33 -- common/autotest_common.sh@955 -- # kill 318030 00:27:06.989 Received shutdown signal, test time was about 2.000000 seconds 00:27:06.989 00:27:06.989 Latency(us) 00:27:06.989 [2024-11-26T22:19:33.383Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:06.989 [2024-11-26T22:19:33.383Z] =================================================================================================================== 00:27:06.989 [2024-11-26T22:19:33.383Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:06.989 23:19:33 -- common/autotest_common.sh@960 -- # wait 318030 00:27:07.247 23:19:33 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:07.247 23:19:33 -- host/digest.sh@77 -- # local rw bs qd 00:27:07.247 23:19:33 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:07.247 23:19:33 -- host/digest.sh@80 -- # rw=randwrite 00:27:07.247 23:19:33 -- host/digest.sh@80 -- # bs=131072 00:27:07.247 23:19:33 -- host/digest.sh@80 -- # qd=16 00:27:07.247 23:19:33 -- host/digest.sh@82 -- # bperfpid=318452 00:27:07.247 23:19:33 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:07.247 23:19:33 -- host/digest.sh@83 -- # waitforlisten 318452 /var/tmp/bperf.sock 00:27:07.247 23:19:33 -- common/autotest_common.sh@829 -- # '[' -z 318452 ']' 00:27:07.247 23:19:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:07.247 23:19:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:07.247 23:19:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:07.247 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:07.247 23:19:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:07.247 23:19:33 -- common/autotest_common.sh@10 -- # set +x 00:27:07.247 [2024-11-26 23:19:33.462120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:07.247 [2024-11-26 23:19:33.462210] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid318452 ] 00:27:07.247 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:07.247 Zero copy mechanism will not be used. 00:27:07.247 EAL: No free 2048 kB hugepages reported on node 1 00:27:07.247 [2024-11-26 23:19:33.519575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:07.247 [2024-11-26 23:19:33.629172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:07.505 23:19:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:07.505 23:19:33 -- common/autotest_common.sh@862 -- # return 0 00:27:07.505 23:19:33 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:07.505 23:19:33 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:07.505 23:19:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:07.763 23:19:34 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.763 23:19:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:08.328 nvme0n1 00:27:08.328 23:19:34 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:08.328 23:19:34 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:08.328 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:08.328 Zero copy mechanism will not be used. 00:27:08.328 Running I/O for 2 seconds... 00:27:10.227 00:27:10.227 Latency(us) 00:27:10.227 [2024-11-26T22:19:36.621Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.227 [2024-11-26T22:19:36.621Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:10.227 nvme0n1 : 2.00 7043.33 880.42 0.00 0.00 2264.74 1820.44 7573.05 00:27:10.227 [2024-11-26T22:19:36.621Z] =================================================================================================================== 00:27:10.227 [2024-11-26T22:19:36.621Z] Total : 7043.33 880.42 0.00 0.00 2264.74 1820.44 7573.05 00:27:10.227 0 00:27:10.227 23:19:36 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:10.227 23:19:36 -- host/digest.sh@92 -- # get_accel_stats 00:27:10.227 23:19:36 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:10.227 23:19:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:10.227 23:19:36 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:10.227 | select(.opcode=="crc32c") 00:27:10.227 | "\(.module_name) \(.executed)"' 00:27:10.485 23:19:36 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:10.485 23:19:36 -- host/digest.sh@93 -- # exp_module=software 00:27:10.485 23:19:36 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:10.485 23:19:36 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:10.485 23:19:36 -- host/digest.sh@97 -- # killprocess 318452 00:27:10.485 23:19:36 -- common/autotest_common.sh@936 -- # '[' -z 318452 ']' 00:27:10.485 23:19:36 -- common/autotest_common.sh@940 -- # kill -0 318452 00:27:10.485 23:19:36 -- common/autotest_common.sh@941 -- # uname 00:27:10.485 23:19:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:10.485 23:19:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 318452 00:27:10.743 23:19:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:10.743 23:19:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:10.743 23:19:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 318452' 00:27:10.743 killing process with pid 318452 00:27:10.743 23:19:36 -- common/autotest_common.sh@955 -- # kill 318452 00:27:10.743 Received shutdown signal, test time was about 2.000000 seconds 00:27:10.743 00:27:10.743 Latency(us) 00:27:10.743 [2024-11-26T22:19:37.137Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.743 [2024-11-26T22:19:37.137Z] =================================================================================================================== 00:27:10.743 [2024-11-26T22:19:37.137Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:10.743 23:19:36 -- common/autotest_common.sh@960 -- # wait 318452 00:27:11.001 23:19:37 -- host/digest.sh@126 -- # killprocess 317036 00:27:11.001 23:19:37 -- common/autotest_common.sh@936 -- # '[' -z 317036 ']' 00:27:11.001 23:19:37 -- common/autotest_common.sh@940 -- # kill -0 317036 00:27:11.001 23:19:37 -- common/autotest_common.sh@941 -- # uname 00:27:11.001 23:19:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:11.001 23:19:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 317036 00:27:11.001 23:19:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:11.001 23:19:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:11.001 23:19:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 317036' 00:27:11.001 killing process with pid 317036 00:27:11.001 23:19:37 -- common/autotest_common.sh@955 -- # kill 317036 00:27:11.001 23:19:37 -- common/autotest_common.sh@960 -- # wait 317036 00:27:11.260 00:27:11.260 real 0m15.702s 00:27:11.260 user 0m31.238s 00:27:11.260 sys 0m4.320s 00:27:11.260 23:19:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:11.260 23:19:37 -- common/autotest_common.sh@10 -- # set +x 00:27:11.260 ************************************ 00:27:11.260 END TEST nvmf_digest_clean 00:27:11.260 ************************************ 00:27:11.260 23:19:37 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:11.260 23:19:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:11.260 23:19:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:11.260 23:19:37 -- common/autotest_common.sh@10 -- # set +x 00:27:11.260 ************************************ 00:27:11.260 START TEST nvmf_digest_error 00:27:11.260 ************************************ 00:27:11.260 23:19:37 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:11.260 23:19:37 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:11.260 23:19:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:11.260 23:19:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:11.260 23:19:37 -- common/autotest_common.sh@10 -- # set +x 00:27:11.260 23:19:37 -- nvmf/common.sh@469 -- # nvmfpid=319018 00:27:11.260 23:19:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:11.260 23:19:37 -- nvmf/common.sh@470 -- # waitforlisten 319018 00:27:11.260 23:19:37 -- common/autotest_common.sh@829 -- # '[' -z 319018 ']' 00:27:11.260 23:19:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:11.260 23:19:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:11.260 23:19:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:11.260 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:11.260 23:19:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:11.260 23:19:37 -- common/autotest_common.sh@10 -- # set +x 00:27:11.260 [2024-11-26 23:19:37.534621] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:11.261 [2024-11-26 23:19:37.534709] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:11.261 EAL: No free 2048 kB hugepages reported on node 1 00:27:11.261 [2024-11-26 23:19:37.598998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:11.519 [2024-11-26 23:19:37.704688] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:11.519 [2024-11-26 23:19:37.704836] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:11.519 [2024-11-26 23:19:37.704855] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:11.519 [2024-11-26 23:19:37.704868] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:11.519 [2024-11-26 23:19:37.704895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:11.519 23:19:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:11.519 23:19:37 -- common/autotest_common.sh@862 -- # return 0 00:27:11.519 23:19:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:11.519 23:19:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:11.519 23:19:37 -- common/autotest_common.sh@10 -- # set +x 00:27:11.519 23:19:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:11.519 23:19:37 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:11.519 23:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:11.519 23:19:37 -- common/autotest_common.sh@10 -- # set +x 00:27:11.519 [2024-11-26 23:19:37.777452] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:11.519 23:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:11.519 23:19:37 -- host/digest.sh@104 -- # common_target_config 00:27:11.519 23:19:37 -- host/digest.sh@43 -- # rpc_cmd 00:27:11.519 23:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:11.519 23:19:37 -- common/autotest_common.sh@10 -- # set +x 00:27:11.519 null0 00:27:11.519 [2024-11-26 23:19:37.896946] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:11.777 [2024-11-26 23:19:37.921202] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:11.777 23:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:11.778 23:19:37 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:11.778 23:19:37 -- host/digest.sh@54 -- # local rw bs qd 00:27:11.778 23:19:37 -- host/digest.sh@56 -- # rw=randread 00:27:11.778 23:19:37 -- host/digest.sh@56 -- # bs=4096 00:27:11.778 23:19:37 -- host/digest.sh@56 -- # qd=128 00:27:11.778 23:19:37 -- host/digest.sh@58 -- # bperfpid=319045 00:27:11.778 23:19:37 -- host/digest.sh@60 -- # waitforlisten 319045 /var/tmp/bperf.sock 00:27:11.778 23:19:37 -- common/autotest_common.sh@829 -- # '[' -z 319045 ']' 00:27:11.778 23:19:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:11.778 23:19:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:11.778 23:19:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:11.778 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:11.778 23:19:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:11.778 23:19:37 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:11.778 23:19:37 -- common/autotest_common.sh@10 -- # set +x 00:27:11.778 [2024-11-26 23:19:37.969699] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:11.778 [2024-11-26 23:19:37.969774] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid319045 ] 00:27:11.778 EAL: No free 2048 kB hugepages reported on node 1 00:27:11.778 [2024-11-26 23:19:38.036602] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:11.778 [2024-11-26 23:19:38.148943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:12.711 23:19:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:12.711 23:19:38 -- common/autotest_common.sh@862 -- # return 0 00:27:12.711 23:19:38 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:12.711 23:19:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:12.975 23:19:39 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:12.975 23:19:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.975 23:19:39 -- common/autotest_common.sh@10 -- # set +x 00:27:12.975 23:19:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.975 23:19:39 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.975 23:19:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:13.542 nvme0n1 00:27:13.542 23:19:39 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:13.542 23:19:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:13.542 23:19:39 -- common/autotest_common.sh@10 -- # set +x 00:27:13.542 23:19:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:13.542 23:19:39 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:13.542 23:19:39 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:13.542 Running I/O for 2 seconds... 00:27:13.542 [2024-11-26 23:19:39.887406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.542 [2024-11-26 23:19:39.887466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:1280 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.542 [2024-11-26 23:19:39.887491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.542 [2024-11-26 23:19:39.902980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.542 [2024-11-26 23:19:39.903020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:7623 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.542 [2024-11-26 23:19:39.903040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.542 [2024-11-26 23:19:39.914354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.542 [2024-11-26 23:19:39.914392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:20763 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.542 [2024-11-26 23:19:39.914412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.542 [2024-11-26 23:19:39.931836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.542 [2024-11-26 23:19:39.931872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:9606 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.542 [2024-11-26 23:19:39.931892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:39.947744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:39.947781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:21073 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:39.947798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:39.962043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:39.962079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:10773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:39.962099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:39.975558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:39.975613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:25038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:39.975630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:39.993380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:39.993416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5959 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:39.993436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.011154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.011207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.011237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.029175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.029226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.029249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.046425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.046480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:4984 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.046501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.062439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.062477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:16429 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.062496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.081636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.081681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:8119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.081711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.098999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.099030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:9696 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.099046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.116043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.116087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:1474 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.116105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.133167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.133212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:8848 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.133230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.150228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.150264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:3231 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.150285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.167387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.167434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:24455 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.167450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.178508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.178552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:22852 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.178589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.802 [2024-11-26 23:19:40.193074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:13.802 [2024-11-26 23:19:40.193105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:4402 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.802 [2024-11-26 23:19:40.193122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.210163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.210193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10438 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.210210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.227171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.227215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9947 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.227232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.244082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.244117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:18825 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.244150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.268414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.268450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:4429 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.268470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.285409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.285445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:12143 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.285464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.296536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.296570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:11403 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.296606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.312647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.312676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:1802 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.312693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.329633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.329662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:14466 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.329678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.346664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.346692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:7115 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.346708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.364121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.061 [2024-11-26 23:19:40.364156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:16563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.061 [2024-11-26 23:19:40.364182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.061 [2024-11-26 23:19:40.381600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.062 [2024-11-26 23:19:40.381648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:23857 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.062 [2024-11-26 23:19:40.381668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.062 [2024-11-26 23:19:40.399044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.062 [2024-11-26 23:19:40.399074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5865 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.062 [2024-11-26 23:19:40.399107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.062 [2024-11-26 23:19:40.410179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.062 [2024-11-26 23:19:40.410225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.062 [2024-11-26 23:19:40.410244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.062 [2024-11-26 23:19:40.426709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.062 [2024-11-26 23:19:40.426744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:19682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.062 [2024-11-26 23:19:40.426763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.062 [2024-11-26 23:19:40.443036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.062 [2024-11-26 23:19:40.443092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19542 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.062 [2024-11-26 23:19:40.443112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.320 [2024-11-26 23:19:40.460698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.320 [2024-11-26 23:19:40.460730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.320 [2024-11-26 23:19:40.460747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.320 [2024-11-26 23:19:40.477786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.320 [2024-11-26 23:19:40.477815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:24081 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.320 [2024-11-26 23:19:40.477830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.320 [2024-11-26 23:19:40.495208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.320 [2024-11-26 23:19:40.495244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:15893 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.320 [2024-11-26 23:19:40.495263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.320 [2024-11-26 23:19:40.512997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.320 [2024-11-26 23:19:40.513033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:14278 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.513051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.530093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.530123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:2513 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.530138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.546970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.547005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:20495 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.547025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.563775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.563825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:8889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.563844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.580757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.580786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:6070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.580803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.597738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.597769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:9390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.597786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.614295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.614330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:19428 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.614350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.631213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.631250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:15532 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.631270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.648147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.648182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:4946 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.648202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.665024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.665059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:16242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.665078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.682242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.682277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:21109 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.682296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.321 [2024-11-26 23:19:40.699114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.321 [2024-11-26 23:19:40.699149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:826 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.321 [2024-11-26 23:19:40.699169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.578 [2024-11-26 23:19:40.716408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.578 [2024-11-26 23:19:40.716443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:12979 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.578 [2024-11-26 23:19:40.716462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.578 [2024-11-26 23:19:40.733851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.578 [2024-11-26 23:19:40.733887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23651 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.578 [2024-11-26 23:19:40.733907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.578 [2024-11-26 23:19:40.750952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.578 [2024-11-26 23:19:40.750981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:18578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.578 [2024-11-26 23:19:40.750997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.578 [2024-11-26 23:19:40.766677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.578 [2024-11-26 23:19:40.766708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:24867 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.578 [2024-11-26 23:19:40.766725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.578 [2024-11-26 23:19:40.785696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.578 [2024-11-26 23:19:40.785727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:11492 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.578 [2024-11-26 23:19:40.785744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.578 [2024-11-26 23:19:40.802754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.578 [2024-11-26 23:19:40.802783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:3126 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.578 [2024-11-26 23:19:40.802820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.578 [2024-11-26 23:19:40.819731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.578 [2024-11-26 23:19:40.819762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:15612 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.578 [2024-11-26 23:19:40.819780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.578 [2024-11-26 23:19:40.835413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.578 [2024-11-26 23:19:40.835448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:18067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.835467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.579 [2024-11-26 23:19:40.847437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.579 [2024-11-26 23:19:40.847471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:9691 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.847491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.579 [2024-11-26 23:19:40.864582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.579 [2024-11-26 23:19:40.864611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:2066 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.864643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.579 [2024-11-26 23:19:40.881563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.579 [2024-11-26 23:19:40.881608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:613 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.881624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.579 [2024-11-26 23:19:40.898488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.579 [2024-11-26 23:19:40.898523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:17191 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.898566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.579 [2024-11-26 23:19:40.915572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.579 [2024-11-26 23:19:40.915601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:8325 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.915617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.579 [2024-11-26 23:19:40.932502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.579 [2024-11-26 23:19:40.932544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:18315 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.932564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.579 [2024-11-26 23:19:40.949639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.579 [2024-11-26 23:19:40.949668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9581 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.949685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.579 [2024-11-26 23:19:40.966480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.579 [2024-11-26 23:19:40.966514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.579 [2024-11-26 23:19:40.966542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:40.983919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:40.983953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:20666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:40.983973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.001267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.001301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:25254 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.001320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.018495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.018550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:12968 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.018583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.034969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.035006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.035026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.049400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.049437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:12611 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.049467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.066345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.066380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:16347 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.066410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.083430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.083465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1174 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.083495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.099271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.099305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.099325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.116134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.116168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:12762 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.116186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.132873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.132901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:16909 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.132919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.148609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.148639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:2474 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.148672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.166835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.166870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:20871 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.166889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.183721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.183750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:4394 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.183770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.199361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.199395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:6804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.199414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.211287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.211320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:21059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.211340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.837 [2024-11-26 23:19:41.229178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:14.837 [2024-11-26 23:19:41.229220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.837 [2024-11-26 23:19:41.229240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.241372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.241407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:6858 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.241426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.253832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.253863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:10035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.253882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.266771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.266801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:1716 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.266819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.278622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.278650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:57 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.278667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.290799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.290842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.290862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.304720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.304750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:3103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.304782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.320893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.320927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22847 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.320946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.337892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.337927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:12488 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.337946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.355603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.355632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:7188 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.355649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.372404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.372438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:25088 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.372457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.389055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.389088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:14357 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.389108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.406195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.406228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:298 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.406247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.422996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.423030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:19872 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.423049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.439831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.439859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:25579 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.439892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.456551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.456599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:8022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.456616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.096 [2024-11-26 23:19:41.473498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.096 [2024-11-26 23:19:41.473538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:10728 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.096 [2024-11-26 23:19:41.473573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.490606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.490637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:23876 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.490664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.507612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.507641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:18789 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.507660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.524661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.524688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:790 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.524708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.541490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.541532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.541553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.558390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.558425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:12616 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.558444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.575439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.575474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:17507 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.575493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.592685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.592713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:17749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.592729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.609408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.609442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5606 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.609462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.354 [2024-11-26 23:19:41.624837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.354 [2024-11-26 23:19:41.624869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:6375 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.354 [2024-11-26 23:19:41.624888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.355 [2024-11-26 23:19:41.636615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.355 [2024-11-26 23:19:41.636651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:16204 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.355 [2024-11-26 23:19:41.636668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.355 [2024-11-26 23:19:41.653707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.355 [2024-11-26 23:19:41.653736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.355 [2024-11-26 23:19:41.653753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.355 [2024-11-26 23:19:41.671243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.355 [2024-11-26 23:19:41.671278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:4976 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.355 [2024-11-26 23:19:41.671297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.355 [2024-11-26 23:19:41.687783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.355 [2024-11-26 23:19:41.687831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:8777 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.355 [2024-11-26 23:19:41.687850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.355 [2024-11-26 23:19:41.704065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.355 [2024-11-26 23:19:41.704100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:18163 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.355 [2024-11-26 23:19:41.704119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.355 [2024-11-26 23:19:41.719014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.355 [2024-11-26 23:19:41.719047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:21255 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.355 [2024-11-26 23:19:41.719067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.355 [2024-11-26 23:19:41.730224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.355 [2024-11-26 23:19:41.730258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:12783 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.355 [2024-11-26 23:19:41.730277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.355 [2024-11-26 23:19:41.744002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.355 [2024-11-26 23:19:41.744036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9352 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.355 [2024-11-26 23:19:41.744055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.613 [2024-11-26 23:19:41.761568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.613 [2024-11-26 23:19:41.761597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:9376 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.613 [2024-11-26 23:19:41.761613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.613 [2024-11-26 23:19:41.778248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.613 [2024-11-26 23:19:41.778282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:13870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.613 [2024-11-26 23:19:41.778302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.613 [2024-11-26 23:19:41.795192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.613 [2024-11-26 23:19:41.795227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:1823 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.613 [2024-11-26 23:19:41.795246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.613 [2024-11-26 23:19:41.812107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.613 [2024-11-26 23:19:41.812136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:21933 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.613 [2024-11-26 23:19:41.812152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.613 [2024-11-26 23:19:41.829260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.613 [2024-11-26 23:19:41.829295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:5127 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.613 [2024-11-26 23:19:41.829315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.613 [2024-11-26 23:19:41.844605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.613 [2024-11-26 23:19:41.844636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4921 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.613 [2024-11-26 23:19:41.844654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.613 [2024-11-26 23:19:41.862890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2384bb0) 00:27:15.613 [2024-11-26 23:19:41.862918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:17966 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.613 [2024-11-26 23:19:41.862934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.613 00:27:15.613 Latency(us) 00:27:15.613 [2024-11-26T22:19:42.007Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:15.613 [2024-11-26T22:19:42.007Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:15.613 nvme0n1 : 2.01 15612.05 60.98 0.00 0.00 8191.77 3276.80 32622.36 00:27:15.613 [2024-11-26T22:19:42.007Z] =================================================================================================================== 00:27:15.613 [2024-11-26T22:19:42.007Z] Total : 15612.05 60.98 0.00 0.00 8191.77 3276.80 32622.36 00:27:15.613 0 00:27:15.613 23:19:41 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:15.613 23:19:41 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:15.613 23:19:41 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:15.613 | .driver_specific 00:27:15.613 | .nvme_error 00:27:15.613 | .status_code 00:27:15.613 | .command_transient_transport_error' 00:27:15.613 23:19:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:15.872 23:19:42 -- host/digest.sh@71 -- # (( 122 > 0 )) 00:27:15.872 23:19:42 -- host/digest.sh@73 -- # killprocess 319045 00:27:15.872 23:19:42 -- common/autotest_common.sh@936 -- # '[' -z 319045 ']' 00:27:15.872 23:19:42 -- common/autotest_common.sh@940 -- # kill -0 319045 00:27:15.872 23:19:42 -- common/autotest_common.sh@941 -- # uname 00:27:15.872 23:19:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:15.872 23:19:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319045 00:27:15.872 23:19:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:15.872 23:19:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:15.872 23:19:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319045' 00:27:15.872 killing process with pid 319045 00:27:15.872 23:19:42 -- common/autotest_common.sh@955 -- # kill 319045 00:27:15.872 Received shutdown signal, test time was about 2.000000 seconds 00:27:15.872 00:27:15.872 Latency(us) 00:27:15.872 [2024-11-26T22:19:42.266Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:15.872 [2024-11-26T22:19:42.266Z] =================================================================================================================== 00:27:15.872 [2024-11-26T22:19:42.266Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:15.872 23:19:42 -- common/autotest_common.sh@960 -- # wait 319045 00:27:16.130 23:19:42 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:16.130 23:19:42 -- host/digest.sh@54 -- # local rw bs qd 00:27:16.130 23:19:42 -- host/digest.sh@56 -- # rw=randread 00:27:16.130 23:19:42 -- host/digest.sh@56 -- # bs=131072 00:27:16.130 23:19:42 -- host/digest.sh@56 -- # qd=16 00:27:16.130 23:19:42 -- host/digest.sh@58 -- # bperfpid=319599 00:27:16.130 23:19:42 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:16.130 23:19:42 -- host/digest.sh@60 -- # waitforlisten 319599 /var/tmp/bperf.sock 00:27:16.130 23:19:42 -- common/autotest_common.sh@829 -- # '[' -z 319599 ']' 00:27:16.130 23:19:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:16.130 23:19:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:16.130 23:19:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:16.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:16.130 23:19:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:16.130 23:19:42 -- common/autotest_common.sh@10 -- # set +x 00:27:16.130 [2024-11-26 23:19:42.489697] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:16.130 [2024-11-26 23:19:42.489786] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid319599 ] 00:27:16.130 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:16.130 Zero copy mechanism will not be used. 00:27:16.130 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.388 [2024-11-26 23:19:42.553711] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:16.388 [2024-11-26 23:19:42.660890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:17.320 23:19:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:17.320 23:19:43 -- common/autotest_common.sh@862 -- # return 0 00:27:17.320 23:19:43 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:17.320 23:19:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:17.320 23:19:43 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:17.320 23:19:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:17.320 23:19:43 -- common/autotest_common.sh@10 -- # set +x 00:27:17.578 23:19:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:17.578 23:19:43 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:17.578 23:19:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:17.836 nvme0n1 00:27:17.836 23:19:44 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:17.836 23:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:17.836 23:19:44 -- common/autotest_common.sh@10 -- # set +x 00:27:17.836 23:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:17.836 23:19:44 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:17.836 23:19:44 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:18.095 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:18.095 Zero copy mechanism will not be used. 00:27:18.095 Running I/O for 2 seconds... 00:27:18.095 [2024-11-26 23:19:44.344232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.344292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.344314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.349469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.349506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.349535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.354854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.354889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.354909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.359347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.359380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.359399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.363859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.363905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.363924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.368532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.368579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.368596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.372814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.372843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.372859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.377276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.377309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.377327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.381870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.381904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.381922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.386153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.386185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.386204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.390485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.390517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.390561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.394801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.394830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.394864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.399169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.095 [2024-11-26 23:19:44.399201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.095 [2024-11-26 23:19:44.399220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.095 [2024-11-26 23:19:44.403573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.403602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.403618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.407791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.407828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.407861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.412115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.412148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.412185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.416922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.416957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.416987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.422166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.422201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.422231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.426802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.426856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.426876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.431919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.431954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.431973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.436583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.436614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.436632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.440994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.441028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.441047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.445492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.445547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.445585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.450343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.450377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.450397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.454972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.455012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.455038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.459732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.459762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.459780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.464495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.464545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.464566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.469096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.469130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.469149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.474409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.474443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.474464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.479342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.479375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.479395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.096 [2024-11-26 23:19:44.486038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.096 [2024-11-26 23:19:44.486073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.096 [2024-11-26 23:19:44.486092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.491692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.491723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.491741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.497378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.497412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.497432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.503885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.503920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.503940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.509950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.509984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.510003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.515881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.515915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.515935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.522114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.522148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.522176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.527786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.527828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.527845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.532452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.532485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.532504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.537067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.537100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.537118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.542228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.542262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.542287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.547026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.547060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.547090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.552090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.552125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.552144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.556972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.557007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.557029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.562723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.562755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.562772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.568488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.568522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.568552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.573104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.573138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.573157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.577048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.577082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.577101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.581579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.581625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.581645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.587761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.587792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.356 [2024-11-26 23:19:44.587813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.356 [2024-11-26 23:19:44.592613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.356 [2024-11-26 23:19:44.592643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.592661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.597345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.597378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.597399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.603087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.603121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.603141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.608045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.608080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.608099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.613597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.613628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.613649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.619806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.619836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.619876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.624916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.624950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.624969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.629575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.629622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.629647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.635274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.635307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.635336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.639680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.639711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.639731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.644313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.644346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.644365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.648715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.648745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.648762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.653218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.653250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.653268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.657607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.657635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.657654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.662024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.662057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.662075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.666363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.666395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.666414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.670842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.670889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.670909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.675447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.675485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.675504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.680056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.680089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.680113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.684595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.684624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.684641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.689215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.689249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.689268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.693679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.693709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.693728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.698074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.698107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.698127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.702470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.702503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.702522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.707015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.707047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.707065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.711333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.711365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.711385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.715847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.715894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.357 [2024-11-26 23:19:44.715914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.357 [2024-11-26 23:19:44.720266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.357 [2024-11-26 23:19:44.720298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.358 [2024-11-26 23:19:44.720321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.358 [2024-11-26 23:19:44.724742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.358 [2024-11-26 23:19:44.724772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.358 [2024-11-26 23:19:44.724791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.358 [2024-11-26 23:19:44.729358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.358 [2024-11-26 23:19:44.729391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.358 [2024-11-26 23:19:44.729409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.358 [2024-11-26 23:19:44.733811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.358 [2024-11-26 23:19:44.733860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.358 [2024-11-26 23:19:44.733879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.358 [2024-11-26 23:19:44.738263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.358 [2024-11-26 23:19:44.738295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.358 [2024-11-26 23:19:44.738315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.358 [2024-11-26 23:19:44.742763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.358 [2024-11-26 23:19:44.742792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.358 [2024-11-26 23:19:44.742809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.358 [2024-11-26 23:19:44.747309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.358 [2024-11-26 23:19:44.747342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.358 [2024-11-26 23:19:44.747368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.751775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.751804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.751852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.757034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.757068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.757095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.762204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.762236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.762257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.766978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.767011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.767031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.771717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.771746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.771764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.777304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.777337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.777355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.782036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.782068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.782088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.787547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.787593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.787610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.792714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.792745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.792767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.797810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.797863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.797882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.802784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.802829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.802848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.808096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.808130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.808149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.813366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.813401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.813421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.818608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.617 [2024-11-26 23:19:44.818639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.617 [2024-11-26 23:19:44.818657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.617 [2024-11-26 23:19:44.823731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.823762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.823782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.830224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.830259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.830278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.836105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.836139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.836158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.843082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.843116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.843136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.850686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.850735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.850752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.858425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.858459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.858479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.865973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.866008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.866027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.873438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.873472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.873490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.880868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.880902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.880922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.888389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.888422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.888442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.895917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.895951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.895975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.903437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.903471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.903491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.910947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.910981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.911012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.918481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.918533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.918553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.926052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.926085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.926105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.933629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.933661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.933678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.941118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.941153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.941172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.948644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.948675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.948692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.956155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.956189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.956209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.962439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.962475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.962498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.968353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.968387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.968408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.974251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.974285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.974305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.980227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.980261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.980285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.986107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.986150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.986169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.990668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.990697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.990714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:44.996715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:44.996745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:44.996763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.618 [2024-11-26 23:19:45.003959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.618 [2024-11-26 23:19:45.004003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.618 [2024-11-26 23:19:45.004021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.011015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.011050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.011078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.016603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.016635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.016652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.020414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.020448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.020481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.026624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.026655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.026673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.032716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.032748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.032765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.037681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.037710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.037727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.043068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.043101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.043120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.047719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.047748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.047767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.054994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.055029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.055049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.060130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.060164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.060185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.066025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.066058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.066086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.071658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.071693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.071713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.077380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.077413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.077432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.082845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.082891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.082919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.878 [2024-11-26 23:19:45.088600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.878 [2024-11-26 23:19:45.088645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.878 [2024-11-26 23:19:45.088664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.094298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.094332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.094350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.099963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.099997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.100018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.105819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.105853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.105871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.111746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.111777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.111818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.116888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.116922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.116943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.121861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.121909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.121935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.126782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.126835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.126851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.132582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.132612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.132629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.137283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.137317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.137336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.141954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.141987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.142005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.146445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.146477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.146495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.151781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.151812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.151844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.155923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.155955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.155974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.160696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.160726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.160749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.166377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.166411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.166430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.171379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.171413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.171432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.175845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.175891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.175910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.180275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.180307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.180327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.185245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.185278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.185296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.189266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.189299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.189317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.193620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.193649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.193666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.197985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.198018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.198037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.203157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.203197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.203216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.208140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.208172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.208190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.212922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.212954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.212973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.217440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.217473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.879 [2024-11-26 23:19:45.217492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.879 [2024-11-26 23:19:45.222960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.879 [2024-11-26 23:19:45.222993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.880 [2024-11-26 23:19:45.223011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.880 [2024-11-26 23:19:45.228140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.880 [2024-11-26 23:19:45.228181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.880 [2024-11-26 23:19:45.228207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.880 [2024-11-26 23:19:45.233936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.880 [2024-11-26 23:19:45.233971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.880 [2024-11-26 23:19:45.233990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.880 [2024-11-26 23:19:45.240348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.880 [2024-11-26 23:19:45.240382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.880 [2024-11-26 23:19:45.240402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.880 [2024-11-26 23:19:45.246544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.880 [2024-11-26 23:19:45.246591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.880 [2024-11-26 23:19:45.246608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.880 [2024-11-26 23:19:45.252418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.880 [2024-11-26 23:19:45.252454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.880 [2024-11-26 23:19:45.252474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.880 [2024-11-26 23:19:45.258632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.880 [2024-11-26 23:19:45.258664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.880 [2024-11-26 23:19:45.258682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.880 [2024-11-26 23:19:45.264984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:18.880 [2024-11-26 23:19:45.265018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.880 [2024-11-26 23:19:45.265038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.271826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.271859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.139 [2024-11-26 23:19:45.271894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.279254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.279289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.139 [2024-11-26 23:19:45.279309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.286750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.286782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.139 [2024-11-26 23:19:45.286815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.294262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.294297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.139 [2024-11-26 23:19:45.294316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.301861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.301896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.139 [2024-11-26 23:19:45.301915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.309423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.309463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.139 [2024-11-26 23:19:45.309483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.316986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.317021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.139 [2024-11-26 23:19:45.317040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.324770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.324800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.139 [2024-11-26 23:19:45.324817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.139 [2024-11-26 23:19:45.331192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.139 [2024-11-26 23:19:45.331226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.331245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.338004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.338039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.338058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.345578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.345608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.345625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.352939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.352973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.352993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.360390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.360424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.360442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.366794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.366824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.366857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.372192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.372226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.372246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.378428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.378462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.378481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.383202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.383236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.383255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.387762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.387790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.387807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.392591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.392621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.392638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.397295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.397328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.397346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.401865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.401898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.401916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.406460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.406491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.406510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.411161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.411192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.411218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.416121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.416155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.416175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.421353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.421386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.421405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.425993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.426026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.426044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.431661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.431691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.431708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.436521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.436576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.436593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.441170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.441204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.441223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.445770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.445799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.445816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.450293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.450326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.450345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.454607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.454657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.454675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.459151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.459184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.459202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.463501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.463541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.463562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.467906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.467939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.140 [2024-11-26 23:19:45.467958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.140 [2024-11-26 23:19:45.472356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.140 [2024-11-26 23:19:45.472389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.472408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.476733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.476762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.476779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.481074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.481107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.481126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.485585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.485615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.485647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.489938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.489971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.489989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.494458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.494490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.494508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.498790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.498819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.498853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.503305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.503338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.503356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.507830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.507863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.507881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.512340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.512372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.512391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.516684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.516731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.516748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.521184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.521218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.521237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.525517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.525572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.525590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.141 [2024-11-26 23:19:45.529966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.141 [2024-11-26 23:19:45.530000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.141 [2024-11-26 23:19:45.530026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.400 [2024-11-26 23:19:45.535040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.400 [2024-11-26 23:19:45.535075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.400 [2024-11-26 23:19:45.535094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.400 [2024-11-26 23:19:45.539234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.400 [2024-11-26 23:19:45.539268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.400 [2024-11-26 23:19:45.539287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.400 [2024-11-26 23:19:45.544015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.400 [2024-11-26 23:19:45.544049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.400 [2024-11-26 23:19:45.544068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.400 [2024-11-26 23:19:45.548104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.400 [2024-11-26 23:19:45.548138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.400 [2024-11-26 23:19:45.548157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.400 [2024-11-26 23:19:45.552346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.552379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.552398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.556478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.556511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.556538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.560975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.561009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.561028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.565055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.565088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.565108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.569605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.569636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.569654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.574684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.574715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.574732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.579475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.579510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.579539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.583897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.583930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.583949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.588648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.588679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.588697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.593488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.593521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.593551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.598702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.598733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.598750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.604242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.604277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.604296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.610191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.610226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.610256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.616443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.616477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.616497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.622535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.622583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.622600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.628681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.628729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.628751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.634507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.634552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.634586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.639126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.639159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.639179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.643456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.643490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.643509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.647909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.647942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.647961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.653018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.653053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.653072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.658442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.658482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.658502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.664747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.664778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.664796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.670377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.670411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.670430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.675919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.675955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.675974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.681598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.681630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.681647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.687150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.401 [2024-11-26 23:19:45.687184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.401 [2024-11-26 23:19:45.687204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.401 [2024-11-26 23:19:45.692570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.692608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.692641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.697312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.697346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.697365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.702031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.702066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.702085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.707163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.707197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.707216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.712700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.712731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.712749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.718694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.718726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.718743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.724283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.724318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.724338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.729386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.729420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.729440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.734804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.734851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.734871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.740229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.740263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.740282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.746078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.746113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.746132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.751872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.751907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.751933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.757618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.757649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.757667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.762660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.762691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.762709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.767135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.767169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.767188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.771157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.771190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.771209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.775254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.775288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.775307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.780368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.780402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.780422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.785389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.785423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.785442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.402 [2024-11-26 23:19:45.790049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.402 [2024-11-26 23:19:45.790082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.402 [2024-11-26 23:19:45.790101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.662 [2024-11-26 23:19:45.794729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.662 [2024-11-26 23:19:45.794765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.662 [2024-11-26 23:19:45.794783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.662 [2024-11-26 23:19:45.799585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.662 [2024-11-26 23:19:45.799616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.662 [2024-11-26 23:19:45.799633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.662 [2024-11-26 23:19:45.804191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.662 [2024-11-26 23:19:45.804224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.662 [2024-11-26 23:19:45.804242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.662 [2024-11-26 23:19:45.808746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.662 [2024-11-26 23:19:45.808775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.662 [2024-11-26 23:19:45.808792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.662 [2024-11-26 23:19:45.813266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.662 [2024-11-26 23:19:45.813298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.662 [2024-11-26 23:19:45.813316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.817548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.817595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.817612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.822116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.822148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.822166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.827153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.827187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.827206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.832259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.832293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.832313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.837702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.837733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.837750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.842759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.842789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.842806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.847749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.847780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.847797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.851831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.851879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.851899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.854665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.854693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.854708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.858894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.858927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.858945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.863591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.863621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.863637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.867964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.867998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.868017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.872523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.872577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.872600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.876974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.877006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.877024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.881588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.881616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.881632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.886354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.886386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.886405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.891179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.891211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.891230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.895638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.895667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.895683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.900050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.900082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.900100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.904441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.904474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.904492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.908793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.908838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.908854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.913088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.913121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.913141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.917545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.917601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.917617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.921962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.921995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.922014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.926285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.926317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.926336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.930815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.930860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.663 [2024-11-26 23:19:45.930879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.663 [2024-11-26 23:19:45.935221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.663 [2024-11-26 23:19:45.935254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.935273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.939744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.939772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.939789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.944007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.944039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.944057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.948509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.948551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.948590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.952942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.952974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.952993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.957501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.957540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.957575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.961926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.961958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.961976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.966368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.966400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.966418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.970858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.970890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.970909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.975210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.975242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.975260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.979623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.979651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.979668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.984086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.984119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.984137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.988499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.988550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.988586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.992909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.992942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.992960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:45.997258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:45.997292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:45.997311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.001715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.001743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.001758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.006167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.006199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.006218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.010704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.010733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.010749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.015214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.015246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.015264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.019973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.020006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.020025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.024369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.024401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.024419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.029141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.029175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.029195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.033751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.033781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.033797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.038439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.038472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.038491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.042834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.042881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.042900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.047611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.047642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.047660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.664 [2024-11-26 23:19:46.052116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.664 [2024-11-26 23:19:46.052150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.664 [2024-11-26 23:19:46.052170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.057521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.057574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.057609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.062506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.062551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.062571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.068954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.068988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.069014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.075944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.075979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.075998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.083821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.083871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.083889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.090939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.090973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.090994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.097361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.097395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.097414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.103515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.103573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.103593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.109893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.109928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.109947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.117098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.117133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.117152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.124685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.124716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.124748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.132415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.132456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.132477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.924 [2024-11-26 23:19:46.138493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.924 [2024-11-26 23:19:46.138535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.924 [2024-11-26 23:19:46.138556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.144764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.144822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.144843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.151259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.151294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.151315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.158219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.158254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.158273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.164685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.164717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.164735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.172222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.172256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.172275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.178309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.178343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.178367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.183695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.183725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.183742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.189588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.189619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.189636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.195226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.195260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.195278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.200687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.200717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.200737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.206073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.206106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.206126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.210542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.210574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.210606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.215212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.215245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.215264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.220192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.220224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.220246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.226219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.226252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.226272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.232843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.232899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.232919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.238419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.238453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.238474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.243917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.243952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.243978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.249243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.249277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.249301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.253874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.253907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.253928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.259492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.259546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.259583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.265028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.265062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.265081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.269541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.269587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.269612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.274114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.274147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.274166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.278769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.278799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.278818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.283238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.283271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.283289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.287414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.925 [2024-11-26 23:19:46.287447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.925 [2024-11-26 23:19:46.287467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.925 [2024-11-26 23:19:46.291135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.926 [2024-11-26 23:19:46.291168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.926 [2024-11-26 23:19:46.291190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.926 [2024-11-26 23:19:46.295188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.926 [2024-11-26 23:19:46.295221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.926 [2024-11-26 23:19:46.295240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.926 [2024-11-26 23:19:46.299106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.926 [2024-11-26 23:19:46.299139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.926 [2024-11-26 23:19:46.299158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.926 [2024-11-26 23:19:46.303308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.926 [2024-11-26 23:19:46.303341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.926 [2024-11-26 23:19:46.303359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.926 [2024-11-26 23:19:46.307842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.926 [2024-11-26 23:19:46.307890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.926 [2024-11-26 23:19:46.307908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.926 [2024-11-26 23:19:46.312310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:19.926 [2024-11-26 23:19:46.312342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.926 [2024-11-26 23:19:46.312370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.184 [2024-11-26 23:19:46.317743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:20.184 [2024-11-26 23:19:46.317772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.184 [2024-11-26 23:19:46.317789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.184 [2024-11-26 23:19:46.324366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:20.184 [2024-11-26 23:19:46.324399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.184 [2024-11-26 23:19:46.324421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.184 [2024-11-26 23:19:46.331718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:20.184 [2024-11-26 23:19:46.331749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.184 [2024-11-26 23:19:46.331771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.184 [2024-11-26 23:19:46.336322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1325bb0) 00:27:20.184 [2024-11-26 23:19:46.336355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.184 [2024-11-26 23:19:46.336375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.184 00:27:20.184 Latency(us) 00:27:20.184 [2024-11-26T22:19:46.578Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:20.184 [2024-11-26T22:19:46.578Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:20.184 nvme0n1 : 2.00 5926.48 740.81 0.00 0.00 2695.49 625.02 9126.49 00:27:20.184 [2024-11-26T22:19:46.578Z] =================================================================================================================== 00:27:20.184 [2024-11-26T22:19:46.578Z] Total : 5926.48 740.81 0.00 0.00 2695.49 625.02 9126.49 00:27:20.184 0 00:27:20.184 23:19:46 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:20.184 23:19:46 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:20.184 23:19:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:20.184 23:19:46 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:20.184 | .driver_specific 00:27:20.184 | .nvme_error 00:27:20.184 | .status_code 00:27:20.184 | .command_transient_transport_error' 00:27:20.443 23:19:46 -- host/digest.sh@71 -- # (( 382 > 0 )) 00:27:20.443 23:19:46 -- host/digest.sh@73 -- # killprocess 319599 00:27:20.443 23:19:46 -- common/autotest_common.sh@936 -- # '[' -z 319599 ']' 00:27:20.443 23:19:46 -- common/autotest_common.sh@940 -- # kill -0 319599 00:27:20.443 23:19:46 -- common/autotest_common.sh@941 -- # uname 00:27:20.443 23:19:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:20.443 23:19:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319599 00:27:20.443 23:19:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:20.443 23:19:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:20.443 23:19:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319599' 00:27:20.443 killing process with pid 319599 00:27:20.443 23:19:46 -- common/autotest_common.sh@955 -- # kill 319599 00:27:20.443 Received shutdown signal, test time was about 2.000000 seconds 00:27:20.443 00:27:20.443 Latency(us) 00:27:20.443 [2024-11-26T22:19:46.837Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:20.443 [2024-11-26T22:19:46.837Z] =================================================================================================================== 00:27:20.443 [2024-11-26T22:19:46.837Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:20.443 23:19:46 -- common/autotest_common.sh@960 -- # wait 319599 00:27:20.702 23:19:46 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:20.702 23:19:46 -- host/digest.sh@54 -- # local rw bs qd 00:27:20.702 23:19:46 -- host/digest.sh@56 -- # rw=randwrite 00:27:20.702 23:19:46 -- host/digest.sh@56 -- # bs=4096 00:27:20.702 23:19:46 -- host/digest.sh@56 -- # qd=128 00:27:20.702 23:19:46 -- host/digest.sh@58 -- # bperfpid=320153 00:27:20.702 23:19:46 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:20.702 23:19:46 -- host/digest.sh@60 -- # waitforlisten 320153 /var/tmp/bperf.sock 00:27:20.702 23:19:46 -- common/autotest_common.sh@829 -- # '[' -z 320153 ']' 00:27:20.702 23:19:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:20.702 23:19:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:20.702 23:19:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:20.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:20.702 23:19:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:20.702 23:19:46 -- common/autotest_common.sh@10 -- # set +x 00:27:20.702 [2024-11-26 23:19:46.930760] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:20.702 [2024-11-26 23:19:46.930837] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid320153 ] 00:27:20.702 EAL: No free 2048 kB hugepages reported on node 1 00:27:20.702 [2024-11-26 23:19:46.988093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:20.960 [2024-11-26 23:19:47.101715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:21.894 23:19:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:21.894 23:19:47 -- common/autotest_common.sh@862 -- # return 0 00:27:21.894 23:19:47 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:21.894 23:19:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:21.894 23:19:48 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:21.894 23:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:21.894 23:19:48 -- common/autotest_common.sh@10 -- # set +x 00:27:21.894 23:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:21.894 23:19:48 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:21.894 23:19:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:22.460 nvme0n1 00:27:22.460 23:19:48 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:22.460 23:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:22.460 23:19:48 -- common/autotest_common.sh@10 -- # set +x 00:27:22.460 23:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:22.460 23:19:48 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:22.460 23:19:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:22.460 Running I/O for 2 seconds... 00:27:22.719 [2024-11-26 23:19:48.863072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f5be8 00:27:22.719 [2024-11-26 23:19:48.863317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:16923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.863368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.875914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e8d30 00:27:22.719 [2024-11-26 23:19:48.877106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:18559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.877143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.889128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f4298 00:27:22.719 [2024-11-26 23:19:48.889700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:22125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.889729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.901456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e9e10 00:27:22.719 [2024-11-26 23:19:48.902264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:19234 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.902295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.913170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f6cc8 00:27:22.719 [2024-11-26 23:19:48.913867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:10333 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.913897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.925436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f3e60 00:27:22.719 [2024-11-26 23:19:48.926185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:23718 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.926231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.937722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190edd58 00:27:22.719 [2024-11-26 23:19:48.938398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:25341 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.938432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.949471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f3e60 00:27:22.719 [2024-11-26 23:19:48.950129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:10832 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.950164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.961145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f57b0 00:27:22.719 [2024-11-26 23:19:48.961689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:17954 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.961718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.973150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190eee38 00:27:22.719 [2024-11-26 23:19:48.973662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19643 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.973699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.985152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f1430 00:27:22.719 [2024-11-26 23:19:48.985658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:4680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.985687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:48.997069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f6cc8 00:27:22.719 [2024-11-26 23:19:48.997572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:20289 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:48.997605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.009013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f2d80 00:27:22.719 [2024-11-26 23:19:49.009579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:4995 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:49.009608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.020925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e0630 00:27:22.719 [2024-11-26 23:19:49.021491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:4720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:49.021520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.032177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e23b8 00:27:22.719 [2024-11-26 23:19:49.033711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:890 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:49.033741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.045110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190ed0b0 00:27:22.719 [2024-11-26 23:19:49.046633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:49.046664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.056977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190ed0b0 00:27:22.719 [2024-11-26 23:19:49.058053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:49.058087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.068971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190ef270 00:27:22.719 [2024-11-26 23:19:49.070639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:23210 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:49.070669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.080904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e5220 00:27:22.719 [2024-11-26 23:19:49.082364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:20085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:49.082398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.093257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f7100 00:27:22.719 [2024-11-26 23:19:49.094949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:16065 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.719 [2024-11-26 23:19:49.094983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:22.719 [2024-11-26 23:19:49.105592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f31b8 00:27:22.720 [2024-11-26 23:19:49.107033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:4069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.720 [2024-11-26 23:19:49.107066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.117953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190dfdc0 00:27:22.977 [2024-11-26 23:19:49.119443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:16252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.119472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.130414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e95a0 00:27:22.977 [2024-11-26 23:19:49.131686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:11721 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.131717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.142989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e27f0 00:27:22.977 [2024-11-26 23:19:49.144205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:15609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.144235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.155026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e9168 00:27:22.977 [2024-11-26 23:19:49.156277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:11141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.156310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.168659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190e9e10 00:27:22.977 [2024-11-26 23:19:49.170255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:13864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.170285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.179792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190fac10 00:27:22.977 [2024-11-26 23:19:49.181175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:14515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.181203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.194430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.194847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:7231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.194881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.208430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.208842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:7167 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.208874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.222472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.222827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:19748 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.222860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.236439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.236792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:10533 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.236826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.250567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.250884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:2272 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.250917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.264498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.264819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:15834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.264849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.278420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.278762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:18961 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.278793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.292403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.292780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:13757 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.292814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.306321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.306634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:20823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.306670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.320226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.320571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:332 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.320600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.334086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.334475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:964 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.334508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.348059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.348352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:8140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.348384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.977 [2024-11-26 23:19:49.362048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:22.977 [2024-11-26 23:19:49.362341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21583 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.977 [2024-11-26 23:19:49.362373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.376024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.376332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:7230 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.376362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.389994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.390328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:18497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.390374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.403949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.404274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:21840 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.404319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.417994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.418321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:18084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.418366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.431811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.432142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:22600 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.432173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.445751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.446081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23225 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.446111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.459686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.460059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:18169 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.460090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.473693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.474082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:23905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.474115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.487452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.487799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:3248 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.487832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.501058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.501387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:7570 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.501435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.515080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.515422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:5671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.515451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.529082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.529401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:25539 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.529429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.543208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.543514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.543567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.557048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.557376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21599 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.557421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.571070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.571435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.571482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.585276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.585620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:16692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.585650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.599399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.599718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:11307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.599746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.613254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.613566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:25059 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.613596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.236 [2024-11-26 23:19:49.627349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.236 [2024-11-26 23:19:49.627689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:11773 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.236 [2024-11-26 23:19:49.627723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.641217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.641534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:23376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.641564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.655297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.655614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:16444 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.655643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.669283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.669634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:4626 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.669669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.683271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.683593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:20181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.683623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.697100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.697405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:7138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.697435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.711027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.711346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:3756 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.711375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.725005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.725332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.725376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.738986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.739296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.739342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.752990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.753317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:22246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.753361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.766884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.767206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:14638 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.767235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.780836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.781162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:21549 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.781191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.794774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.795100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:5372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.795128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.808871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.809177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:12424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.809205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.822881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.823198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:19245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.823229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.836899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.495 [2024-11-26 23:19:49.837212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:11760 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.495 [2024-11-26 23:19:49.837260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.495 [2024-11-26 23:19:49.850840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.496 [2024-11-26 23:19:49.851154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:10395 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.496 [2024-11-26 23:19:49.851183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.496 [2024-11-26 23:19:49.864753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.496 [2024-11-26 23:19:49.865079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:13091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.496 [2024-11-26 23:19:49.865107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.496 [2024-11-26 23:19:49.878608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.496 [2024-11-26 23:19:49.878873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:17343 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.496 [2024-11-26 23:19:49.878902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.754 [2024-11-26 23:19:49.892538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.754 [2024-11-26 23:19:49.892833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:15885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.754 [2024-11-26 23:19:49.892865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.754 [2024-11-26 23:19:49.906230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.754 [2024-11-26 23:19:49.906573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22171 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.754 [2024-11-26 23:19:49.906602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.754 [2024-11-26 23:19:49.920172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.754 [2024-11-26 23:19:49.920486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:4417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.754 [2024-11-26 23:19:49.920519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.754 [2024-11-26 23:19:49.934104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:49.934435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:24491 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:49.934464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:49.947860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:49.948186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:23653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:49.948215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:49.961810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:49.962130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:21978 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:49.962159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:49.975665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:49.975996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:11168 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:49.976025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:49.989512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:49.989848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:7018 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:49.989876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.003045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.003287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:15885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.003315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.016856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.017234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:7147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.017276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.030579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.030944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.030991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.044402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.044780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:2339 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.044820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.058635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.058971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:12105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.059003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.072343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.072662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:5898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.072693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.086245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.086583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:764 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.086613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.100129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.100453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:11949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.100483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.114150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.114480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:395 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.114510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.128135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.128492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:41 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.128521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:23.755 [2024-11-26 23:19:50.142256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:23.755 [2024-11-26 23:19:50.142602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:6752 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.755 [2024-11-26 23:19:50.142632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.156395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.156723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:1937 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.156761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.170274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.170606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:11638 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.170636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.183952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.184245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:2277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.184274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.197413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.197689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:7889 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.197718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.210771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.211100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:15107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.211128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.224439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.224715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:8417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.224744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.238257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.238618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:4496 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.238648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.252412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.252777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:24060 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.252807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.266471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.266824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15854 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.266857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.280426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.280819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:20684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.280857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.294298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.294643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:3882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.294672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.308269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.308600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:19388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.308629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.322221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.322562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:6377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.322592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.336140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.336441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:18283 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.336469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.350129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.350435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:12640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.350464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.364148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.364455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:3100 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.364485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.378020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.378347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:23098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.378392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.392016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.014 [2024-11-26 23:19:50.392335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:18979 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.014 [2024-11-26 23:19:50.392364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.014 [2024-11-26 23:19:50.406059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.406384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:17553 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.406440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.419875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.420218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:14680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.420246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.433766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.434060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:19417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.434104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.447660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.447954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.447984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.461455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.461791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:22480 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.461823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.475223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.475590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:23004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.475622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.489171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.489513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:15727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.489564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.503095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.503431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:13657 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.503459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.517086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.517427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:14042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.517462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.531154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.531476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:15938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.531505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.545050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.545378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:14929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.545425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.559132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.559435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:20111 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.559463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.573149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.573458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:20511 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.573489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.587127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.587432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:11095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.587461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.601361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.273 [2024-11-26 23:19:50.601689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:16264 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.273 [2024-11-26 23:19:50.601719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.273 [2024-11-26 23:19:50.615345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.274 [2024-11-26 23:19:50.615662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:1354 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.274 [2024-11-26 23:19:50.615691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.274 [2024-11-26 23:19:50.629086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.274 [2024-11-26 23:19:50.629418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.274 [2024-11-26 23:19:50.629464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.274 [2024-11-26 23:19:50.642962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.274 [2024-11-26 23:19:50.643291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:20502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.274 [2024-11-26 23:19:50.643336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.274 [2024-11-26 23:19:50.656647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.274 [2024-11-26 23:19:50.656920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:7628 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.274 [2024-11-26 23:19:50.656949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.532 [2024-11-26 23:19:50.670738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.532 [2024-11-26 23:19:50.671060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:15584 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.532 [2024-11-26 23:19:50.671088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.532 [2024-11-26 23:19:50.684723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.532 [2024-11-26 23:19:50.685057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:22663 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.532 [2024-11-26 23:19:50.685089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.698696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.699057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:12203 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.699085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.712732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.713058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:8068 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.713087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.726737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.727069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:19410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.727097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.740724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.741053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:12283 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.741082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.754780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.755112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:4976 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.755142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.768700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.769037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:15046 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.769084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.782591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.782893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:15829 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.782942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.796585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.796939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:3655 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.796986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.810470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.810794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.810825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.824483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.824823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.824852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.838363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.838687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:10700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.838716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 [2024-11-26 23:19:50.852412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92ad0) with pdu=0x2000190f92c0 00:27:24.533 [2024-11-26 23:19:50.852680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:14667 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.533 [2024-11-26 23:19:50.852724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.533 00:27:24.533 Latency(us) 00:27:24.533 [2024-11-26T22:19:50.927Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:24.533 [2024-11-26T22:19:50.927Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:24.533 nvme0n1 : 2.01 18714.45 73.10 0.00 0.00 6824.20 3155.44 14563.56 00:27:24.533 [2024-11-26T22:19:50.927Z] =================================================================================================================== 00:27:24.533 [2024-11-26T22:19:50.927Z] Total : 18714.45 73.10 0.00 0.00 6824.20 3155.44 14563.56 00:27:24.533 0 00:27:24.533 23:19:50 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:24.533 23:19:50 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:24.533 23:19:50 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:24.533 | .driver_specific 00:27:24.533 | .nvme_error 00:27:24.533 | .status_code 00:27:24.533 | .command_transient_transport_error' 00:27:24.533 23:19:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:24.791 23:19:51 -- host/digest.sh@71 -- # (( 147 > 0 )) 00:27:24.791 23:19:51 -- host/digest.sh@73 -- # killprocess 320153 00:27:24.791 23:19:51 -- common/autotest_common.sh@936 -- # '[' -z 320153 ']' 00:27:24.791 23:19:51 -- common/autotest_common.sh@940 -- # kill -0 320153 00:27:24.791 23:19:51 -- common/autotest_common.sh@941 -- # uname 00:27:24.791 23:19:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:24.791 23:19:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 320153 00:27:24.791 23:19:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:24.791 23:19:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:24.791 23:19:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 320153' 00:27:24.791 killing process with pid 320153 00:27:24.791 23:19:51 -- common/autotest_common.sh@955 -- # kill 320153 00:27:24.791 Received shutdown signal, test time was about 2.000000 seconds 00:27:24.791 00:27:24.791 Latency(us) 00:27:24.791 [2024-11-26T22:19:51.185Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:24.791 [2024-11-26T22:19:51.185Z] =================================================================================================================== 00:27:24.791 [2024-11-26T22:19:51.185Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:24.791 23:19:51 -- common/autotest_common.sh@960 -- # wait 320153 00:27:25.049 23:19:51 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:25.049 23:19:51 -- host/digest.sh@54 -- # local rw bs qd 00:27:25.049 23:19:51 -- host/digest.sh@56 -- # rw=randwrite 00:27:25.049 23:19:51 -- host/digest.sh@56 -- # bs=131072 00:27:25.049 23:19:51 -- host/digest.sh@56 -- # qd=16 00:27:25.049 23:19:51 -- host/digest.sh@58 -- # bperfpid=320708 00:27:25.049 23:19:51 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:25.049 23:19:51 -- host/digest.sh@60 -- # waitforlisten 320708 /var/tmp/bperf.sock 00:27:25.049 23:19:51 -- common/autotest_common.sh@829 -- # '[' -z 320708 ']' 00:27:25.049 23:19:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:25.049 23:19:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:25.049 23:19:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:25.049 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:25.049 23:19:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:25.049 23:19:51 -- common/autotest_common.sh@10 -- # set +x 00:27:25.307 [2024-11-26 23:19:51.472565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:25.307 [2024-11-26 23:19:51.472643] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid320708 ] 00:27:25.307 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:25.307 Zero copy mechanism will not be used. 00:27:25.307 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.307 [2024-11-26 23:19:51.532836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:25.307 [2024-11-26 23:19:51.646105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:26.242 23:19:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:26.242 23:19:52 -- common/autotest_common.sh@862 -- # return 0 00:27:26.242 23:19:52 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:26.243 23:19:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:26.501 23:19:52 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:26.501 23:19:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:26.501 23:19:52 -- common/autotest_common.sh@10 -- # set +x 00:27:26.501 23:19:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:26.501 23:19:52 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:26.501 23:19:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:26.759 nvme0n1 00:27:26.759 23:19:53 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:26.759 23:19:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:26.759 23:19:53 -- common/autotest_common.sh@10 -- # set +x 00:27:26.759 23:19:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:26.759 23:19:53 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:26.759 23:19:53 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:27.019 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:27.019 Zero copy mechanism will not be used. 00:27:27.019 Running I/O for 2 seconds... 00:27:27.019 [2024-11-26 23:19:53.277828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.278293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.278372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.283123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.283445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.283572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.288138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.288343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.288431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.293197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.293366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.293399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.297985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.298166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.298222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.303037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.303133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.303165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.308635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.308838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.308898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.313735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.314100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.314134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.319318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.319645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.319709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.324729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.325036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.325070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.330106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.330257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.330288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.336675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.336913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.336946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.341893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.342041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.342092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.346707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.346911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.346965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.351752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.351976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.352034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.356817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.357076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.357158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.361641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.361972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.362034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.366769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.367026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.367061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.372221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.372363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.372392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.378101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.378397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.378460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.383703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.383967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.384034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.389234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.389510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.389575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.394162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.394522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.394590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.398913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.019 [2024-11-26 23:19:53.399223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.019 [2024-11-26 23:19:53.399290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.019 [2024-11-26 23:19:53.403976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.020 [2024-11-26 23:19:53.404113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.020 [2024-11-26 23:19:53.404143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.020 [2024-11-26 23:19:53.409803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.020 [2024-11-26 23:19:53.410000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.020 [2024-11-26 23:19:53.410068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.414693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.414918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.414975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.420128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.420300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.420331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.425621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.425769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.425797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.431332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.431571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.431600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.437204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.437355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.437386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.444173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.444633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.444664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.450068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.450443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.450508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.454899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.455130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.455201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.459764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.460017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.460072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.465320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.465435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.465521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.470315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.470460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.470534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.475410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.475605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.475654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.481170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.481371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.481452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.486612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.486919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.280 [2024-11-26 23:19:53.486954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.280 [2024-11-26 23:19:53.491941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.280 [2024-11-26 23:19:53.492185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.492253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.497314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.497486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.497515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.502383] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.502571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.502620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.507309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.507415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.507473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.511760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.511941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.511996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.516026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.516218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.516277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.520391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.520662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.520723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.524769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.525026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.525095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.528935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.529170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.529206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.533196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.533329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.533367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.537693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.537912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.537961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.541945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.542092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.542141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.546115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.546283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.546335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.550344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.550590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.550638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.554713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.554911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.554977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.559143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.559377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.559448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.563359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.563630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.563689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.567687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.568051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.568096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.571953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.572250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.572316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.576209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.576423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.576452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.580452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.580744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.580832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.584706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.585036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.585089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.589038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.589236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.589296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.593386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.593766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.593812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.597712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.598008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.598052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.601918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.602152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.602220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.606311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.606573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.281 [2024-11-26 23:19:53.606614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.281 [2024-11-26 23:19:53.610533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.281 [2024-11-26 23:19:53.610715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.610806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.614895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.615178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.615234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.619139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.619467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.619544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.623560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.623791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.623866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.627738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.627924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.628013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.632038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.632239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.632282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.636266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.636490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.636557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.640713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.641053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.641083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.645015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.645395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.645452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.649275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.649566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.649608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.653965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.654167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.654222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.659202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.659441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.659470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.665240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.665391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.282 [2024-11-26 23:19:53.665418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.282 [2024-11-26 23:19:53.670871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.282 [2024-11-26 23:19:53.671136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.671193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.675417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.675732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.675809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.679986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.680140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.680188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.684472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.684694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.684771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.688916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.689095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.689124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.693394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.693657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.693688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.698827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.699058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.699087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.704481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.704677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.704707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.709720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.710008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.710087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.714763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.715102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.715154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.719718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.719919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.719948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.724733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.724924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.725006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.729100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.729322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.729388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.733301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.733434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.733479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.737624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.737884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.737960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.741873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.742145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.742214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.746055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.746254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.746284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.750338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.750672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.750726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.754389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.754532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.754577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.758725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.758968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.759058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.762770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.763075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.763123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.766951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.767117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.767203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.543 [2024-11-26 23:19:53.771234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.543 [2024-11-26 23:19:53.771493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.543 [2024-11-26 23:19:53.771569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.775456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.775689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.775744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.779765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.780027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.780075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.783913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.784161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.784191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.788065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.788319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.788366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.792277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.792401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.792462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.796619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.796896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.796967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.800879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.801031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.801092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.805216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.805514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.805609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.809607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.809927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.809956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.813822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.813946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.813975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.818050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.818318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.818358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.822419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.822580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.822611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.826671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.826947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.827004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.830952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.831181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.831226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.835242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.835531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.835606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.839477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.839803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.839833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.844101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.844291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.844319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.849195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.849378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.849406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.855041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.855228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.855257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.860835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.860976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.861031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.865395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.865708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.865773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.869651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.869857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.869902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.874871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.874948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.875045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.879759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.879961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.880042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.884817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.884919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.884951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.890522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.890789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.890848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.895283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.544 [2024-11-26 23:19:53.895481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.544 [2024-11-26 23:19:53.895623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.544 [2024-11-26 23:19:53.900353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.545 [2024-11-26 23:19:53.900649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.545 [2024-11-26 23:19:53.900688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.545 [2024-11-26 23:19:53.905133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.545 [2024-11-26 23:19:53.905384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.545 [2024-11-26 23:19:53.905474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.545 [2024-11-26 23:19:53.909958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.545 [2024-11-26 23:19:53.910065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.545 [2024-11-26 23:19:53.910123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.545 [2024-11-26 23:19:53.915667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.545 [2024-11-26 23:19:53.915851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.545 [2024-11-26 23:19:53.915895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.545 [2024-11-26 23:19:53.920636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.545 [2024-11-26 23:19:53.920859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.545 [2024-11-26 23:19:53.920983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.545 [2024-11-26 23:19:53.925629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.545 [2024-11-26 23:19:53.925773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.545 [2024-11-26 23:19:53.925818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.545 [2024-11-26 23:19:53.930794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.545 [2024-11-26 23:19:53.930937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.545 [2024-11-26 23:19:53.931007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.805 [2024-11-26 23:19:53.936441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.805 [2024-11-26 23:19:53.936718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.805 [2024-11-26 23:19:53.936749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.805 [2024-11-26 23:19:53.941667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.805 [2024-11-26 23:19:53.941970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.805 [2024-11-26 23:19:53.942045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.805 [2024-11-26 23:19:53.946926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.805 [2024-11-26 23:19:53.947135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.805 [2024-11-26 23:19:53.947232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.805 [2024-11-26 23:19:53.952462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.805 [2024-11-26 23:19:53.952684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.805 [2024-11-26 23:19:53.952751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.805 [2024-11-26 23:19:53.957668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.805 [2024-11-26 23:19:53.957848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.805 [2024-11-26 23:19:53.957929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.805 [2024-11-26 23:19:53.963126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.805 [2024-11-26 23:19:53.963382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:53.963415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:53.968517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:53.968736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:53.968765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:53.973663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:53.974032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:53.974065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:53.979147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:53.979409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:53.979476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:53.984414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:53.984625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:53.984687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:53.989997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:53.990166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:53.990198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:53.995505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:53.995790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:53.995882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.000832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.001090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.001123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.006521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.006682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.006712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.012287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.012677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.012738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.018066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.018283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.018349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.023815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.024078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.024126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.029444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.029704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.029761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.035130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.035471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.035503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.040624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.040860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.040931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.046229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.046510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.046573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.051907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.052286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.052318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.057470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.057850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.057879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.062876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.063230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.063308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.068351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.068684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.068744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.074013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.074344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.074377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.079605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.079828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.079876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.084997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.085167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.085199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.090658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.090921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.090954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.096160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.096358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.096390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.101774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.101979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.102046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.107627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.107835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.806 [2024-11-26 23:19:54.107889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.806 [2024-11-26 23:19:54.113177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.806 [2024-11-26 23:19:54.113432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.113466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.118503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.118912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.118979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.123425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.123787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.123817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.128585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.128752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.128782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.134624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.134830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.134907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.141220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.141402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.141434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.148002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.148139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.148171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.154837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.155197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.155229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.161243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.161458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.161491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.167814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.167960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.167992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.174611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.174715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.174752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.181232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.181406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.181438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.187723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.187836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.187882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.807 [2024-11-26 23:19:54.194352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:27.807 [2024-11-26 23:19:54.194639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.807 [2024-11-26 23:19:54.194697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.201132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.201336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.201368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.207865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.208212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.208245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.214748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.214907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.214968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.221404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.221620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.221649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.228145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.228439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.228501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.234745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.234927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.235002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.241345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.241547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.241613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.247957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.248163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.248210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.254722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.254974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.255039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.261191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.261537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.261584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.267644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.267934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.267967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.274121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.274288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.274320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.280693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.280816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.280860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.287445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.287635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.287683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.294222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.294518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.294604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.300838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.300960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.300990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.307368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.307712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.307743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.313834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.314065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.314097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.320422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.320599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.320626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.327033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.327216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.327246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.333595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.333898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.333932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.340276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.340586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.340617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.346780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.346923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.346960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.353297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.353486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.353556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.359859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.360071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.360102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.366405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.065 [2024-11-26 23:19:54.366530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.065 [2024-11-26 23:19:54.366576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.065 [2024-11-26 23:19:54.373216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.373458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.373491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.379940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.380119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.380196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.386663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.386845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.386876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.393058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.393233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.393263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.400058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.400289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.400359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.406709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.407016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.407050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.413328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.413665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.413695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.419970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.420206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.420258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.426446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.426704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.426733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.433278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.433485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.433515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.439930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.440256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.440291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.446457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.446620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.446649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.066 [2024-11-26 23:19:54.452821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.066 [2024-11-26 23:19:54.453107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.066 [2024-11-26 23:19:54.453141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.459473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.459622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.459650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.466114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.466348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.466381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.472812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.473063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.473096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.479647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.479941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.479975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.486396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.486612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.486640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.493127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.493339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.493370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.499995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.500228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.500262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.506743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.506969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.507001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.513402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.513548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.513592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.519991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.520146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.520186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.526623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.526829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.526878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.533194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.533329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.533359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.540083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.540315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.540376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.546962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.547132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.547162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.553101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.553254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.553285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.558432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.558587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.558615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.563716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.563898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.563942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.568888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.569189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.569222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.574385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.574715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.574746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.579511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.579906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.579938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.584318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.584577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.584640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.589607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.589894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.589928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.594900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.595184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.325 [2024-11-26 23:19:54.595231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.325 [2024-11-26 23:19:54.599979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.325 [2024-11-26 23:19:54.600256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.600288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.605620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.605866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.605898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.610672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.610866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.610943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.616070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.616319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.616384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.621687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.621983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.622017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.627091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.627365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.627441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.632514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.632665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.632691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.637959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.638256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.638291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.643698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.643996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.644030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.649848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.650107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.650142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.655285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.655625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.655655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.660197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.660463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.660498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.665089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.665283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.665322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.670165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.670380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.670428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.675156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.675316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.675375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.680049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.680183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.680239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.685078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.685230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.685295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.690180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.690465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.690509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.695354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.695598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.695646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.700407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.700622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.700665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.705478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.705660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.705701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.710455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.710726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.710784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.326 [2024-11-26 23:19:54.715460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.326 [2024-11-26 23:19:54.715618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.326 [2024-11-26 23:19:54.715677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.720682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.720953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.721012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.725728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.725957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.725989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.730924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.731195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.731267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.735775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.736117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.736173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.740523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.740757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.740803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.745638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.745826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.745858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.751230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.751508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.751572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.756152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.756414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.756485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.761841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.762123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.762185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.767384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.767590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.767646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.772629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.772775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.772804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.778405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.778605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.778634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.784127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.784425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.784458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.789709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.789980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.790013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.795479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.795799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.586 [2024-11-26 23:19:54.795845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.586 [2024-11-26 23:19:54.801541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.586 [2024-11-26 23:19:54.801727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.801791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.807489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.807620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.807680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.814152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.814310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.814342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.820521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.820658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.820722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.825707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.825864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.825896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.830727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.830966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.831023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.835694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.835861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.835894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.840782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.841163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.841237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.845521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.845887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.845940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.850122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.850295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.850354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.855332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.855690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.855721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.860602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.860828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.860913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.866477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.866723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.866754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.872321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.872594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.872653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.877161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.877470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.877521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.882093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.882410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.882473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.886893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.887071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.887118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.891830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.892085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.892156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.896770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.897055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.897108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.901618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.901764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.901808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.906652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.906870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.906926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.911547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.911843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.911907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.916404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.916711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.916758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.921230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.921541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.921612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.926018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.926275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.926337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.930942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.931192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.931264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.935805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.935990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.936049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.587 [2024-11-26 23:19:54.940708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.587 [2024-11-26 23:19:54.940914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.587 [2024-11-26 23:19:54.940970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.588 [2024-11-26 23:19:54.945670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.588 [2024-11-26 23:19:54.945908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.588 [2024-11-26 23:19:54.945971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.588 [2024-11-26 23:19:54.950431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.588 [2024-11-26 23:19:54.950710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.588 [2024-11-26 23:19:54.950768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.588 [2024-11-26 23:19:54.955408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.588 [2024-11-26 23:19:54.955704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.588 [2024-11-26 23:19:54.955773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.588 [2024-11-26 23:19:54.960269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.588 [2024-11-26 23:19:54.960615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.588 [2024-11-26 23:19:54.960691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.588 [2024-11-26 23:19:54.965016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.588 [2024-11-26 23:19:54.965221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.588 [2024-11-26 23:19:54.965280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.588 [2024-11-26 23:19:54.969963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.588 [2024-11-26 23:19:54.970201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.588 [2024-11-26 23:19:54.970266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.588 [2024-11-26 23:19:54.976024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.588 [2024-11-26 23:19:54.976244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.588 [2024-11-26 23:19:54.976322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:54.980782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:54.980987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:54.981044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:54.985563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:54.985926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:54.985960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:54.990092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:54.990408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:54.990475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:54.994682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:54.994889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:54.994922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:54.999284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:54.999651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:54.999682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:55.003904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:55.004206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:55.004241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:55.008506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:55.008780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:55.008822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:55.013140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:55.013383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:55.013429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:55.017701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:55.017917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:55.017973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:55.022362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:55.022689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.847 [2024-11-26 23:19:55.022740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.847 [2024-11-26 23:19:55.026972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.847 [2024-11-26 23:19:55.027196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.027265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.031449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.031635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.031675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.036087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.036315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.036382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.040672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.040914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.040971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.045254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.045457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.045488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.049906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.050146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.050196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.054535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.054825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.054892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.059076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.059335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.059374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.063639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.063795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.063878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.068260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.068520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.068587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.072881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.073149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.073183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.077560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.077868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.077937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.082084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.082330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.082390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.087053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.087187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.087267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.091851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.092119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.092163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.096484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.096713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.096777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.101685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.101940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.101974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.107062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.107269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.107300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.112056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.112311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.112345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.117004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.117233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.117284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.121992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.122139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.122169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.127631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.127920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.127968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.133589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.133774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.133801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.140477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.140724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.140763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.146297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.146488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.146522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.152069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.152169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.152264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.157297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.157604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.157654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.161868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.162091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.162172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.848 [2024-11-26 23:19:55.166341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.848 [2024-11-26 23:19:55.166619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.848 [2024-11-26 23:19:55.166678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.170802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.171018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.171076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.175391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.175684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.175737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.179986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.180226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.180277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.184456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.184711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.184771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.188887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.189077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.189137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.193460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.193739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.193769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.197942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.198161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.198249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.202424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.202637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.202668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.206999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.207356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.207405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.211447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.211646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.211729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.215977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.216257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.216325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.220572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.220747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.220807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.225094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.225249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.225316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.229766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.230096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.230152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.849 [2024-11-26 23:19:55.234364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:28.849 [2024-11-26 23:19:55.234647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.849 [2024-11-26 23:19:55.234678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.107 [2024-11-26 23:19:55.239249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:29.107 [2024-11-26 23:19:55.239532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.107 [2024-11-26 23:19:55.239611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.107 [2024-11-26 23:19:55.243819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:29.107 [2024-11-26 23:19:55.244122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.107 [2024-11-26 23:19:55.244154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.107 [2024-11-26 23:19:55.248592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:29.107 [2024-11-26 23:19:55.248818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.107 [2024-11-26 23:19:55.248864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.107 [2024-11-26 23:19:55.253256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:29.107 [2024-11-26 23:19:55.253534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.107 [2024-11-26 23:19:55.253600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.107 [2024-11-26 23:19:55.257891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:29.107 [2024-11-26 23:19:55.258156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.107 [2024-11-26 23:19:55.258209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.107 [2024-11-26 23:19:55.262450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:29.107 [2024-11-26 23:19:55.262636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.107 [2024-11-26 23:19:55.262666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.107 [2024-11-26 23:19:55.267160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:29.107 [2024-11-26 23:19:55.267427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.108 [2024-11-26 23:19:55.267507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.108 [2024-11-26 23:19:55.271696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa92fb0) with pdu=0x2000190fef90 00:27:29.108 [2024-11-26 23:19:55.271991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.108 [2024-11-26 23:19:55.272044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.108 00:27:29.108 Latency(us) 00:27:29.108 [2024-11-26T22:19:55.502Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:29.108 [2024-11-26T22:19:55.502Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:29.108 nvme0n1 : 2.00 5898.58 737.32 0.00 0.00 2702.95 1771.90 7184.69 00:27:29.108 [2024-11-26T22:19:55.502Z] =================================================================================================================== 00:27:29.108 [2024-11-26T22:19:55.502Z] Total : 5898.58 737.32 0.00 0.00 2702.95 1771.90 7184.69 00:27:29.108 0 00:27:29.108 23:19:55 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:29.108 23:19:55 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:29.108 23:19:55 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:29.108 | .driver_specific 00:27:29.108 | .nvme_error 00:27:29.108 | .status_code 00:27:29.108 | .command_transient_transport_error' 00:27:29.108 23:19:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:29.366 23:19:55 -- host/digest.sh@71 -- # (( 380 > 0 )) 00:27:29.366 23:19:55 -- host/digest.sh@73 -- # killprocess 320708 00:27:29.366 23:19:55 -- common/autotest_common.sh@936 -- # '[' -z 320708 ']' 00:27:29.366 23:19:55 -- common/autotest_common.sh@940 -- # kill -0 320708 00:27:29.366 23:19:55 -- common/autotest_common.sh@941 -- # uname 00:27:29.366 23:19:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:29.366 23:19:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 320708 00:27:29.366 23:19:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:29.366 23:19:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:29.366 23:19:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 320708' 00:27:29.366 killing process with pid 320708 00:27:29.366 23:19:55 -- common/autotest_common.sh@955 -- # kill 320708 00:27:29.366 Received shutdown signal, test time was about 2.000000 seconds 00:27:29.366 00:27:29.366 Latency(us) 00:27:29.366 [2024-11-26T22:19:55.760Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:29.366 [2024-11-26T22:19:55.760Z] =================================================================================================================== 00:27:29.366 [2024-11-26T22:19:55.760Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:29.366 23:19:55 -- common/autotest_common.sh@960 -- # wait 320708 00:27:29.625 23:19:55 -- host/digest.sh@115 -- # killprocess 319018 00:27:29.625 23:19:55 -- common/autotest_common.sh@936 -- # '[' -z 319018 ']' 00:27:29.625 23:19:55 -- common/autotest_common.sh@940 -- # kill -0 319018 00:27:29.625 23:19:55 -- common/autotest_common.sh@941 -- # uname 00:27:29.625 23:19:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:29.625 23:19:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319018 00:27:29.625 23:19:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:29.625 23:19:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:29.625 23:19:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319018' 00:27:29.625 killing process with pid 319018 00:27:29.625 23:19:55 -- common/autotest_common.sh@955 -- # kill 319018 00:27:29.625 23:19:55 -- common/autotest_common.sh@960 -- # wait 319018 00:27:29.884 00:27:29.884 real 0m18.642s 00:27:29.884 user 0m37.236s 00:27:29.884 sys 0m4.671s 00:27:29.884 23:19:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:29.884 23:19:56 -- common/autotest_common.sh@10 -- # set +x 00:27:29.884 ************************************ 00:27:29.884 END TEST nvmf_digest_error 00:27:29.884 ************************************ 00:27:29.884 23:19:56 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:29.884 23:19:56 -- host/digest.sh@139 -- # nvmftestfini 00:27:29.884 23:19:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:29.884 23:19:56 -- nvmf/common.sh@116 -- # sync 00:27:29.884 23:19:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:29.884 23:19:56 -- nvmf/common.sh@119 -- # set +e 00:27:29.884 23:19:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:29.884 23:19:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:29.884 rmmod nvme_tcp 00:27:29.884 rmmod nvme_fabrics 00:27:29.884 rmmod nvme_keyring 00:27:29.884 23:19:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:29.884 23:19:56 -- nvmf/common.sh@123 -- # set -e 00:27:29.884 23:19:56 -- nvmf/common.sh@124 -- # return 0 00:27:29.884 23:19:56 -- nvmf/common.sh@477 -- # '[' -n 319018 ']' 00:27:29.884 23:19:56 -- nvmf/common.sh@478 -- # killprocess 319018 00:27:29.884 23:19:56 -- common/autotest_common.sh@936 -- # '[' -z 319018 ']' 00:27:29.884 23:19:56 -- common/autotest_common.sh@940 -- # kill -0 319018 00:27:29.884 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (319018) - No such process 00:27:29.884 23:19:56 -- common/autotest_common.sh@963 -- # echo 'Process with pid 319018 is not found' 00:27:29.884 Process with pid 319018 is not found 00:27:29.884 23:19:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:29.884 23:19:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:29.884 23:19:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:29.884 23:19:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:29.884 23:19:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:29.884 23:19:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:29.884 23:19:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:29.884 23:19:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:32.421 23:19:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:32.421 00:27:32.421 real 0m39.000s 00:27:32.421 user 1m9.432s 00:27:32.421 sys 0m10.634s 00:27:32.421 23:19:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:32.421 23:19:58 -- common/autotest_common.sh@10 -- # set +x 00:27:32.421 ************************************ 00:27:32.421 END TEST nvmf_digest 00:27:32.421 ************************************ 00:27:32.421 23:19:58 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:32.421 23:19:58 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:32.421 23:19:58 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:32.421 23:19:58 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:32.421 23:19:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:32.421 23:19:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:32.421 23:19:58 -- common/autotest_common.sh@10 -- # set +x 00:27:32.421 ************************************ 00:27:32.421 START TEST nvmf_bdevperf 00:27:32.421 ************************************ 00:27:32.421 23:19:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:32.421 * Looking for test storage... 00:27:32.421 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:32.421 23:19:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:32.421 23:19:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:32.421 23:19:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:32.421 23:19:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:32.421 23:19:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:32.421 23:19:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:32.421 23:19:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:32.421 23:19:58 -- scripts/common.sh@335 -- # IFS=.-: 00:27:32.421 23:19:58 -- scripts/common.sh@335 -- # read -ra ver1 00:27:32.421 23:19:58 -- scripts/common.sh@336 -- # IFS=.-: 00:27:32.421 23:19:58 -- scripts/common.sh@336 -- # read -ra ver2 00:27:32.421 23:19:58 -- scripts/common.sh@337 -- # local 'op=<' 00:27:32.421 23:19:58 -- scripts/common.sh@339 -- # ver1_l=2 00:27:32.421 23:19:58 -- scripts/common.sh@340 -- # ver2_l=1 00:27:32.421 23:19:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:32.421 23:19:58 -- scripts/common.sh@343 -- # case "$op" in 00:27:32.421 23:19:58 -- scripts/common.sh@344 -- # : 1 00:27:32.421 23:19:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:32.421 23:19:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:32.421 23:19:58 -- scripts/common.sh@364 -- # decimal 1 00:27:32.421 23:19:58 -- scripts/common.sh@352 -- # local d=1 00:27:32.421 23:19:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:32.421 23:19:58 -- scripts/common.sh@354 -- # echo 1 00:27:32.421 23:19:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:32.421 23:19:58 -- scripts/common.sh@365 -- # decimal 2 00:27:32.421 23:19:58 -- scripts/common.sh@352 -- # local d=2 00:27:32.421 23:19:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:32.421 23:19:58 -- scripts/common.sh@354 -- # echo 2 00:27:32.421 23:19:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:32.421 23:19:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:32.421 23:19:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:32.421 23:19:58 -- scripts/common.sh@367 -- # return 0 00:27:32.421 23:19:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:32.421 23:19:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:32.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.421 --rc genhtml_branch_coverage=1 00:27:32.421 --rc genhtml_function_coverage=1 00:27:32.421 --rc genhtml_legend=1 00:27:32.421 --rc geninfo_all_blocks=1 00:27:32.421 --rc geninfo_unexecuted_blocks=1 00:27:32.421 00:27:32.421 ' 00:27:32.421 23:19:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:32.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.421 --rc genhtml_branch_coverage=1 00:27:32.421 --rc genhtml_function_coverage=1 00:27:32.421 --rc genhtml_legend=1 00:27:32.421 --rc geninfo_all_blocks=1 00:27:32.421 --rc geninfo_unexecuted_blocks=1 00:27:32.421 00:27:32.421 ' 00:27:32.421 23:19:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:32.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.421 --rc genhtml_branch_coverage=1 00:27:32.421 --rc genhtml_function_coverage=1 00:27:32.421 --rc genhtml_legend=1 00:27:32.421 --rc geninfo_all_blocks=1 00:27:32.421 --rc geninfo_unexecuted_blocks=1 00:27:32.421 00:27:32.421 ' 00:27:32.421 23:19:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:32.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.421 --rc genhtml_branch_coverage=1 00:27:32.421 --rc genhtml_function_coverage=1 00:27:32.421 --rc genhtml_legend=1 00:27:32.421 --rc geninfo_all_blocks=1 00:27:32.421 --rc geninfo_unexecuted_blocks=1 00:27:32.421 00:27:32.421 ' 00:27:32.421 23:19:58 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:32.421 23:19:58 -- nvmf/common.sh@7 -- # uname -s 00:27:32.421 23:19:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:32.421 23:19:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:32.421 23:19:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:32.421 23:19:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:32.421 23:19:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:32.421 23:19:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:32.421 23:19:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:32.421 23:19:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:32.421 23:19:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:32.421 23:19:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:32.421 23:19:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:32.421 23:19:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:32.421 23:19:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:32.421 23:19:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:32.421 23:19:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:32.421 23:19:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:32.421 23:19:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:32.421 23:19:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:32.421 23:19:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:32.421 23:19:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.421 23:19:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.421 23:19:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.421 23:19:58 -- paths/export.sh@5 -- # export PATH 00:27:32.421 23:19:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.421 23:19:58 -- nvmf/common.sh@46 -- # : 0 00:27:32.421 23:19:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:32.421 23:19:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:32.421 23:19:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:32.421 23:19:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:32.421 23:19:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:32.421 23:19:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:32.421 23:19:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:32.421 23:19:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:32.421 23:19:58 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:32.421 23:19:58 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:32.422 23:19:58 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:32.422 23:19:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:32.422 23:19:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:32.422 23:19:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:32.422 23:19:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:32.422 23:19:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:32.422 23:19:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:32.422 23:19:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:32.422 23:19:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:32.422 23:19:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:32.422 23:19:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:32.422 23:19:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:32.422 23:19:58 -- common/autotest_common.sh@10 -- # set +x 00:27:34.336 23:20:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:34.336 23:20:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:34.336 23:20:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:34.336 23:20:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:34.336 23:20:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:34.336 23:20:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:34.336 23:20:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:34.336 23:20:00 -- nvmf/common.sh@294 -- # net_devs=() 00:27:34.336 23:20:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:34.336 23:20:00 -- nvmf/common.sh@295 -- # e810=() 00:27:34.336 23:20:00 -- nvmf/common.sh@295 -- # local -ga e810 00:27:34.336 23:20:00 -- nvmf/common.sh@296 -- # x722=() 00:27:34.336 23:20:00 -- nvmf/common.sh@296 -- # local -ga x722 00:27:34.336 23:20:00 -- nvmf/common.sh@297 -- # mlx=() 00:27:34.336 23:20:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:34.336 23:20:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:34.336 23:20:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:34.336 23:20:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:34.336 23:20:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:34.336 23:20:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:34.336 23:20:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:34.336 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:34.336 23:20:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:34.336 23:20:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:34.336 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:34.336 23:20:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:34.336 23:20:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:34.336 23:20:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:34.336 23:20:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:34.336 23:20:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:34.336 23:20:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:34.336 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:34.336 23:20:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:34.336 23:20:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:34.336 23:20:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:34.336 23:20:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:34.336 23:20:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:34.336 23:20:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:34.336 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:34.336 23:20:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:34.336 23:20:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:34.336 23:20:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:34.336 23:20:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:34.336 23:20:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:34.336 23:20:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:34.336 23:20:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:34.336 23:20:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:34.336 23:20:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:34.337 23:20:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:34.337 23:20:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:34.337 23:20:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:34.337 23:20:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:34.337 23:20:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:34.337 23:20:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:34.337 23:20:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:34.337 23:20:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:34.337 23:20:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:34.337 23:20:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:34.337 23:20:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:34.337 23:20:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:34.337 23:20:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:34.337 23:20:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:34.337 23:20:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:34.337 23:20:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:34.337 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:34.337 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:27:34.337 00:27:34.337 --- 10.0.0.2 ping statistics --- 00:27:34.337 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:34.337 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:27:34.337 23:20:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:34.337 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:34.337 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:27:34.337 00:27:34.337 --- 10.0.0.1 ping statistics --- 00:27:34.337 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:34.337 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:27:34.337 23:20:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:34.337 23:20:00 -- nvmf/common.sh@410 -- # return 0 00:27:34.337 23:20:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:34.337 23:20:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:34.337 23:20:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:34.337 23:20:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:34.337 23:20:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:34.337 23:20:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:34.337 23:20:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:34.337 23:20:00 -- host/bdevperf.sh@25 -- # tgt_init 00:27:34.337 23:20:00 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:34.337 23:20:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:34.337 23:20:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:34.337 23:20:00 -- common/autotest_common.sh@10 -- # set +x 00:27:34.337 23:20:00 -- nvmf/common.sh@469 -- # nvmfpid=323222 00:27:34.337 23:20:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:34.337 23:20:00 -- nvmf/common.sh@470 -- # waitforlisten 323222 00:27:34.337 23:20:00 -- common/autotest_common.sh@829 -- # '[' -z 323222 ']' 00:27:34.337 23:20:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:34.337 23:20:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:34.337 23:20:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:34.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:34.337 23:20:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:34.337 23:20:00 -- common/autotest_common.sh@10 -- # set +x 00:27:34.337 [2024-11-26 23:20:00.671885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:34.337 [2024-11-26 23:20:00.671978] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:34.337 EAL: No free 2048 kB hugepages reported on node 1 00:27:34.595 [2024-11-26 23:20:00.745279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:34.595 [2024-11-26 23:20:00.863492] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:34.595 [2024-11-26 23:20:00.863671] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:34.595 [2024-11-26 23:20:00.863692] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:34.595 [2024-11-26 23:20:00.863706] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:34.595 [2024-11-26 23:20:00.863800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:34.595 [2024-11-26 23:20:00.863879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:34.595 [2024-11-26 23:20:00.863883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:35.529 23:20:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:35.529 23:20:01 -- common/autotest_common.sh@862 -- # return 0 00:27:35.529 23:20:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:35.529 23:20:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:35.529 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:35.529 23:20:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:35.529 23:20:01 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:35.529 23:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:35.529 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:35.529 [2024-11-26 23:20:01.665645] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:35.529 23:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:35.529 23:20:01 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:35.530 23:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:35.530 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:35.530 Malloc0 00:27:35.530 23:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:35.530 23:20:01 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:35.530 23:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:35.530 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:35.530 23:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:35.530 23:20:01 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:35.530 23:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:35.530 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:35.530 23:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:35.530 23:20:01 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:35.530 23:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:35.530 23:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:35.530 [2024-11-26 23:20:01.723702] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:35.530 23:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:35.530 23:20:01 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:35.530 23:20:01 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:35.530 23:20:01 -- nvmf/common.sh@520 -- # config=() 00:27:35.530 23:20:01 -- nvmf/common.sh@520 -- # local subsystem config 00:27:35.530 23:20:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:35.530 23:20:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:35.530 { 00:27:35.530 "params": { 00:27:35.530 "name": "Nvme$subsystem", 00:27:35.530 "trtype": "$TEST_TRANSPORT", 00:27:35.530 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:35.530 "adrfam": "ipv4", 00:27:35.530 "trsvcid": "$NVMF_PORT", 00:27:35.530 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:35.530 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:35.530 "hdgst": ${hdgst:-false}, 00:27:35.530 "ddgst": ${ddgst:-false} 00:27:35.530 }, 00:27:35.530 "method": "bdev_nvme_attach_controller" 00:27:35.530 } 00:27:35.530 EOF 00:27:35.530 )") 00:27:35.530 23:20:01 -- nvmf/common.sh@542 -- # cat 00:27:35.530 23:20:01 -- nvmf/common.sh@544 -- # jq . 00:27:35.530 23:20:01 -- nvmf/common.sh@545 -- # IFS=, 00:27:35.530 23:20:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:35.530 "params": { 00:27:35.530 "name": "Nvme1", 00:27:35.530 "trtype": "tcp", 00:27:35.530 "traddr": "10.0.0.2", 00:27:35.530 "adrfam": "ipv4", 00:27:35.530 "trsvcid": "4420", 00:27:35.530 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:35.530 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:35.530 "hdgst": false, 00:27:35.530 "ddgst": false 00:27:35.530 }, 00:27:35.530 "method": "bdev_nvme_attach_controller" 00:27:35.530 }' 00:27:35.530 [2024-11-26 23:20:01.766554] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:35.530 [2024-11-26 23:20:01.766625] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid323383 ] 00:27:35.530 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.530 [2024-11-26 23:20:01.825614] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:35.788 [2024-11-26 23:20:01.938755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:35.788 Running I/O for 1 seconds... 00:27:37.162 00:27:37.162 Latency(us) 00:27:37.162 [2024-11-26T22:20:03.556Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:37.162 [2024-11-26T22:20:03.556Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:37.162 Verification LBA range: start 0x0 length 0x4000 00:27:37.162 Nvme1n1 : 1.01 12868.49 50.27 0.00 0.00 9901.89 1450.29 17670.45 00:27:37.162 [2024-11-26T22:20:03.556Z] =================================================================================================================== 00:27:37.162 [2024-11-26T22:20:03.556Z] Total : 12868.49 50.27 0.00 0.00 9901.89 1450.29 17670.45 00:27:37.162 23:20:03 -- host/bdevperf.sh@30 -- # bdevperfpid=323648 00:27:37.162 23:20:03 -- host/bdevperf.sh@32 -- # sleep 3 00:27:37.162 23:20:03 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:37.162 23:20:03 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:37.162 23:20:03 -- nvmf/common.sh@520 -- # config=() 00:27:37.162 23:20:03 -- nvmf/common.sh@520 -- # local subsystem config 00:27:37.162 23:20:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:37.162 23:20:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:37.162 { 00:27:37.162 "params": { 00:27:37.162 "name": "Nvme$subsystem", 00:27:37.162 "trtype": "$TEST_TRANSPORT", 00:27:37.162 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:37.162 "adrfam": "ipv4", 00:27:37.162 "trsvcid": "$NVMF_PORT", 00:27:37.162 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:37.162 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:37.162 "hdgst": ${hdgst:-false}, 00:27:37.162 "ddgst": ${ddgst:-false} 00:27:37.162 }, 00:27:37.162 "method": "bdev_nvme_attach_controller" 00:27:37.162 } 00:27:37.162 EOF 00:27:37.162 )") 00:27:37.162 23:20:03 -- nvmf/common.sh@542 -- # cat 00:27:37.162 23:20:03 -- nvmf/common.sh@544 -- # jq . 00:27:37.162 23:20:03 -- nvmf/common.sh@545 -- # IFS=, 00:27:37.162 23:20:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:37.162 "params": { 00:27:37.162 "name": "Nvme1", 00:27:37.162 "trtype": "tcp", 00:27:37.162 "traddr": "10.0.0.2", 00:27:37.162 "adrfam": "ipv4", 00:27:37.162 "trsvcid": "4420", 00:27:37.162 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:37.162 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:37.162 "hdgst": false, 00:27:37.162 "ddgst": false 00:27:37.162 }, 00:27:37.162 "method": "bdev_nvme_attach_controller" 00:27:37.162 }' 00:27:37.162 [2024-11-26 23:20:03.451401] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:37.162 [2024-11-26 23:20:03.451480] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid323648 ] 00:27:37.162 EAL: No free 2048 kB hugepages reported on node 1 00:27:37.162 [2024-11-26 23:20:03.509953] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:37.419 [2024-11-26 23:20:03.619257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:37.677 Running I/O for 15 seconds... 00:27:40.208 23:20:06 -- host/bdevperf.sh@33 -- # kill -9 323222 00:27:40.208 23:20:06 -- host/bdevperf.sh@35 -- # sleep 3 00:27:40.208 [2024-11-26 23:20:06.428090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:131040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:131048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:131064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:0 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:16 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:48 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:56 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:64 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.208 [2024-11-26 23:20:06.428859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.208 [2024-11-26 23:20:06.428876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.208 [2024-11-26 23:20:06.428891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.428907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.428921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.428938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.428952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.428969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.428984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.429046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.429077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.429175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.429206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:88 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:96 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.429779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.429854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.429916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.429947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.429983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.429999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.430014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.430030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.430045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.430062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.430076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.430092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.209 [2024-11-26 23:20:06.430106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.430123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.209 [2024-11-26 23:20:06.430137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.209 [2024-11-26 23:20:06.430153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:1000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:1008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:1016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:1024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:1032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:1040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:1048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:1056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:1072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:1080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:1088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:1096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:1104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:1112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:1120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.210 [2024-11-26 23:20:06.430849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.430972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.430988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:1128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:1136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.210 [2024-11-26 23:20:06.431410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.210 [2024-11-26 23:20:06.431426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:1144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.431441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:1152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:1160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.431502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:1168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:1176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:1192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:1200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.431676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:1208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:1216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:1224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.431759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:1232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:1240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.431838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:1248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:1264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:40.211 [2024-11-26 23:20:06.431932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:1272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.431963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.431984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:1280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:1288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:40.211 [2024-11-26 23:20:06.432247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x195c740 is same with the state(5) to be set 00:27:40.211 [2024-11-26 23:20:06.432281] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:40.211 [2024-11-26 23:20:06.432294] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:40.211 [2024-11-26 23:20:06.432311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:752 len:8 PRP1 0x0 PRP2 0x0 00:27:40.211 [2024-11-26 23:20:06.432325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432397] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x195c740 was disconnected and freed. reset controller. 00:27:40.211 [2024-11-26 23:20:06.432475] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.211 [2024-11-26 23:20:06.432499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.211 [2024-11-26 23:20:06.432544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432576] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.211 [2024-11-26 23:20:06.432589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432602] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.211 [2024-11-26 23:20:06.432615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:40.211 [2024-11-26 23:20:06.432627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.211 [2024-11-26 23:20:06.434929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.211 [2024-11-26 23:20:06.434970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.211 [2024-11-26 23:20:06.435599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.211 [2024-11-26 23:20:06.435716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.211 [2024-11-26 23:20:06.435741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.211 [2024-11-26 23:20:06.435758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.211 [2024-11-26 23:20:06.436007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.211 [2024-11-26 23:20:06.436141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.211 [2024-11-26 23:20:06.436163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.211 [2024-11-26 23:20:06.436183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.211 [2024-11-26 23:20:06.438785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.211 [2024-11-26 23:20:06.447513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.211 [2024-11-26 23:20:06.447776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.211 [2024-11-26 23:20:06.447935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.211 [2024-11-26 23:20:06.447963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.211 [2024-11-26 23:20:06.447980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.211 [2024-11-26 23:20:06.448127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.211 [2024-11-26 23:20:06.448242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.448265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.212 [2024-11-26 23:20:06.448281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.212 [2024-11-26 23:20:06.450917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.212 [2024-11-26 23:20:06.459995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.212 [2024-11-26 23:20:06.460325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.460437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.460466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.212 [2024-11-26 23:20:06.460483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.212 [2024-11-26 23:20:06.460678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.212 [2024-11-26 23:20:06.460902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.460925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.212 [2024-11-26 23:20:06.460940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.212 [2024-11-26 23:20:06.463201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.212 [2024-11-26 23:20:06.472487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.212 [2024-11-26 23:20:06.472822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.472968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.472993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.212 [2024-11-26 23:20:06.473008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.212 [2024-11-26 23:20:06.473203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.212 [2024-11-26 23:20:06.473355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.473378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.212 [2024-11-26 23:20:06.473393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.212 [2024-11-26 23:20:06.475681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.212 [2024-11-26 23:20:06.485173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.212 [2024-11-26 23:20:06.485473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.485634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.485660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.212 [2024-11-26 23:20:06.485675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.212 [2024-11-26 23:20:06.485824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.212 [2024-11-26 23:20:06.486004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.486028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.212 [2024-11-26 23:20:06.486043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.212 [2024-11-26 23:20:06.488429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.212 [2024-11-26 23:20:06.497864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.212 [2024-11-26 23:20:06.498198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.498334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.498359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.212 [2024-11-26 23:20:06.498379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.212 [2024-11-26 23:20:06.498571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.212 [2024-11-26 23:20:06.498705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.498728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.212 [2024-11-26 23:20:06.498743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.212 [2024-11-26 23:20:06.501037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.212 [2024-11-26 23:20:06.510411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.212 [2024-11-26 23:20:06.510732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.510862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.510890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.212 [2024-11-26 23:20:06.510907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.212 [2024-11-26 23:20:06.511037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.212 [2024-11-26 23:20:06.511207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.511230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.212 [2024-11-26 23:20:06.511245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.212 [2024-11-26 23:20:06.513587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.212 [2024-11-26 23:20:06.522907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.212 [2024-11-26 23:20:06.523201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.523355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.523383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.212 [2024-11-26 23:20:06.523399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.212 [2024-11-26 23:20:06.523537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.212 [2024-11-26 23:20:06.523652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.523676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.212 [2024-11-26 23:20:06.523693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.212 [2024-11-26 23:20:06.526227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.212 [2024-11-26 23:20:06.535388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.212 [2024-11-26 23:20:06.535679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.535801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.535829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.212 [2024-11-26 23:20:06.535846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.212 [2024-11-26 23:20:06.535944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.212 [2024-11-26 23:20:06.536148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.536172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.212 [2024-11-26 23:20:06.536187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.212 [2024-11-26 23:20:06.538641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.212 [2024-11-26 23:20:06.547835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.212 [2024-11-26 23:20:06.548176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.548304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.212 [2024-11-26 23:20:06.548332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.212 [2024-11-26 23:20:06.548349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.212 [2024-11-26 23:20:06.548541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.212 [2024-11-26 23:20:06.548765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.212 [2024-11-26 23:20:06.548789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.213 [2024-11-26 23:20:06.548804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.213 [2024-11-26 23:20:06.551011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.213 [2024-11-26 23:20:06.560423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.213 [2024-11-26 23:20:06.560803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.213 [2024-11-26 23:20:06.560894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.213 [2024-11-26 23:20:06.560923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.213 [2024-11-26 23:20:06.560939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.213 [2024-11-26 23:20:06.561126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.213 [2024-11-26 23:20:06.561294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.213 [2024-11-26 23:20:06.561318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.213 [2024-11-26 23:20:06.561333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.213 [2024-11-26 23:20:06.563483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.213 [2024-11-26 23:20:06.572996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.213 [2024-11-26 23:20:06.573284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.213 [2024-11-26 23:20:06.573436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.213 [2024-11-26 23:20:06.573464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.213 [2024-11-26 23:20:06.573481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.213 [2024-11-26 23:20:06.573660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.213 [2024-11-26 23:20:06.573885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.213 [2024-11-26 23:20:06.573909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.213 [2024-11-26 23:20:06.573924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.213 [2024-11-26 23:20:06.576149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.213 [2024-11-26 23:20:06.585683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.213 [2024-11-26 23:20:06.585958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.213 [2024-11-26 23:20:06.586089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.213 [2024-11-26 23:20:06.586117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.213 [2024-11-26 23:20:06.586134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.213 [2024-11-26 23:20:06.586298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.213 [2024-11-26 23:20:06.586467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.213 [2024-11-26 23:20:06.586490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.213 [2024-11-26 23:20:06.586505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.213 [2024-11-26 23:20:06.588829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.472 [2024-11-26 23:20:06.598216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.472 [2024-11-26 23:20:06.598449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.598564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.598591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.472 [2024-11-26 23:20:06.598606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.472 [2024-11-26 23:20:06.598755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.472 [2024-11-26 23:20:06.598936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.472 [2024-11-26 23:20:06.598960] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.472 [2024-11-26 23:20:06.598975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.472 [2024-11-26 23:20:06.601234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.472 [2024-11-26 23:20:06.610833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.472 [2024-11-26 23:20:06.611157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.611330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.611358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.472 [2024-11-26 23:20:06.611375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.472 [2024-11-26 23:20:06.611604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.472 [2024-11-26 23:20:06.611745] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.472 [2024-11-26 23:20:06.611769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.472 [2024-11-26 23:20:06.611785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.472 [2024-11-26 23:20:06.614423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.472 [2024-11-26 23:20:06.623560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.472 [2024-11-26 23:20:06.623870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.624003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.624031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.472 [2024-11-26 23:20:06.624048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.472 [2024-11-26 23:20:06.624213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.472 [2024-11-26 23:20:06.624347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.472 [2024-11-26 23:20:06.624370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.472 [2024-11-26 23:20:06.624385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.472 [2024-11-26 23:20:06.626872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.472 [2024-11-26 23:20:06.636062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.472 [2024-11-26 23:20:06.636353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.636541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.636567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.472 [2024-11-26 23:20:06.636583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.472 [2024-11-26 23:20:06.636798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.472 [2024-11-26 23:20:06.637021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.472 [2024-11-26 23:20:06.637044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.472 [2024-11-26 23:20:06.637059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.472 [2024-11-26 23:20:06.639651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.472 [2024-11-26 23:20:06.648637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.472 [2024-11-26 23:20:06.648998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.649231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.649256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.472 [2024-11-26 23:20:06.649271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.472 [2024-11-26 23:20:06.649488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.472 [2024-11-26 23:20:06.649679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.472 [2024-11-26 23:20:06.649703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.472 [2024-11-26 23:20:06.649724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.472 [2024-11-26 23:20:06.651982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.472 [2024-11-26 23:20:06.661342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.472 [2024-11-26 23:20:06.661647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.661801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.472 [2024-11-26 23:20:06.661829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.472 [2024-11-26 23:20:06.661845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.472 [2024-11-26 23:20:06.662029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.472 [2024-11-26 23:20:06.662161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.472 [2024-11-26 23:20:06.662184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.472 [2024-11-26 23:20:06.662199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.664647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.673999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.674276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.674397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.674425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.674442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.674660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.674793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.674814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.674845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.677382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.686745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.687016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.687179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.687234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.687249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.687393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.687574] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.687599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.687620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.689845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.699358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.699617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.699715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.699743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.699760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.699961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.700130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.700154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.700169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.702411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.711953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.712264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.712431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.712457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.712472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.712598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.712763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.712786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.712802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.715116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.724532] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.724804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.724968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.724996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.725013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.725177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.725347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.725370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.725385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.727779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.737076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.737373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.737579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.737609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.737627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.737810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.738034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.738057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.738072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.740315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.749770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.750016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.750192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.750218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.750233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.750443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.750606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.750631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.750646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.752872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.762112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.762461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.762569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.762599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.762616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.762782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.762951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.762974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.762989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.765417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.774764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.775087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.775219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.775247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.473 [2024-11-26 23:20:06.775264] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.473 [2024-11-26 23:20:06.775412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.473 [2024-11-26 23:20:06.775610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.473 [2024-11-26 23:20:06.775635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.473 [2024-11-26 23:20:06.775650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.473 [2024-11-26 23:20:06.777928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.473 [2024-11-26 23:20:06.787485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.473 [2024-11-26 23:20:06.787780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.473 [2024-11-26 23:20:06.788003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.788028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.474 [2024-11-26 23:20:06.788043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.474 [2024-11-26 23:20:06.788236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.474 [2024-11-26 23:20:06.788362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.474 [2024-11-26 23:20:06.788386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.474 [2024-11-26 23:20:06.788401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.474 [2024-11-26 23:20:06.790904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.474 [2024-11-26 23:20:06.799985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.474 [2024-11-26 23:20:06.800279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.800444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.800472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.474 [2024-11-26 23:20:06.800490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.474 [2024-11-26 23:20:06.800629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.474 [2024-11-26 23:20:06.800763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.474 [2024-11-26 23:20:06.800786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.474 [2024-11-26 23:20:06.800801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.474 [2024-11-26 23:20:06.803018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.474 [2024-11-26 23:20:06.812460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.474 [2024-11-26 23:20:06.812774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.812945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.812974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.474 [2024-11-26 23:20:06.812991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.474 [2024-11-26 23:20:06.813139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.474 [2024-11-26 23:20:06.813290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.474 [2024-11-26 23:20:06.813313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.474 [2024-11-26 23:20:06.813328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.474 [2024-11-26 23:20:06.815633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.474 [2024-11-26 23:20:06.825116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.474 [2024-11-26 23:20:06.825479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.825608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.825650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.474 [2024-11-26 23:20:06.825668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.474 [2024-11-26 23:20:06.825833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.474 [2024-11-26 23:20:06.826020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.474 [2024-11-26 23:20:06.826042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.474 [2024-11-26 23:20:06.826057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.474 [2024-11-26 23:20:06.828374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.474 [2024-11-26 23:20:06.837671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.474 [2024-11-26 23:20:06.837979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.838099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.838124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.474 [2024-11-26 23:20:06.838140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.474 [2024-11-26 23:20:06.838334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.474 [2024-11-26 23:20:06.838467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.474 [2024-11-26 23:20:06.838490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.474 [2024-11-26 23:20:06.838504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.474 [2024-11-26 23:20:06.840884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.474 [2024-11-26 23:20:06.850129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.474 [2024-11-26 23:20:06.850436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.850601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.850628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.474 [2024-11-26 23:20:06.850648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.474 [2024-11-26 23:20:06.850778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.474 [2024-11-26 23:20:06.850980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.474 [2024-11-26 23:20:06.851004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.474 [2024-11-26 23:20:06.851019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.474 [2024-11-26 23:20:06.853225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.474 [2024-11-26 23:20:06.862632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.474 [2024-11-26 23:20:06.862957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.863050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.474 [2024-11-26 23:20:06.863076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.474 [2024-11-26 23:20:06.863091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.474 [2024-11-26 23:20:06.863299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.474 [2024-11-26 23:20:06.863486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.474 [2024-11-26 23:20:06.863509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.474 [2024-11-26 23:20:06.863534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.733 [2024-11-26 23:20:06.865961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.733 [2024-11-26 23:20:06.875284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.733 [2024-11-26 23:20:06.875558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.733 [2024-11-26 23:20:06.875686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.733 [2024-11-26 23:20:06.875711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.733 [2024-11-26 23:20:06.875727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.733 [2024-11-26 23:20:06.875934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.733 [2024-11-26 23:20:06.876086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.733 [2024-11-26 23:20:06.876109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.876124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.878240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.888056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.888338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.888490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.888518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.888551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.888755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.734 [2024-11-26 23:20:06.888869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.734 [2024-11-26 23:20:06.888892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.888907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.891134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.900462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.900788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.900941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.900969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.900986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.901132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.734 [2024-11-26 23:20:06.901265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.734 [2024-11-26 23:20:06.901288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.901303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.903807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.913019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.913341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.913469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.913494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.913509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.913689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.734 [2024-11-26 23:20:06.913859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.734 [2024-11-26 23:20:06.913883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.913898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.916377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.925561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.925872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.925999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.926026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.926043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.926196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.734 [2024-11-26 23:20:06.926311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.734 [2024-11-26 23:20:06.926334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.926349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.928565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.938166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.938486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.938647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.938676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.938693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.938804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.734 [2024-11-26 23:20:06.938973] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.734 [2024-11-26 23:20:06.938996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.939012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.941422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.950737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.951044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.951169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.951197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.951213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.951342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.734 [2024-11-26 23:20:06.951588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.734 [2024-11-26 23:20:06.951609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.951623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.953794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.963249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.963542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.963664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.963692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.963709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.963874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.734 [2024-11-26 23:20:06.964049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.734 [2024-11-26 23:20:06.964073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.964088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.966382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.975881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.976174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.976278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.976303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.976318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.976466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.734 [2024-11-26 23:20:06.976666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.734 [2024-11-26 23:20:06.976691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.734 [2024-11-26 23:20:06.976706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.734 [2024-11-26 23:20:06.979149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.734 [2024-11-26 23:20:06.988365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.734 [2024-11-26 23:20:06.988704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.988832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.734 [2024-11-26 23:20:06.988860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.734 [2024-11-26 23:20:06.988877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.734 [2024-11-26 23:20:06.988987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:06.989173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:06.989196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:06.989212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:06.991494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.000827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.001151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.001300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.001327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.001344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.001472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.001598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.001627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.001643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:07.003940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.013488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.013746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.013847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.013872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.013887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.014066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.014211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.014235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.014250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:07.016681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.026021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.026293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.026421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.026466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.026481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.026658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.026817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.026841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.026856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:07.029046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.038614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.038921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.039044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.039072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.039089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.039254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.039441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.039465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.039486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:07.041739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.051435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.051726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.051852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.051878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.051893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.052085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.052326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.052350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.052365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:07.054818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.064047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.064379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.064517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.064550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.064566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.064703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.064836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.064859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.064874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:07.067117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.076391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.076740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.076833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.076860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.076877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.077078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.077211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.077234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.077249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:07.079556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.089095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.089402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.089543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.089570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.089585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.089746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.089926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.089949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.089964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.735 [2024-11-26 23:20:07.092494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.735 [2024-11-26 23:20:07.101704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.735 [2024-11-26 23:20:07.101979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.102076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.735 [2024-11-26 23:20:07.102104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.735 [2024-11-26 23:20:07.102121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.735 [2024-11-26 23:20:07.102267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.735 [2024-11-26 23:20:07.102419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.735 [2024-11-26 23:20:07.102442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.735 [2024-11-26 23:20:07.102457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.736 [2024-11-26 23:20:07.105086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.736 [2024-11-26 23:20:07.114249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.736 [2024-11-26 23:20:07.114603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.736 [2024-11-26 23:20:07.114775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.736 [2024-11-26 23:20:07.114801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.736 [2024-11-26 23:20:07.114816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.736 [2024-11-26 23:20:07.114980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.736 [2024-11-26 23:20:07.115205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.736 [2024-11-26 23:20:07.115229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.736 [2024-11-26 23:20:07.115244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.736 [2024-11-26 23:20:07.117640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.994 [2024-11-26 23:20:07.126934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.994 [2024-11-26 23:20:07.127244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.994 [2024-11-26 23:20:07.127351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.127379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.127397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.127591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.127743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.127767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.127782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.130189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.139492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.139758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.139886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.139914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.139931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.140114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.140283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.140306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.140321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.142881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.152002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.152373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.152503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.152536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.152553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.152733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.152902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.152924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.152939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.155343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.164410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.164727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.164842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.164867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.164883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.165037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.165224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.165247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.165262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.167715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.177036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.177341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.177477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.177505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.177523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.177701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.177816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.177838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.177853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.180311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.189645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.189897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.190037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.190062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.190078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.190254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.190466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.190490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.190505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.192917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.202084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.202378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.202543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.202574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.202590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.202707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.202868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.202891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.202906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.205256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.214742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.215080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.215209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.215237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.215254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.215401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.215516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.215551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.215568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.218015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.227173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.227465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.227609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.227635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.227650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.995 [2024-11-26 23:20:07.227783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.995 [2024-11-26 23:20:07.227973] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.995 [2024-11-26 23:20:07.227996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.995 [2024-11-26 23:20:07.228012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.995 [2024-11-26 23:20:07.230533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.995 [2024-11-26 23:20:07.239894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.995 [2024-11-26 23:20:07.240177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.240327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.995 [2024-11-26 23:20:07.240355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.995 [2024-11-26 23:20:07.240377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.240508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.240671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.240695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.240711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.243209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.252378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.252721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.252853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.252881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.252898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.253063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.253249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.253272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.253288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.255634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.264762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.265082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.265235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.265276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.265291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.265483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.265671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.265695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.265711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.268046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.277500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.277785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.277937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.277962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.277977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.278161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.278294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.278317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.278333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.280694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.290206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.290516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.290651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.290680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.290697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.290862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.291031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.291054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.291070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.293134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.302828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.303084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.303241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.303266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.303281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.303457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.303632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.303657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.303672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.305899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.315587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.315895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.316032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.316057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.316073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.316231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.316424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.316449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.316464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.318738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.328243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.328606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.328747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.328772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.328788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.329032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.329165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.329188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.329203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.331486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.340684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.340939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.341038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.341066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.341083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.341248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.341417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.341440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.341456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.996 [2024-11-26 23:20:07.343747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.996 [2024-11-26 23:20:07.353341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.996 [2024-11-26 23:20:07.353663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.353788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.996 [2024-11-26 23:20:07.353816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.996 [2024-11-26 23:20:07.353833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.996 [2024-11-26 23:20:07.354015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.996 [2024-11-26 23:20:07.354130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.996 [2024-11-26 23:20:07.354162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.996 [2024-11-26 23:20:07.354178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.997 [2024-11-26 23:20:07.356423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.997 [2024-11-26 23:20:07.365886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.997 [2024-11-26 23:20:07.366207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.997 [2024-11-26 23:20:07.366335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.997 [2024-11-26 23:20:07.366363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.997 [2024-11-26 23:20:07.366380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.997 [2024-11-26 23:20:07.366538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.997 [2024-11-26 23:20:07.366710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.997 [2024-11-26 23:20:07.366733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.997 [2024-11-26 23:20:07.366748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.997 [2024-11-26 23:20:07.369101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.997 [2024-11-26 23:20:07.378474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.997 [2024-11-26 23:20:07.378835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.997 [2024-11-26 23:20:07.379004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.997 [2024-11-26 23:20:07.379029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:40.997 [2024-11-26 23:20:07.379045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:40.997 [2024-11-26 23:20:07.379208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:40.997 [2024-11-26 23:20:07.379373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.997 [2024-11-26 23:20:07.379397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.997 [2024-11-26 23:20:07.379412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.997 [2024-11-26 23:20:07.381805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.256 [2024-11-26 23:20:07.391008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.256 [2024-11-26 23:20:07.391273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.391399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.391427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.256 [2024-11-26 23:20:07.391444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.256 [2024-11-26 23:20:07.391584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.256 [2024-11-26 23:20:07.391753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.256 [2024-11-26 23:20:07.391777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.256 [2024-11-26 23:20:07.391798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.256 [2024-11-26 23:20:07.394042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.256 [2024-11-26 23:20:07.403497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.256 [2024-11-26 23:20:07.403790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.403938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.403963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.256 [2024-11-26 23:20:07.403978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.256 [2024-11-26 23:20:07.404134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.256 [2024-11-26 23:20:07.404303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.256 [2024-11-26 23:20:07.404327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.256 [2024-11-26 23:20:07.404342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.256 [2024-11-26 23:20:07.406762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.256 [2024-11-26 23:20:07.415962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.256 [2024-11-26 23:20:07.416290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.416454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.416496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.256 [2024-11-26 23:20:07.416513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.256 [2024-11-26 23:20:07.416688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.256 [2024-11-26 23:20:07.416857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.256 [2024-11-26 23:20:07.416881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.256 [2024-11-26 23:20:07.416896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.256 [2024-11-26 23:20:07.419301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.256 [2024-11-26 23:20:07.428573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.256 [2024-11-26 23:20:07.428838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.428992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.429020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.256 [2024-11-26 23:20:07.429037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.256 [2024-11-26 23:20:07.429185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.256 [2024-11-26 23:20:07.429353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.256 [2024-11-26 23:20:07.429376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.256 [2024-11-26 23:20:07.429392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.256 [2024-11-26 23:20:07.431697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.256 [2024-11-26 23:20:07.441092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.256 [2024-11-26 23:20:07.441402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.441558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.441587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.256 [2024-11-26 23:20:07.441604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.256 [2024-11-26 23:20:07.441841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.256 [2024-11-26 23:20:07.442011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.256 [2024-11-26 23:20:07.442035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.256 [2024-11-26 23:20:07.442050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.256 [2024-11-26 23:20:07.444449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.256 [2024-11-26 23:20:07.453647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.256 [2024-11-26 23:20:07.453979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.454122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.454167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.256 [2024-11-26 23:20:07.454185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.256 [2024-11-26 23:20:07.454367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.256 [2024-11-26 23:20:07.454582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.256 [2024-11-26 23:20:07.454607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.256 [2024-11-26 23:20:07.454622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.256 [2024-11-26 23:20:07.457086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.256 [2024-11-26 23:20:07.466264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.256 [2024-11-26 23:20:07.466539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.466654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.256 [2024-11-26 23:20:07.466687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.256 [2024-11-26 23:20:07.466720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.256 [2024-11-26 23:20:07.466831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.256 [2024-11-26 23:20:07.466981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.467004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.467019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.469319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.479042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.479320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.479446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.479475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.479492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.479632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.479837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.479861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.479876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.482141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.491663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.491970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.492145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.492190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.492207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.492318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.492468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.492491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.492506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.494809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.504182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.504431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.504580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.504610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.504627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.504810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.504979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.505002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.505018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.507385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.516735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.517030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.517161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.517204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.517220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.517352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.517538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.517562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.517578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.520003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.529406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.529692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.529822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.529850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.529867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.530050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.530184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.530206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.530222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.532486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.542074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.542420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.542572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.542614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.542629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.542729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.542896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.542919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.542934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.545177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.554638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.554947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.555113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.555143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.555159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.555307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.555538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.555562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.555577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.557821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.567183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.567454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.567580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.567622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.567637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.567786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.567993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.568017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.568033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.570442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.579787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.257 [2024-11-26 23:20:07.580135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.580273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.257 [2024-11-26 23:20:07.580301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.257 [2024-11-26 23:20:07.580318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.257 [2024-11-26 23:20:07.580446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.257 [2024-11-26 23:20:07.580590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.257 [2024-11-26 23:20:07.580614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.257 [2024-11-26 23:20:07.580630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.257 [2024-11-26 23:20:07.582998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.257 [2024-11-26 23:20:07.592431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.258 [2024-11-26 23:20:07.592771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.592931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.592959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.258 [2024-11-26 23:20:07.592981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.258 [2024-11-26 23:20:07.593111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.258 [2024-11-26 23:20:07.593244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.258 [2024-11-26 23:20:07.593267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.258 [2024-11-26 23:20:07.593282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.258 [2024-11-26 23:20:07.595557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.258 [2024-11-26 23:20:07.604911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.258 [2024-11-26 23:20:07.605208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.605362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.605390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.258 [2024-11-26 23:20:07.605406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.258 [2024-11-26 23:20:07.605566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.258 [2024-11-26 23:20:07.605718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.258 [2024-11-26 23:20:07.605742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.258 [2024-11-26 23:20:07.605757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.258 [2024-11-26 23:20:07.608163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.258 [2024-11-26 23:20:07.617397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.258 [2024-11-26 23:20:07.617779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.617907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.617935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.258 [2024-11-26 23:20:07.617952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.258 [2024-11-26 23:20:07.618063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.258 [2024-11-26 23:20:07.618268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.258 [2024-11-26 23:20:07.618292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.258 [2024-11-26 23:20:07.618308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.258 [2024-11-26 23:20:07.620675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.258 [2024-11-26 23:20:07.630218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.258 [2024-11-26 23:20:07.630542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.630645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.630674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.258 [2024-11-26 23:20:07.630691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.258 [2024-11-26 23:20:07.630862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.258 [2024-11-26 23:20:07.631068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.258 [2024-11-26 23:20:07.631092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.258 [2024-11-26 23:20:07.631107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.258 [2024-11-26 23:20:07.633479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.258 [2024-11-26 23:20:07.642676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.258 [2024-11-26 23:20:07.642993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.643092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.258 [2024-11-26 23:20:07.643121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.258 [2024-11-26 23:20:07.643138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.258 [2024-11-26 23:20:07.643302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.258 [2024-11-26 23:20:07.643472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.258 [2024-11-26 23:20:07.643495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.258 [2024-11-26 23:20:07.643510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.258 [2024-11-26 23:20:07.645727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.517 [2024-11-26 23:20:07.655195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.517 [2024-11-26 23:20:07.655471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.655602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.655632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.517 [2024-11-26 23:20:07.655649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.517 [2024-11-26 23:20:07.655796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.517 [2024-11-26 23:20:07.655947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.517 [2024-11-26 23:20:07.655970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.517 [2024-11-26 23:20:07.655985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.517 [2024-11-26 23:20:07.658210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.517 [2024-11-26 23:20:07.667873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.517 [2024-11-26 23:20:07.668196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.668352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.668380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.517 [2024-11-26 23:20:07.668397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.517 [2024-11-26 23:20:07.668543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.517 [2024-11-26 23:20:07.668746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.517 [2024-11-26 23:20:07.668771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.517 [2024-11-26 23:20:07.668786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.517 [2024-11-26 23:20:07.670971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.517 [2024-11-26 23:20:07.680358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.517 [2024-11-26 23:20:07.680615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.680752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.680780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.517 [2024-11-26 23:20:07.680797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.517 [2024-11-26 23:20:07.680984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.517 [2024-11-26 23:20:07.681153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.517 [2024-11-26 23:20:07.681176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.517 [2024-11-26 23:20:07.681191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.517 [2024-11-26 23:20:07.683507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.517 [2024-11-26 23:20:07.692941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.517 [2024-11-26 23:20:07.693251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.693365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.693391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.517 [2024-11-26 23:20:07.693406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.517 [2024-11-26 23:20:07.693581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.517 [2024-11-26 23:20:07.693766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.517 [2024-11-26 23:20:07.693799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.517 [2024-11-26 23:20:07.693814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.517 [2024-11-26 23:20:07.696203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.517 [2024-11-26 23:20:07.705551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.517 [2024-11-26 23:20:07.705856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.705995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.517 [2024-11-26 23:20:07.706020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.517 [2024-11-26 23:20:07.706036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.517 [2024-11-26 23:20:07.706167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.517 [2024-11-26 23:20:07.706327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.706356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.706372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.708665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.718363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.718669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.718818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.718843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.718859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.718990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.719173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.719197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.719212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.721665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.730964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.731256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.731384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.731409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.731424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.731625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.731795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.731818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.731834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.734328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.743338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.743614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.743731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.743759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.743776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.743959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.744091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.744114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.744135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.746555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.755963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.756276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.756405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.756432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.756449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.756624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.756829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.756852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.756868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.759189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.768620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.768968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.769139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.769163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.769178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.769342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.769559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.769590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.769606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.772140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.781217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.781537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.781660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.781688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.781705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.781869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.782092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.782115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.782131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.784487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.793782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.794071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.794221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.794249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.794266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.794467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.794681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.794705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.794721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.796940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.806482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.806819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.806959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.806985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.807000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.807159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.807346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.807370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.807385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.809669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.819007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.518 [2024-11-26 23:20:07.819349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.819476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.518 [2024-11-26 23:20:07.819501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.518 [2024-11-26 23:20:07.819517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.518 [2024-11-26 23:20:07.819699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.518 [2024-11-26 23:20:07.819850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.518 [2024-11-26 23:20:07.819874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.518 [2024-11-26 23:20:07.819889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.518 [2024-11-26 23:20:07.822280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.518 [2024-11-26 23:20:07.831502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.519 [2024-11-26 23:20:07.831904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.832022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.832064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.519 [2024-11-26 23:20:07.832081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.519 [2024-11-26 23:20:07.832245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.519 [2024-11-26 23:20:07.832396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.519 [2024-11-26 23:20:07.832418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.519 [2024-11-26 23:20:07.832433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.519 [2024-11-26 23:20:07.834777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.519 [2024-11-26 23:20:07.844028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.519 [2024-11-26 23:20:07.844341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.844520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.844554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.519 [2024-11-26 23:20:07.844570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.519 [2024-11-26 23:20:07.844765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.519 [2024-11-26 23:20:07.844880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.519 [2024-11-26 23:20:07.844903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.519 [2024-11-26 23:20:07.844918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.519 [2024-11-26 23:20:07.847329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.519 [2024-11-26 23:20:07.856631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.519 [2024-11-26 23:20:07.856933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.857051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.857079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.519 [2024-11-26 23:20:07.857096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.519 [2024-11-26 23:20:07.857279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.519 [2024-11-26 23:20:07.857502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.519 [2024-11-26 23:20:07.857534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.519 [2024-11-26 23:20:07.857553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.519 [2024-11-26 23:20:07.859785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.519 [2024-11-26 23:20:07.869260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.519 [2024-11-26 23:20:07.869538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.869671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.869699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.519 [2024-11-26 23:20:07.869716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.519 [2024-11-26 23:20:07.869881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.519 [2024-11-26 23:20:07.870014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.519 [2024-11-26 23:20:07.870037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.519 [2024-11-26 23:20:07.870052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.519 [2024-11-26 23:20:07.872406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.519 [2024-11-26 23:20:07.881755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.519 [2024-11-26 23:20:07.882123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.882254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.882282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.519 [2024-11-26 23:20:07.882299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.519 [2024-11-26 23:20:07.882446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.519 [2024-11-26 23:20:07.882589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.519 [2024-11-26 23:20:07.882614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.519 [2024-11-26 23:20:07.882629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.519 [2024-11-26 23:20:07.884856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.519 [2024-11-26 23:20:07.894310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.519 [2024-11-26 23:20:07.894628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.894793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.894818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.519 [2024-11-26 23:20:07.894833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.519 [2024-11-26 23:20:07.895039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.519 [2024-11-26 23:20:07.895245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.519 [2024-11-26 23:20:07.895268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.519 [2024-11-26 23:20:07.895283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.519 [2024-11-26 23:20:07.897607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.519 [2024-11-26 23:20:07.906812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.519 [2024-11-26 23:20:07.907112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.907243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.519 [2024-11-26 23:20:07.907276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.519 [2024-11-26 23:20:07.907294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.519 [2024-11-26 23:20:07.907459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.519 [2024-11-26 23:20:07.907640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.519 [2024-11-26 23:20:07.907664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.519 [2024-11-26 23:20:07.907679] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.778 [2024-11-26 23:20:07.910121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.778 [2024-11-26 23:20:07.919372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.778 [2024-11-26 23:20:07.919698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.778 [2024-11-26 23:20:07.919847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.778 [2024-11-26 23:20:07.919876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.778 [2024-11-26 23:20:07.919893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.778 [2024-11-26 23:20:07.920057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.778 [2024-11-26 23:20:07.920226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.778 [2024-11-26 23:20:07.920250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.778 [2024-11-26 23:20:07.920266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.778 [2024-11-26 23:20:07.922438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.778 [2024-11-26 23:20:07.931861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.778 [2024-11-26 23:20:07.932170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.778 [2024-11-26 23:20:07.932276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.778 [2024-11-26 23:20:07.932305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.778 [2024-11-26 23:20:07.932322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.778 [2024-11-26 23:20:07.932505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.778 [2024-11-26 23:20:07.932685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.778 [2024-11-26 23:20:07.932710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.778 [2024-11-26 23:20:07.932725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.778 [2024-11-26 23:20:07.934914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.778 [2024-11-26 23:20:07.944642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.778 [2024-11-26 23:20:07.944988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.778 [2024-11-26 23:20:07.945111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.778 [2024-11-26 23:20:07.945137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.778 [2024-11-26 23:20:07.945160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.778 [2024-11-26 23:20:07.945323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.778 [2024-11-26 23:20:07.945510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:07.945547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:07.945563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:07.947993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:07.957229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:07.957543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:07.957643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:07.957670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:07.957687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:07.957870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:07.957985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:07.958009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:07.958024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:07.960294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:07.969883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:07.970152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:07.970330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:07.970356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:07.970371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:07.970567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:07.970775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:07.970799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:07.970813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:07.973221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:07.982571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:07.982881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:07.983006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:07.983035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:07.983052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:07.983259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:07.983374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:07.983397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:07.983412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:07.985459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:07.995155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:07.995477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:07.995617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:07.995646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:07.995663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:07.995828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:07.995979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:07.996002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:07.996017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:07.998281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:08.007673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:08.007981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.008146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.008171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:08.008187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:08.008362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:08.008560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:08.008584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:08.008599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:08.010840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:08.020412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:08.020764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.020890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.020920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:08.020936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:08.021102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:08.021277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:08.021300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:08.021315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:08.023627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:08.032959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:08.033250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.033382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.033410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:08.033427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:08.033641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:08.033847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:08.033870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:08.033885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:08.036434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:08.045384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:08.045724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.045876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.045904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:08.045921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:08.046104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:08.046220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:08.046243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:08.046258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:08.048727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:08.058156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.779 [2024-11-26 23:20:08.058550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.058665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.779 [2024-11-26 23:20:08.058690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.779 [2024-11-26 23:20:08.058706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.779 [2024-11-26 23:20:08.058869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.779 [2024-11-26 23:20:08.059053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.779 [2024-11-26 23:20:08.059082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.779 [2024-11-26 23:20:08.059098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.779 [2024-11-26 23:20:08.061238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.779 [2024-11-26 23:20:08.070763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.780 [2024-11-26 23:20:08.071031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.071153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.071182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.780 [2024-11-26 23:20:08.071199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.780 [2024-11-26 23:20:08.071401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.780 [2024-11-26 23:20:08.071564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.780 [2024-11-26 23:20:08.071588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.780 [2024-11-26 23:20:08.071603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.780 [2024-11-26 23:20:08.073828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.780 [2024-11-26 23:20:08.083509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.780 [2024-11-26 23:20:08.083833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.083980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.084005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.780 [2024-11-26 23:20:08.084021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.780 [2024-11-26 23:20:08.084165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.780 [2024-11-26 23:20:08.084280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.780 [2024-11-26 23:20:08.084302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.780 [2024-11-26 23:20:08.084317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.780 [2024-11-26 23:20:08.086768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.780 [2024-11-26 23:20:08.096044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.780 [2024-11-26 23:20:08.096313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.096451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.096476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.780 [2024-11-26 23:20:08.096491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.780 [2024-11-26 23:20:08.096664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.780 [2024-11-26 23:20:08.096809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.780 [2024-11-26 23:20:08.096832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.780 [2024-11-26 23:20:08.096853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.780 [2024-11-26 23:20:08.099153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.780 [2024-11-26 23:20:08.108710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.780 [2024-11-26 23:20:08.109027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.109156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.109184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.780 [2024-11-26 23:20:08.109201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.780 [2024-11-26 23:20:08.109384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.780 [2024-11-26 23:20:08.109516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.780 [2024-11-26 23:20:08.109550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.780 [2024-11-26 23:20:08.109566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.780 [2024-11-26 23:20:08.111988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.780 [2024-11-26 23:20:08.121133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.780 [2024-11-26 23:20:08.121458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.121587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.121629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.780 [2024-11-26 23:20:08.121645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.780 [2024-11-26 23:20:08.121809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.780 [2024-11-26 23:20:08.122000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.780 [2024-11-26 23:20:08.122024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.780 [2024-11-26 23:20:08.122039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.780 [2024-11-26 23:20:08.124197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.780 [2024-11-26 23:20:08.133529] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.780 [2024-11-26 23:20:08.133806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.133962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.134011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.780 [2024-11-26 23:20:08.134029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.780 [2024-11-26 23:20:08.134211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.780 [2024-11-26 23:20:08.134397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.780 [2024-11-26 23:20:08.134420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.780 [2024-11-26 23:20:08.134435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.780 [2024-11-26 23:20:08.136949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.780 [2024-11-26 23:20:08.145987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.780 [2024-11-26 23:20:08.146252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.146372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.146397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.780 [2024-11-26 23:20:08.146413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.780 [2024-11-26 23:20:08.146638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.780 [2024-11-26 23:20:08.146801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.780 [2024-11-26 23:20:08.146825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.780 [2024-11-26 23:20:08.146840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.780 [2024-11-26 23:20:08.148922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.780 [2024-11-26 23:20:08.158650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.780 [2024-11-26 23:20:08.158949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.159152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.780 [2024-11-26 23:20:08.159210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:41.780 [2024-11-26 23:20:08.159228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:41.780 [2024-11-26 23:20:08.159356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:41.780 [2024-11-26 23:20:08.159576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.780 [2024-11-26 23:20:08.159601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.780 [2024-11-26 23:20:08.159615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.780 [2024-11-26 23:20:08.161948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.171224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.171499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.171641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.171669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.171686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.171850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.172037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.172060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.040 [2024-11-26 23:20:08.172075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.040 [2024-11-26 23:20:08.174343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.183761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.184086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.184215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.184243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.184260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.184425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.184608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.184632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.040 [2024-11-26 23:20:08.184648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.040 [2024-11-26 23:20:08.186927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.196404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.196639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.196766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.196794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.196811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.196922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.197091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.197114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.040 [2024-11-26 23:20:08.197130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.040 [2024-11-26 23:20:08.199471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.209010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.209371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.209509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.209542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.209576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.209777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.209964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.209987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.040 [2024-11-26 23:20:08.210003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.040 [2024-11-26 23:20:08.212378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.221499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.221770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.221901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.221945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.221961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.222140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.222357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.222380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.040 [2024-11-26 23:20:08.222396] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.040 [2024-11-26 23:20:08.224595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.234117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.234474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.234615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.234658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.234673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.234842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.235003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.235027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.040 [2024-11-26 23:20:08.235042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.040 [2024-11-26 23:20:08.237433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.246514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.246858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.246977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.247002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.247017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.247209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.247343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.247366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.040 [2024-11-26 23:20:08.247381] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.040 [2024-11-26 23:20:08.249837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.259027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.259313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.259445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.259478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.259496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.259640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.259810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.259833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.040 [2024-11-26 23:20:08.259848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.040 [2024-11-26 23:20:08.262256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.040 [2024-11-26 23:20:08.271725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.040 [2024-11-26 23:20:08.272009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.272138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.040 [2024-11-26 23:20:08.272163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.040 [2024-11-26 23:20:08.272178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.040 [2024-11-26 23:20:08.272358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.040 [2024-11-26 23:20:08.272568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.040 [2024-11-26 23:20:08.272593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.272608] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.274953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.284209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.284535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.284702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.284727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.284742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.284922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.285110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.285134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.285149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.287451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.296906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.297178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.297307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.297335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.297357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.297522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.297722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.297745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.297760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.300023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.309417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.309697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.309799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.309827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.309844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.309972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.310142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.310165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.310180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.312340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.322131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.322462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.322655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.322681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.322696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.322876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.323042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.323065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.323081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.325289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.335048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.335447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.335549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.335577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.335594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.335765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.335971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.335994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.336009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.338553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.347545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.347836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.347988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.348036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.348053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.348183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.348333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.348356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.348371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.350731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.360095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.360418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.360553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.360582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.360599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.360729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.360880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.360902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.360918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.363305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.372751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.373028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.373198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.373224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.373239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.373431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.373590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.373614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.373630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.375814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.385467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.385836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.385984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.041 [2024-11-26 23:20:08.386009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.041 [2024-11-26 23:20:08.386024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.041 [2024-11-26 23:20:08.386223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.041 [2024-11-26 23:20:08.386428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.041 [2024-11-26 23:20:08.386451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.041 [2024-11-26 23:20:08.386466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.041 [2024-11-26 23:20:08.388718] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.041 [2024-11-26 23:20:08.398128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.041 [2024-11-26 23:20:08.398449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.042 [2024-11-26 23:20:08.398572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.042 [2024-11-26 23:20:08.398601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.042 [2024-11-26 23:20:08.398618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.042 [2024-11-26 23:20:08.398783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.042 [2024-11-26 23:20:08.398970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.042 [2024-11-26 23:20:08.398993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.042 [2024-11-26 23:20:08.399008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.042 [2024-11-26 23:20:08.401325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.042 [2024-11-26 23:20:08.410833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.042 [2024-11-26 23:20:08.411141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.042 [2024-11-26 23:20:08.411300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.042 [2024-11-26 23:20:08.411326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.042 [2024-11-26 23:20:08.411341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.042 [2024-11-26 23:20:08.411520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.042 [2024-11-26 23:20:08.411672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.042 [2024-11-26 23:20:08.411701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.042 [2024-11-26 23:20:08.411717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.042 [2024-11-26 23:20:08.413996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.042 [2024-11-26 23:20:08.423599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.042 [2024-11-26 23:20:08.423960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.042 [2024-11-26 23:20:08.424118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.042 [2024-11-26 23:20:08.424159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.042 [2024-11-26 23:20:08.424174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.042 [2024-11-26 23:20:08.424322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.042 [2024-11-26 23:20:08.424490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.042 [2024-11-26 23:20:08.424514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.042 [2024-11-26 23:20:08.424536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.042 [2024-11-26 23:20:08.426823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.301 [2024-11-26 23:20:08.436259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.301 [2024-11-26 23:20:08.436522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.301 [2024-11-26 23:20:08.436683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.301 [2024-11-26 23:20:08.436711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.301 [2024-11-26 23:20:08.436728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.301 [2024-11-26 23:20:08.436875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.301 [2024-11-26 23:20:08.437043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.301 [2024-11-26 23:20:08.437067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.301 [2024-11-26 23:20:08.437082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.301 [2024-11-26 23:20:08.439290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.301 [2024-11-26 23:20:08.448964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.301 [2024-11-26 23:20:08.449257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.301 [2024-11-26 23:20:08.449373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.301 [2024-11-26 23:20:08.449400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.301 [2024-11-26 23:20:08.449417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.301 [2024-11-26 23:20:08.449575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.301 [2024-11-26 23:20:08.449727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.301 [2024-11-26 23:20:08.449750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.301 [2024-11-26 23:20:08.449771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.301 [2024-11-26 23:20:08.451995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.301 [2024-11-26 23:20:08.461546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.301 [2024-11-26 23:20:08.461815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.301 [2024-11-26 23:20:08.461949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.301 [2024-11-26 23:20:08.461977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.301 [2024-11-26 23:20:08.461994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.301 [2024-11-26 23:20:08.462177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.301 [2024-11-26 23:20:08.462346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.301 [2024-11-26 23:20:08.462370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.301 [2024-11-26 23:20:08.462386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.301 [2024-11-26 23:20:08.464601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.301 [2024-11-26 23:20:08.474043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.301 [2024-11-26 23:20:08.474333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.474487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.474515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.474541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.474672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.474895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.474918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.474934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.477138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.486608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.486909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.487042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.487067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.487083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.487262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.487445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.487468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.487484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.489757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.499087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.499381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.499547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.499576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.499593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.499776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.499927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.499950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.499965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.502224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.511621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.511946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.512068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.512093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.512108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.512282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.512415] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.512438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.512453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.514850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.524242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.524554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.524653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.524682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.524699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.524882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.525052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.525076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.525091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.527573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.536957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.537259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.537365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.537391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.537406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.537628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.537797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.537830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.537845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.540106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.549514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.549919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.550045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.550087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.550104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.550233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.550419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.550442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.550457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.552780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.562067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.562411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.562492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.562517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.562540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.562740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.562856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.562879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.562893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.565230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.574494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.574774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.574917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.574946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.574962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.302 [2024-11-26 23:20:08.575145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.302 [2024-11-26 23:20:08.575332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.302 [2024-11-26 23:20:08.575356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.302 [2024-11-26 23:20:08.575372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.302 [2024-11-26 23:20:08.577713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.302 [2024-11-26 23:20:08.587185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.302 [2024-11-26 23:20:08.587441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.587600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.302 [2024-11-26 23:20:08.587629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.302 [2024-11-26 23:20:08.587646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.587810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.587980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.588004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.588019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.590442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.303 [2024-11-26 23:20:08.599896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.303 [2024-11-26 23:20:08.600197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.600325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.600368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.303 [2024-11-26 23:20:08.600383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.600574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.600739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.600763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.600778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.603001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.303 [2024-11-26 23:20:08.612506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.303 [2024-11-26 23:20:08.612823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.612943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.612977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.303 [2024-11-26 23:20:08.612995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.613177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.613311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.613333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.613349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.615727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.303 [2024-11-26 23:20:08.625094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.303 [2024-11-26 23:20:08.625431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.625584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.625613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.303 [2024-11-26 23:20:08.625630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.625759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.625910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.625934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.625949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.628228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.303 [2024-11-26 23:20:08.637679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.303 [2024-11-26 23:20:08.637968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.638092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.638120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.303 [2024-11-26 23:20:08.638137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.638319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.638452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.638475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.638490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.640832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.303 [2024-11-26 23:20:08.650571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.303 [2024-11-26 23:20:08.650915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.651095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.651120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.303 [2024-11-26 23:20:08.651141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.651354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.651488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.651510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.651535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.653870] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.303 [2024-11-26 23:20:08.663203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.303 [2024-11-26 23:20:08.663530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.663659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.663700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.303 [2024-11-26 23:20:08.663715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.663880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.664059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.664082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.664097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.666603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.303 [2024-11-26 23:20:08.675911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.303 [2024-11-26 23:20:08.676217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.676333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.676361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.303 [2024-11-26 23:20:08.676378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.676535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.676705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.676728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.676743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.679058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.303 [2024-11-26 23:20:08.688644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.303 [2024-11-26 23:20:08.688956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.689080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.303 [2024-11-26 23:20:08.689108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.303 [2024-11-26 23:20:08.689125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.303 [2024-11-26 23:20:08.689295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.303 [2024-11-26 23:20:08.689500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.303 [2024-11-26 23:20:08.689523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.303 [2024-11-26 23:20:08.689547] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.303 [2024-11-26 23:20:08.691792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.563 [2024-11-26 23:20:08.701308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.563 [2024-11-26 23:20:08.701604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.701762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.701790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.563 [2024-11-26 23:20:08.701808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.563 [2024-11-26 23:20:08.701973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.563 [2024-11-26 23:20:08.702196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.563 [2024-11-26 23:20:08.702220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.563 [2024-11-26 23:20:08.702235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.563 [2024-11-26 23:20:08.704580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.563 [2024-11-26 23:20:08.714129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.563 [2024-11-26 23:20:08.714401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.714509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.714561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.563 [2024-11-26 23:20:08.714580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.563 [2024-11-26 23:20:08.714763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.563 [2024-11-26 23:20:08.714925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.563 [2024-11-26 23:20:08.714948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.563 [2024-11-26 23:20:08.714964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.563 [2024-11-26 23:20:08.717244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.563 [2024-11-26 23:20:08.726808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.563 [2024-11-26 23:20:08.727099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.727255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.727284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.563 [2024-11-26 23:20:08.727301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.563 [2024-11-26 23:20:08.727466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.563 [2024-11-26 23:20:08.727706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.563 [2024-11-26 23:20:08.727731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.563 [2024-11-26 23:20:08.727746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.563 [2024-11-26 23:20:08.730368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.563 [2024-11-26 23:20:08.739209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.563 [2024-11-26 23:20:08.739519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.739625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.739653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.563 [2024-11-26 23:20:08.739671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.563 [2024-11-26 23:20:08.739835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.563 [2024-11-26 23:20:08.740005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.563 [2024-11-26 23:20:08.740028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.563 [2024-11-26 23:20:08.740043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.563 [2024-11-26 23:20:08.742415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.563 [2024-11-26 23:20:08.751839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.563 [2024-11-26 23:20:08.752129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.752279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.752307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.563 [2024-11-26 23:20:08.752324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.563 [2024-11-26 23:20:08.752534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.563 [2024-11-26 23:20:08.752686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.563 [2024-11-26 23:20:08.752709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.563 [2024-11-26 23:20:08.752724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.563 [2024-11-26 23:20:08.755130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.563 [2024-11-26 23:20:08.764411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.563 [2024-11-26 23:20:08.764749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.764874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.764902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.563 [2024-11-26 23:20:08.764919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.563 [2024-11-26 23:20:08.765101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.563 [2024-11-26 23:20:08.765270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.563 [2024-11-26 23:20:08.765299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.563 [2024-11-26 23:20:08.765315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.563 [2024-11-26 23:20:08.767550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.563 [2024-11-26 23:20:08.777177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.563 [2024-11-26 23:20:08.777569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.777734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.563 [2024-11-26 23:20:08.777762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.563 [2024-11-26 23:20:08.777779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.563 [2024-11-26 23:20:08.777944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.563 [2024-11-26 23:20:08.778094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.563 [2024-11-26 23:20:08.778118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.563 [2024-11-26 23:20:08.778133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.780323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.789704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.790010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.790136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.790164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.790181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.790363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.790478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.790500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.790521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.792822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.802422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.802760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.802879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.802907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.802924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.803071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.803240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.803263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.803284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.805769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.815093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.815423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.815568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.815594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.815610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.815804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.815970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.815994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.816009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.818032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.827695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.828004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.828131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.828156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.828172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.828350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.828512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.828548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.828564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.830848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.840157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.840500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.840658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.840684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.840700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.840863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.841028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.841051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.841067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.843615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.852759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.853121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.853259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.853287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.853304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.853505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.853670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.853693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.853708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.855966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.865283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.865581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.865736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.865764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.865781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.865928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.866132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.866156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.866171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.868309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.877737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.878145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.878290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.878331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.878347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.878461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.878644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.878669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.878684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.880890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.890342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.890626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.890757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.890783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.564 [2024-11-26 23:20:08.890799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.564 [2024-11-26 23:20:08.890955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.564 [2024-11-26 23:20:08.891182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.564 [2024-11-26 23:20:08.891206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.564 [2024-11-26 23:20:08.891221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.564 [2024-11-26 23:20:08.893706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.564 [2024-11-26 23:20:08.903005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.564 [2024-11-26 23:20:08.903267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.903431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.564 [2024-11-26 23:20:08.903456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.565 [2024-11-26 23:20:08.903472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.565 [2024-11-26 23:20:08.903638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.565 [2024-11-26 23:20:08.903772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.565 [2024-11-26 23:20:08.903795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.565 [2024-11-26 23:20:08.903810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.565 [2024-11-26 23:20:08.906086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.565 [2024-11-26 23:20:08.915375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.565 [2024-11-26 23:20:08.915675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.565 [2024-11-26 23:20:08.915794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.565 [2024-11-26 23:20:08.915847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.565 [2024-11-26 23:20:08.915863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.565 [2024-11-26 23:20:08.916024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.565 [2024-11-26 23:20:08.916183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.565 [2024-11-26 23:20:08.916206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.565 [2024-11-26 23:20:08.916222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.565 [2024-11-26 23:20:08.918686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.565 [2024-11-26 23:20:08.927797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.565 [2024-11-26 23:20:08.928076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.565 [2024-11-26 23:20:08.928226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.565 [2024-11-26 23:20:08.928254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.565 [2024-11-26 23:20:08.928272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.565 [2024-11-26 23:20:08.928454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.565 [2024-11-26 23:20:08.928670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.565 [2024-11-26 23:20:08.928695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.565 [2024-11-26 23:20:08.928710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.565 [2024-11-26 23:20:08.931245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.565 [2024-11-26 23:20:08.940334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.565 [2024-11-26 23:20:08.940659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.565 [2024-11-26 23:20:08.940768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.565 [2024-11-26 23:20:08.940796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.565 [2024-11-26 23:20:08.940813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.565 [2024-11-26 23:20:08.940959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.565 [2024-11-26 23:20:08.941128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.565 [2024-11-26 23:20:08.941151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.565 [2024-11-26 23:20:08.941166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.565 [2024-11-26 23:20:08.943479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.565 [2024-11-26 23:20:08.953005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.565 [2024-11-26 23:20:08.953344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.565 [2024-11-26 23:20:08.953495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.565 [2024-11-26 23:20:08.953532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.565 [2024-11-26 23:20:08.953551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.565 [2024-11-26 23:20:08.953717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.565 [2024-11-26 23:20:08.953867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.565 [2024-11-26 23:20:08.953891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.565 [2024-11-26 23:20:08.953906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.824 [2024-11-26 23:20:08.956076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.824 [2024-11-26 23:20:08.965607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.824 [2024-11-26 23:20:08.965921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.824 [2024-11-26 23:20:08.966062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:08.966091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:08.966107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:08.966267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:08.966453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:08.966476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:08.966491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:08.969063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:08.978254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:08.978517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:08.978667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:08.978695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:08.978712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:08.978860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:08.979011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:08.979034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:08.979050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:08.981436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:08.990874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:08.991137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:08.991265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:08.991293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:08.991310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:08.991475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:08.991620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:08.991644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:08.991659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:08.994260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:09.003480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:09.003899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.004073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.004101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:09.004128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:09.004313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:09.004445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:09.004468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:09.004483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:09.006934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:09.016094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:09.016430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.016588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.016617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:09.016634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:09.016745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:09.016950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:09.016973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:09.016988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:09.019391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:09.028743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:09.029035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.029186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.029214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:09.029231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:09.029396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:09.029558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:09.029582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:09.029597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:09.031909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:09.041355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:09.041650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.041799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.041828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:09.041845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:09.041998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:09.042166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:09.042189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:09.042205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:09.044648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:09.053937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:09.054248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.054375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.054403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:09.054421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:09.054651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:09.054821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:09.054845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:09.054860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:09.057262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:09.066522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:09.066819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.066948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.066976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:09.066993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.825 [2024-11-26 23:20:09.067140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.825 [2024-11-26 23:20:09.067327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.825 [2024-11-26 23:20:09.067350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.825 [2024-11-26 23:20:09.067365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.825 [2024-11-26 23:20:09.069696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.825 [2024-11-26 23:20:09.079194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.825 [2024-11-26 23:20:09.079542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.079700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.825 [2024-11-26 23:20:09.079728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.825 [2024-11-26 23:20:09.079745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.079910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.080123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.080146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.080162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.082594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.091696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.092024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.092150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.092178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.092195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.092323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.092438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.092461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.092476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.094690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.104176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.104461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.104592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.104621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.104638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.104803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.104954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.104977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.104992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.107467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.116633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.116919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.117012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.117040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.117057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.117259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.117428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.117460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.117476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.119838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.128993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.129302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.129397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.129425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.129442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.129600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.129788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.129811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.129826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.132287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.141499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.141805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.141933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.141962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.141979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.142143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.142330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.142354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.142369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.144748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.153954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.154297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.154418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.154446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.154463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.154657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.154827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.154850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.154872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.157080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.166385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.166737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.166891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.166919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.166936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.167118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.167288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.167311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.167326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.169814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.178877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.179232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.179364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.179393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.179410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.179586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.179719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.826 [2024-11-26 23:20:09.179742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.826 [2024-11-26 23:20:09.179758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.826 [2024-11-26 23:20:09.181802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.826 [2024-11-26 23:20:09.191538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.826 [2024-11-26 23:20:09.191907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.192038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.826 [2024-11-26 23:20:09.192067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.826 [2024-11-26 23:20:09.192084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.826 [2024-11-26 23:20:09.192267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.826 [2024-11-26 23:20:09.192435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.827 [2024-11-26 23:20:09.192459] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.827 [2024-11-26 23:20:09.192474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.827 [2024-11-26 23:20:09.194787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.827 [2024-11-26 23:20:09.203979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.827 [2024-11-26 23:20:09.204325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.827 [2024-11-26 23:20:09.204432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.827 [2024-11-26 23:20:09.204460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:42.827 [2024-11-26 23:20:09.204477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:42.827 [2024-11-26 23:20:09.204708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:42.827 [2024-11-26 23:20:09.204860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.827 [2024-11-26 23:20:09.204883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.827 [2024-11-26 23:20:09.204899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.827 [2024-11-26 23:20:09.207164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.084 [2024-11-26 23:20:09.216666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.216996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.217119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.217147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.217165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.217312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.217481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.217504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.217519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.219956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.229273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.229546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.229671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.229700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.229717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.229882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.230051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.230074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.230090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.232443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.241719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.242078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.242230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.242258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.242275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.242404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.242546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.242570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.242585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.244882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.254265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.254592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.254747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.254775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.254792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.254939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.255072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.255095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.255110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.257209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.266825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.267092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.267244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.267273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.267290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.267509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.267743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.267767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.267782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.270115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.279487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.279801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.279931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.279959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.279976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.280159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.280399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.280422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.280437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.282781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.292228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.292569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.292699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.292727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.292744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.292927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.293078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.293102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.293117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.295470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.304604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.304901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.305019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.305047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.305064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.305229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.305361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.305384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.305399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.307795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.317157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.085 [2024-11-26 23:20:09.317502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.317610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.085 [2024-11-26 23:20:09.317643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.085 [2024-11-26 23:20:09.317661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.085 [2024-11-26 23:20:09.317826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.085 [2024-11-26 23:20:09.317977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.085 [2024-11-26 23:20:09.318001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.085 [2024-11-26 23:20:09.318016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.085 [2024-11-26 23:20:09.320155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.085 [2024-11-26 23:20:09.329951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.330237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.330389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.330417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.086 [2024-11-26 23:20:09.330435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.086 [2024-11-26 23:20:09.330593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.086 [2024-11-26 23:20:09.330763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.086 [2024-11-26 23:20:09.330786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.086 [2024-11-26 23:20:09.330801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.086 [2024-11-26 23:20:09.333081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.086 [2024-11-26 23:20:09.342607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.342914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.343050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.343078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.086 [2024-11-26 23:20:09.343095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.086 [2024-11-26 23:20:09.343241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.086 [2024-11-26 23:20:09.343392] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.086 [2024-11-26 23:20:09.343415] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.086 [2024-11-26 23:20:09.343430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.086 [2024-11-26 23:20:09.345916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.086 [2024-11-26 23:20:09.355428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.355758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.355884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.355911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.086 [2024-11-26 23:20:09.355934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.086 [2024-11-26 23:20:09.356117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.086 [2024-11-26 23:20:09.356250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.086 [2024-11-26 23:20:09.356272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.086 [2024-11-26 23:20:09.356288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.086 [2024-11-26 23:20:09.358461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.086 [2024-11-26 23:20:09.368062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.368452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.368588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.368617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.086 [2024-11-26 23:20:09.368634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.086 [2024-11-26 23:20:09.368853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.086 [2024-11-26 23:20:09.369004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.086 [2024-11-26 23:20:09.369027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.086 [2024-11-26 23:20:09.369043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.086 [2024-11-26 23:20:09.371394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.086 [2024-11-26 23:20:09.380624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.380917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.381043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.381072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.086 [2024-11-26 23:20:09.381089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.086 [2024-11-26 23:20:09.381236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.086 [2024-11-26 23:20:09.381476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.086 [2024-11-26 23:20:09.381499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.086 [2024-11-26 23:20:09.381515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.086 [2024-11-26 23:20:09.383879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.086 [2024-11-26 23:20:09.393304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.393572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.393725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.393753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.086 [2024-11-26 23:20:09.393770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.086 [2024-11-26 23:20:09.393977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.086 [2024-11-26 23:20:09.394146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.086 [2024-11-26 23:20:09.394169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.086 [2024-11-26 23:20:09.394185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.086 [2024-11-26 23:20:09.396562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.086 [2024-11-26 23:20:09.405751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.406036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.406188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.406216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.086 [2024-11-26 23:20:09.406233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.086 [2024-11-26 23:20:09.406380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.086 [2024-11-26 23:20:09.406542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.086 [2024-11-26 23:20:09.406565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.086 [2024-11-26 23:20:09.406581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.086 [2024-11-26 23:20:09.408894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.086 [2024-11-26 23:20:09.418372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.418742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.418873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.418900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.086 [2024-11-26 23:20:09.418917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.086 [2024-11-26 23:20:09.419046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.086 [2024-11-26 23:20:09.419232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.086 [2024-11-26 23:20:09.419256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.086 [2024-11-26 23:20:09.419271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.086 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 323222 Killed "${NVMF_APP[@]}" "$@" 00:27:43.086 23:20:09 -- host/bdevperf.sh@36 -- # tgt_init 00:27:43.086 [2024-11-26 23:20:09.421669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.086 23:20:09 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:43.086 23:20:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:43.086 23:20:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:43.086 23:20:09 -- common/autotest_common.sh@10 -- # set +x 00:27:43.086 23:20:09 -- nvmf/common.sh@469 -- # nvmfpid=324333 00:27:43.086 23:20:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:43.086 23:20:09 -- nvmf/common.sh@470 -- # waitforlisten 324333 00:27:43.086 23:20:09 -- common/autotest_common.sh@829 -- # '[' -z 324333 ']' 00:27:43.086 23:20:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:43.086 23:20:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:43.086 23:20:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:43.086 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:43.086 23:20:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:43.086 23:20:09 -- common/autotest_common.sh@10 -- # set +x 00:27:43.086 [2024-11-26 23:20:09.430872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.086 [2024-11-26 23:20:09.431189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.086 [2024-11-26 23:20:09.431345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.087 [2024-11-26 23:20:09.431373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.087 [2024-11-26 23:20:09.431391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.087 [2024-11-26 23:20:09.431584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.087 [2024-11-26 23:20:09.431721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.087 [2024-11-26 23:20:09.431745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.087 [2024-11-26 23:20:09.431761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.087 [2024-11-26 23:20:09.434041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.087 [2024-11-26 23:20:09.443332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.087 [2024-11-26 23:20:09.443636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.087 [2024-11-26 23:20:09.443745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.087 [2024-11-26 23:20:09.443773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.087 [2024-11-26 23:20:09.443790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.087 [2024-11-26 23:20:09.443973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.087 [2024-11-26 23:20:09.444159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.087 [2024-11-26 23:20:09.444182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.087 [2024-11-26 23:20:09.444197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.087 [2024-11-26 23:20:09.446599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.087 [2024-11-26 23:20:09.456086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.087 [2024-11-26 23:20:09.456336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.087 [2024-11-26 23:20:09.456497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.087 [2024-11-26 23:20:09.456545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.087 [2024-11-26 23:20:09.456564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.087 [2024-11-26 23:20:09.456730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.087 [2024-11-26 23:20:09.456899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.087 [2024-11-26 23:20:09.456928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.087 [2024-11-26 23:20:09.456944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.087 [2024-11-26 23:20:09.459244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.087 [2024-11-26 23:20:09.468701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.087 [2024-11-26 23:20:09.468986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.087 [2024-11-26 23:20:09.469138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.087 [2024-11-26 23:20:09.469166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.087 [2024-11-26 23:20:09.469183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.087 [2024-11-26 23:20:09.469348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.087 [2024-11-26 23:20:09.469499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.087 [2024-11-26 23:20:09.469522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.087 [2024-11-26 23:20:09.469549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.087 [2024-11-26 23:20:09.470736] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:43.087 [2024-11-26 23:20:09.470823] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:43.087 [2024-11-26 23:20:09.471885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.347 [2024-11-26 23:20:09.481013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.347 [2024-11-26 23:20:09.481320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.481412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.481440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.347 [2024-11-26 23:20:09.481458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.347 [2024-11-26 23:20:09.481634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.347 [2024-11-26 23:20:09.481840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.347 [2024-11-26 23:20:09.481863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.347 [2024-11-26 23:20:09.481878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.347 [2024-11-26 23:20:09.484145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.347 [2024-11-26 23:20:09.493670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.347 [2024-11-26 23:20:09.493978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.494131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.494159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.347 [2024-11-26 23:20:09.494176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.347 [2024-11-26 23:20:09.494305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.347 [2024-11-26 23:20:09.494463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.347 [2024-11-26 23:20:09.494486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.347 [2024-11-26 23:20:09.494501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.347 [2024-11-26 23:20:09.496590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.347 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.347 [2024-11-26 23:20:09.506413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.347 [2024-11-26 23:20:09.506680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.506789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.506817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.347 [2024-11-26 23:20:09.506835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.347 [2024-11-26 23:20:09.507000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.347 [2024-11-26 23:20:09.507187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.347 [2024-11-26 23:20:09.507210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.347 [2024-11-26 23:20:09.507226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.347 [2024-11-26 23:20:09.509513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.347 [2024-11-26 23:20:09.519201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.347 [2024-11-26 23:20:09.519474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.519607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.519635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.347 [2024-11-26 23:20:09.519653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.347 [2024-11-26 23:20:09.519764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.347 [2024-11-26 23:20:09.519932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.347 [2024-11-26 23:20:09.519955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.347 [2024-11-26 23:20:09.519970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.347 [2024-11-26 23:20:09.522374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.347 [2024-11-26 23:20:09.531796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.347 [2024-11-26 23:20:09.532069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.532197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.532225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.347 [2024-11-26 23:20:09.532242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.347 [2024-11-26 23:20:09.532444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.347 [2024-11-26 23:20:09.532593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.347 [2024-11-26 23:20:09.532618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.347 [2024-11-26 23:20:09.532633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.347 [2024-11-26 23:20:09.534914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.347 [2024-11-26 23:20:09.539895] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:43.347 [2024-11-26 23:20:09.544306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.347 [2024-11-26 23:20:09.544638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.544773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.544801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.347 [2024-11-26 23:20:09.544819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.347 [2024-11-26 23:20:09.544986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.347 [2024-11-26 23:20:09.545174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.347 [2024-11-26 23:20:09.545197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.347 [2024-11-26 23:20:09.545214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.347 [2024-11-26 23:20:09.547624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.347 [2024-11-26 23:20:09.557001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.347 [2024-11-26 23:20:09.557420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.557565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.347 [2024-11-26 23:20:09.557595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.347 [2024-11-26 23:20:09.557615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.347 [2024-11-26 23:20:09.557808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.557963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.557987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.558005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.560372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.569496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.569804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.569917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.569945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.348 [2024-11-26 23:20:09.569962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.348 [2024-11-26 23:20:09.570145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.570297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.570332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.570349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.572549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.581906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.582156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.582320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.582348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.348 [2024-11-26 23:20:09.582366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.348 [2024-11-26 23:20:09.582560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.582731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.582755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.582770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.585252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.594477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.594791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.594907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.594935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.348 [2024-11-26 23:20:09.594953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.348 [2024-11-26 23:20:09.595100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.595251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.595274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.595289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.597848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.607230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.607632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.607772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.607801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.348 [2024-11-26 23:20:09.607821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.348 [2024-11-26 23:20:09.608006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.608215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.608240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.608269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.610738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.619902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.620250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.620377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.620406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.348 [2024-11-26 23:20:09.620426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.348 [2024-11-26 23:20:09.620587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.620722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.620746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.620763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.623061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.632512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.632795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.632935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.632965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.348 [2024-11-26 23:20:09.632982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.348 [2024-11-26 23:20:09.633166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.633316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.633340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.633355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.635424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.645090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.645441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.645604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.645634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.348 [2024-11-26 23:20:09.645651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.348 [2024-11-26 23:20:09.645834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.645949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.645973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.645988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.648402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.657556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.657849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.658001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.348 [2024-11-26 23:20:09.658029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.348 [2024-11-26 23:20:09.658046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.348 [2024-11-26 23:20:09.658229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.348 [2024-11-26 23:20:09.658398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.348 [2024-11-26 23:20:09.658421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.348 [2024-11-26 23:20:09.658438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.348 [2024-11-26 23:20:09.659071] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:43.348 [2024-11-26 23:20:09.659209] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:43.348 [2024-11-26 23:20:09.659229] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:43.348 [2024-11-26 23:20:09.659245] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:43.348 [2024-11-26 23:20:09.659301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:43.348 [2024-11-26 23:20:09.659357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:43.348 [2024-11-26 23:20:09.659361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:43.348 [2024-11-26 23:20:09.660899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.348 [2024-11-26 23:20:09.670125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.348 [2024-11-26 23:20:09.670481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.670667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.670696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.349 [2024-11-26 23:20:09.670717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.349 [2024-11-26 23:20:09.670837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.349 [2024-11-26 23:20:09.671066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.349 [2024-11-26 23:20:09.671090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.349 [2024-11-26 23:20:09.671110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.349 [2024-11-26 23:20:09.673301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.349 [2024-11-26 23:20:09.682891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.349 [2024-11-26 23:20:09.683282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.683397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.683426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.349 [2024-11-26 23:20:09.683447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.349 [2024-11-26 23:20:09.683680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.349 [2024-11-26 23:20:09.683839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.349 [2024-11-26 23:20:09.683863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.349 [2024-11-26 23:20:09.683883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.349 [2024-11-26 23:20:09.686168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.349 [2024-11-26 23:20:09.695630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.349 [2024-11-26 23:20:09.696088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.696219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.696249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.349 [2024-11-26 23:20:09.696271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.349 [2024-11-26 23:20:09.696452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.349 [2024-11-26 23:20:09.696623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.349 [2024-11-26 23:20:09.696648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.349 [2024-11-26 23:20:09.696668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.349 [2024-11-26 23:20:09.698898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.349 [2024-11-26 23:20:09.708498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.349 [2024-11-26 23:20:09.708923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.709124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.709153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.349 [2024-11-26 23:20:09.709176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.349 [2024-11-26 23:20:09.709374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.349 [2024-11-26 23:20:09.709577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.349 [2024-11-26 23:20:09.709602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.349 [2024-11-26 23:20:09.709655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.349 [2024-11-26 23:20:09.711860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.349 [2024-11-26 23:20:09.721144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.349 [2024-11-26 23:20:09.721406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.721549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.721585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.349 [2024-11-26 23:20:09.721604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.349 [2024-11-26 23:20:09.721788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.349 [2024-11-26 23:20:09.721905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.349 [2024-11-26 23:20:09.721929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.349 [2024-11-26 23:20:09.721946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.349 [2024-11-26 23:20:09.724354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.349 [2024-11-26 23:20:09.733565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.349 [2024-11-26 23:20:09.733974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.734075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.349 [2024-11-26 23:20:09.734104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.349 [2024-11-26 23:20:09.734126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.349 [2024-11-26 23:20:09.734249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.349 [2024-11-26 23:20:09.734425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.349 [2024-11-26 23:20:09.734449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.349 [2024-11-26 23:20:09.734470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.349 [2024-11-26 23:20:09.737044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.608 [2024-11-26 23:20:09.746091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.608 [2024-11-26 23:20:09.746448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.608 [2024-11-26 23:20:09.746619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.608 [2024-11-26 23:20:09.746649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.608 [2024-11-26 23:20:09.746669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.608 [2024-11-26 23:20:09.746847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.608 [2024-11-26 23:20:09.747002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.608 [2024-11-26 23:20:09.747025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.608 [2024-11-26 23:20:09.747043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.608 [2024-11-26 23:20:09.749598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.608 [2024-11-26 23:20:09.758724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.608 [2024-11-26 23:20:09.758996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.759126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.759154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.759171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.759300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.759424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.759447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.759463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.761813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.771212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.771554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.771654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.771687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.771705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.771870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.772039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.772062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.772078] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.774408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.783601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.783891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.783996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.784025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.784042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.784190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.784377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.784401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.784416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.786705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.795997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.796276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.796403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.796431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.796448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.796622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.796845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.796869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.796890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.799263] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.808575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.808856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.808984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.809012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.809029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.809158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.809309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.809332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.809347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.811795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.821187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.821538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.821668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.821696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.821713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.821879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.822101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.822124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.822139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.824439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.833935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.834174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.834327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.834355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.834372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.834501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.834663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.834687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.834708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.836991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.846444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.846734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.846863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.846891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.846908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.847090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.847259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.847282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.847298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.849414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.859123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.859405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.859513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.859552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.609 [2024-11-26 23:20:09.859570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.609 [2024-11-26 23:20:09.859735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.609 [2024-11-26 23:20:09.859886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.609 [2024-11-26 23:20:09.859909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.609 [2024-11-26 23:20:09.859924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.609 [2024-11-26 23:20:09.862273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.609 [2024-11-26 23:20:09.871612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.609 [2024-11-26 23:20:09.871854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.871945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.609 [2024-11-26 23:20:09.871973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.871990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.872136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.872342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.872365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.610 [2024-11-26 23:20:09.872380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.610 [2024-11-26 23:20:09.874683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.610 [2024-11-26 23:20:09.884101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.610 [2024-11-26 23:20:09.884394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.884480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.884508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.884532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.884681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.884850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.884873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.610 [2024-11-26 23:20:09.884888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.610 [2024-11-26 23:20:09.887221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.610 [2024-11-26 23:20:09.896582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.610 [2024-11-26 23:20:09.896816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.896949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.896977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.896995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.897177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.897347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.897371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.610 [2024-11-26 23:20:09.897386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.610 [2024-11-26 23:20:09.899808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.610 [2024-11-26 23:20:09.909018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.610 [2024-11-26 23:20:09.909342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.909444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.909476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.909493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.909685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.909837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.909861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.610 [2024-11-26 23:20:09.909876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.610 [2024-11-26 23:20:09.912171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.610 [2024-11-26 23:20:09.921572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.610 [2024-11-26 23:20:09.921884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.921983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.922013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.922031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.922159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.922365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.922389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.610 [2024-11-26 23:20:09.922405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.610 [2024-11-26 23:20:09.924729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.610 [2024-11-26 23:20:09.934236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.610 [2024-11-26 23:20:09.934495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.934663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.934692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.934709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.934874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.935043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.935067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.610 [2024-11-26 23:20:09.935082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.610 [2024-11-26 23:20:09.937420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.610 [2024-11-26 23:20:09.946955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.610 [2024-11-26 23:20:09.947204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.947366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.947394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.947412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.947604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.947810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.947834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.610 [2024-11-26 23:20:09.947849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.610 [2024-11-26 23:20:09.950020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.610 [2024-11-26 23:20:09.959587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.610 [2024-11-26 23:20:09.959861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.959986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.960015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.960032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.960179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.960366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.960390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.610 [2024-11-26 23:20:09.960405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.610 [2024-11-26 23:20:09.962646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.610 [2024-11-26 23:20:09.972345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.610 [2024-11-26 23:20:09.972581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.972686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.610 [2024-11-26 23:20:09.972714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.610 [2024-11-26 23:20:09.972732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.610 [2024-11-26 23:20:09.972879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.610 [2024-11-26 23:20:09.973049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.610 [2024-11-26 23:20:09.973072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.611 [2024-11-26 23:20:09.973088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.611 [2024-11-26 23:20:09.975441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.611 [2024-11-26 23:20:09.984812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.611 [2024-11-26 23:20:09.985121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.611 [2024-11-26 23:20:09.985256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.611 [2024-11-26 23:20:09.985284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.611 [2024-11-26 23:20:09.985301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.611 [2024-11-26 23:20:09.985430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.611 [2024-11-26 23:20:09.985591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.611 [2024-11-26 23:20:09.985615] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.611 [2024-11-26 23:20:09.985630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.611 [2024-11-26 23:20:09.987937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.611 [2024-11-26 23:20:09.997154] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.611 [2024-11-26 23:20:09.997385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.611 [2024-11-26 23:20:09.997514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.611 [2024-11-26 23:20:09.997551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.611 [2024-11-26 23:20:09.997574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.611 [2024-11-26 23:20:09.997722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.611 [2024-11-26 23:20:09.997927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.611 [2024-11-26 23:20:09.997951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.611 [2024-11-26 23:20:09.997966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.870 [2024-11-26 23:20:10.000372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.870 [2024-11-26 23:20:10.009783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.870 [2024-11-26 23:20:10.010103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.010233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.010262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.870 [2024-11-26 23:20:10.010280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.870 [2024-11-26 23:20:10.010446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.870 [2024-11-26 23:20:10.010596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.870 [2024-11-26 23:20:10.010621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.870 [2024-11-26 23:20:10.010636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.870 [2024-11-26 23:20:10.013090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.870 [2024-11-26 23:20:10.022700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.870 [2024-11-26 23:20:10.023022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.023160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.023192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.870 [2024-11-26 23:20:10.023213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.870 [2024-11-26 23:20:10.023381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.870 [2024-11-26 23:20:10.023582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.870 [2024-11-26 23:20:10.023610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.870 [2024-11-26 23:20:10.023629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.870 [2024-11-26 23:20:10.025771] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.870 [2024-11-26 23:20:10.035436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.870 [2024-11-26 23:20:10.035674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.035801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.035830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.870 [2024-11-26 23:20:10.035854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.870 [2024-11-26 23:20:10.036038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.870 [2024-11-26 23:20:10.036198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.870 [2024-11-26 23:20:10.036221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.870 [2024-11-26 23:20:10.036236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.870 [2024-11-26 23:20:10.038338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.870 [2024-11-26 23:20:10.048055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.870 [2024-11-26 23:20:10.048278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.048384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.048412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.870 [2024-11-26 23:20:10.048429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.870 [2024-11-26 23:20:10.048622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.870 [2024-11-26 23:20:10.048829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.870 [2024-11-26 23:20:10.048859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.870 [2024-11-26 23:20:10.048874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.870 [2024-11-26 23:20:10.051314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.870 [2024-11-26 23:20:10.060573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.870 [2024-11-26 23:20:10.060844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.060975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.870 [2024-11-26 23:20:10.061003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.870 [2024-11-26 23:20:10.061020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.061167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.061336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.061359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.061374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.063678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.073329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.073623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.073728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.073765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.073792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.074031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.074250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.074281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.074306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.077324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.085949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.086244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.086348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.086377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.086394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.086553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.086747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.086771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.086786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.089069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.098746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.099036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.099138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.099167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.099184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.099313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.099464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.099488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.099503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.101915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.111303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.111556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.111692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.111721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.111738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.111867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.112059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.112083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.112099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.114395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.123850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.124175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.124310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.124338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.124356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.124520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.124736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.124759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.124774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.126983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.136397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.136628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.136785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.136813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.136830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.137032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.137183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.137207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.137222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.139618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.148825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.149145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.149264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.149292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.149309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.149473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.149687] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.149716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.149732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.152081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.161555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.161783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.161905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.161933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.161950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.162079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.162247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.162270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.871 [2024-11-26 23:20:10.162285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.871 [2024-11-26 23:20:10.164473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.871 [2024-11-26 23:20:10.173894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.871 [2024-11-26 23:20:10.174182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.174285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.871 [2024-11-26 23:20:10.174313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.871 [2024-11-26 23:20:10.174330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.871 [2024-11-26 23:20:10.174476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.871 [2024-11-26 23:20:10.174674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.871 [2024-11-26 23:20:10.174698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.872 [2024-11-26 23:20:10.174714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.872 [2024-11-26 23:20:10.177086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.872 [2024-11-26 23:20:10.186549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.872 [2024-11-26 23:20:10.186873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.186970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.186996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.872 [2024-11-26 23:20:10.187013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.872 [2024-11-26 23:20:10.187123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.872 [2024-11-26 23:20:10.187291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.872 [2024-11-26 23:20:10.187314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.872 [2024-11-26 23:20:10.187336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.872 [2024-11-26 23:20:10.189612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.872 [2024-11-26 23:20:10.199231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.872 [2024-11-26 23:20:10.199520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.199629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.199656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.872 [2024-11-26 23:20:10.199674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.872 [2024-11-26 23:20:10.199857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.872 [2024-11-26 23:20:10.200044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.872 [2024-11-26 23:20:10.200067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.872 [2024-11-26 23:20:10.200082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.872 [2024-11-26 23:20:10.202311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.872 [2024-11-26 23:20:10.211882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.872 [2024-11-26 23:20:10.212208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.212314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.212342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.872 [2024-11-26 23:20:10.212359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.872 [2024-11-26 23:20:10.212470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.872 [2024-11-26 23:20:10.212668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.872 [2024-11-26 23:20:10.212692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.872 [2024-11-26 23:20:10.212707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.872 [2024-11-26 23:20:10.215046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.872 [2024-11-26 23:20:10.224602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.872 [2024-11-26 23:20:10.224867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.224993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.225021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.872 [2024-11-26 23:20:10.225038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.872 [2024-11-26 23:20:10.225203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.872 [2024-11-26 23:20:10.225336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.872 [2024-11-26 23:20:10.225358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.872 [2024-11-26 23:20:10.225373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.872 [2024-11-26 23:20:10.227732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.872 [2024-11-26 23:20:10.236813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.872 [2024-11-26 23:20:10.237154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.237284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.237312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.872 [2024-11-26 23:20:10.237329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.872 [2024-11-26 23:20:10.237439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.872 [2024-11-26 23:20:10.237601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.872 [2024-11-26 23:20:10.237626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.872 [2024-11-26 23:20:10.237641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.872 [2024-11-26 23:20:10.239975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.872 [2024-11-26 23:20:10.249532] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.872 [2024-11-26 23:20:10.249810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.249905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.872 [2024-11-26 23:20:10.249933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:43.872 [2024-11-26 23:20:10.249950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:43.872 [2024-11-26 23:20:10.250114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:43.872 [2024-11-26 23:20:10.250282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.872 [2024-11-26 23:20:10.250309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.872 [2024-11-26 23:20:10.250324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.872 [2024-11-26 23:20:10.252548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.872 [2024-11-26 23:20:10.261953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.132 [2024-11-26 23:20:10.262235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.262347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.262375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.132 [2024-11-26 23:20:10.262392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.132 [2024-11-26 23:20:10.262548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.132 [2024-11-26 23:20:10.262746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.132 [2024-11-26 23:20:10.262771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.132 [2024-11-26 23:20:10.262787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.132 [2024-11-26 23:20:10.265161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.132 [2024-11-26 23:20:10.274618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.132 [2024-11-26 23:20:10.274952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.275051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.275080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.132 [2024-11-26 23:20:10.275098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.132 [2024-11-26 23:20:10.275262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.132 [2024-11-26 23:20:10.275421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.132 [2024-11-26 23:20:10.275447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.132 [2024-11-26 23:20:10.275462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.132 [2024-11-26 23:20:10.277774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.132 [2024-11-26 23:20:10.287095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.132 [2024-11-26 23:20:10.287420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.287535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.287564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.132 [2024-11-26 23:20:10.287581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.132 [2024-11-26 23:20:10.287710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.132 [2024-11-26 23:20:10.287880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.132 [2024-11-26 23:20:10.287903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.132 [2024-11-26 23:20:10.287918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.132 [2024-11-26 23:20:10.290144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.132 [2024-11-26 23:20:10.299744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.132 [2024-11-26 23:20:10.300036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.300164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.300193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.132 [2024-11-26 23:20:10.300210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.132 [2024-11-26 23:20:10.300375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.132 [2024-11-26 23:20:10.300575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.132 [2024-11-26 23:20:10.300600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.132 [2024-11-26 23:20:10.300616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.132 [2024-11-26 23:20:10.303095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.132 [2024-11-26 23:20:10.312462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.132 [2024-11-26 23:20:10.312779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.312919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.132 [2024-11-26 23:20:10.312948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.132 [2024-11-26 23:20:10.312966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.133 [2024-11-26 23:20:10.313150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.133 [2024-11-26 23:20:10.313307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.133 [2024-11-26 23:20:10.313336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.133 [2024-11-26 23:20:10.313353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.133 [2024-11-26 23:20:10.315802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.133 [2024-11-26 23:20:10.325086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.133 [2024-11-26 23:20:10.325328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.325462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.325490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.133 [2024-11-26 23:20:10.325507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.133 [2024-11-26 23:20:10.325665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.133 [2024-11-26 23:20:10.325835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.133 [2024-11-26 23:20:10.325858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.133 [2024-11-26 23:20:10.325875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.133 [2024-11-26 23:20:10.327997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.133 [2024-11-26 23:20:10.337619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.133 [2024-11-26 23:20:10.337897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.337988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.338016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.133 [2024-11-26 23:20:10.338033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.133 [2024-11-26 23:20:10.338162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.133 [2024-11-26 23:20:10.338295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.133 [2024-11-26 23:20:10.338320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.133 [2024-11-26 23:20:10.338359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.133 [2024-11-26 23:20:10.340815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.133 [2024-11-26 23:20:10.350417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.133 [2024-11-26 23:20:10.350711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.350865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.350899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.133 [2024-11-26 23:20:10.350918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.133 [2024-11-26 23:20:10.351084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.133 [2024-11-26 23:20:10.351288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.133 [2024-11-26 23:20:10.351312] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.133 [2024-11-26 23:20:10.351327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.133 [2024-11-26 23:20:10.353702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.133 [2024-11-26 23:20:10.362984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.133 [2024-11-26 23:20:10.363252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.363388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.363424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.133 [2024-11-26 23:20:10.363443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.133 [2024-11-26 23:20:10.363640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.133 [2024-11-26 23:20:10.363828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.133 [2024-11-26 23:20:10.363852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.133 [2024-11-26 23:20:10.363867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.133 [2024-11-26 23:20:10.366295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.133 [2024-11-26 23:20:10.375629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.133 [2024-11-26 23:20:10.375843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.375966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.375995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.133 [2024-11-26 23:20:10.376012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.133 [2024-11-26 23:20:10.376159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.133 [2024-11-26 23:20:10.376387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.133 [2024-11-26 23:20:10.376414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.133 [2024-11-26 23:20:10.376429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.133 [2024-11-26 23:20:10.378835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.133 [2024-11-26 23:20:10.388516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.133 [2024-11-26 23:20:10.388882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.388978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.389008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.133 [2024-11-26 23:20:10.389031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.133 [2024-11-26 23:20:10.389197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.133 [2024-11-26 23:20:10.389384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.133 [2024-11-26 23:20:10.389411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.133 [2024-11-26 23:20:10.389446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.133 [2024-11-26 23:20:10.391856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.133 [2024-11-26 23:20:10.401184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.133 [2024-11-26 23:20:10.401449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.401585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.133 [2024-11-26 23:20:10.401616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.133 [2024-11-26 23:20:10.401634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.133 [2024-11-26 23:20:10.401782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.133 [2024-11-26 23:20:10.401970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.401993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.134 [2024-11-26 23:20:10.402008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.134 [2024-11-26 23:20:10.404398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.134 [2024-11-26 23:20:10.413909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.134 [2024-11-26 23:20:10.414191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.414349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.414377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.134 [2024-11-26 23:20:10.414395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.134 [2024-11-26 23:20:10.414602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.134 [2024-11-26 23:20:10.414810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.414833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.134 [2024-11-26 23:20:10.414848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.134 [2024-11-26 23:20:10.417059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.134 [2024-11-26 23:20:10.426376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.134 [2024-11-26 23:20:10.426614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.426702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.426728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.134 [2024-11-26 23:20:10.426743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.134 [2024-11-26 23:20:10.426865] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.134 [2024-11-26 23:20:10.427003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.427024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.134 [2024-11-26 23:20:10.427037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.134 23:20:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:44.134 23:20:10 -- common/autotest_common.sh@862 -- # return 0 00:27:44.134 [2024-11-26 23:20:10.429014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.134 23:20:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:44.134 23:20:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:44.134 23:20:10 -- common/autotest_common.sh@10 -- # set +x 00:27:44.134 [2024-11-26 23:20:10.438966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.134 [2024-11-26 23:20:10.439302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.439767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.439797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.134 [2024-11-26 23:20:10.439825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.134 [2024-11-26 23:20:10.439956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.134 [2024-11-26 23:20:10.440041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.440076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.134 [2024-11-26 23:20:10.440090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.134 [2024-11-26 23:20:10.442211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.134 23:20:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:44.134 23:20:10 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:44.134 23:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.134 23:20:10 -- common/autotest_common.sh@10 -- # set +x 00:27:44.134 [2024-11-26 23:20:10.451318] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.134 [2024-11-26 23:20:10.451557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.451648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.451673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.134 [2024-11-26 23:20:10.451688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.134 [2024-11-26 23:20:10.451837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.134 [2024-11-26 23:20:10.452051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.452071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.134 [2024-11-26 23:20:10.452084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.134 [2024-11-26 23:20:10.452501] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:44.134 [2024-11-26 23:20:10.454133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.134 23:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.134 23:20:10 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:44.134 23:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.134 23:20:10 -- common/autotest_common.sh@10 -- # set +x 00:27:44.134 [2024-11-26 23:20:10.463784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.134 [2024-11-26 23:20:10.464111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.464231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.464257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.134 [2024-11-26 23:20:10.464273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.134 [2024-11-26 23:20:10.464389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.134 [2024-11-26 23:20:10.464509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.464545] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.134 [2024-11-26 23:20:10.464561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.134 [2024-11-26 23:20:10.466658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.134 [2024-11-26 23:20:10.476312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.134 [2024-11-26 23:20:10.476575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.476697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.476724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.134 [2024-11-26 23:20:10.476740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.134 [2024-11-26 23:20:10.476857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.134 [2024-11-26 23:20:10.477037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.477057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.134 [2024-11-26 23:20:10.477070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.134 [2024-11-26 23:20:10.479204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.134 [2024-11-26 23:20:10.488736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.134 [2024-11-26 23:20:10.489138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.489289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.489315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.134 [2024-11-26 23:20:10.489335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.134 [2024-11-26 23:20:10.489473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.134 [2024-11-26 23:20:10.489655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.489678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.134 [2024-11-26 23:20:10.489695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.134 [2024-11-26 23:20:10.492112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.134 Malloc0 00:27:44.134 23:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.134 23:20:10 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:44.134 23:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.134 23:20:10 -- common/autotest_common.sh@10 -- # set +x 00:27:44.134 [2024-11-26 23:20:10.501207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.134 [2024-11-26 23:20:10.501549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.501686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.134 [2024-11-26 23:20:10.501713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.134 [2024-11-26 23:20:10.501731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.134 [2024-11-26 23:20:10.501902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.134 [2024-11-26 23:20:10.502078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.134 [2024-11-26 23:20:10.502100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.135 [2024-11-26 23:20:10.502116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.135 [2024-11-26 23:20:10.504399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.135 23:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.135 23:20:10 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:44.135 23:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.135 23:20:10 -- common/autotest_common.sh@10 -- # set +x 00:27:44.135 [2024-11-26 23:20:10.513723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.135 [2024-11-26 23:20:10.514034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.135 [2024-11-26 23:20:10.514121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.135 [2024-11-26 23:20:10.514147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x193d160 with addr=10.0.0.2, port=4420 00:27:44.135 [2024-11-26 23:20:10.514163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x193d160 is same with the state(5) to be set 00:27:44.135 [2024-11-26 23:20:10.514312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x193d160 (9): Bad file descriptor 00:27:44.135 [2024-11-26 23:20:10.514463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.135 [2024-11-26 23:20:10.514483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.135 [2024-11-26 23:20:10.514496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.135 23:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.135 23:20:10 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:44.135 23:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.135 23:20:10 -- common/autotest_common.sh@10 -- # set +x 00:27:44.135 [2024-11-26 23:20:10.516472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.135 [2024-11-26 23:20:10.520094] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:44.393 23:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.393 23:20:10 -- host/bdevperf.sh@38 -- # wait 323648 00:27:44.393 [2024-11-26 23:20:10.526287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.393 [2024-11-26 23:20:10.557254] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:52.501 00:27:52.501 Latency(us) 00:27:52.501 [2024-11-26T22:20:18.895Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:52.501 [2024-11-26T22:20:18.895Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:52.501 Verification LBA range: start 0x0 length 0x4000 00:27:52.501 Nvme1n1 : 15.01 9286.05 36.27 15433.65 0.00 5162.72 807.06 20097.71 00:27:52.501 [2024-11-26T22:20:18.895Z] =================================================================================================================== 00:27:52.501 [2024-11-26T22:20:18.895Z] Total : 9286.05 36.27 15433.65 0.00 5162.72 807.06 20097.71 00:27:52.759 23:20:19 -- host/bdevperf.sh@39 -- # sync 00:27:53.016 23:20:19 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:53.016 23:20:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:53.016 23:20:19 -- common/autotest_common.sh@10 -- # set +x 00:27:53.016 23:20:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:53.016 23:20:19 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:53.016 23:20:19 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:53.016 23:20:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:53.016 23:20:19 -- nvmf/common.sh@116 -- # sync 00:27:53.016 23:20:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:53.016 23:20:19 -- nvmf/common.sh@119 -- # set +e 00:27:53.016 23:20:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:53.016 23:20:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:53.016 rmmod nvme_tcp 00:27:53.016 rmmod nvme_fabrics 00:27:53.016 rmmod nvme_keyring 00:27:53.016 23:20:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:53.016 23:20:19 -- nvmf/common.sh@123 -- # set -e 00:27:53.016 23:20:19 -- nvmf/common.sh@124 -- # return 0 00:27:53.016 23:20:19 -- nvmf/common.sh@477 -- # '[' -n 324333 ']' 00:27:53.016 23:20:19 -- nvmf/common.sh@478 -- # killprocess 324333 00:27:53.016 23:20:19 -- common/autotest_common.sh@936 -- # '[' -z 324333 ']' 00:27:53.016 23:20:19 -- common/autotest_common.sh@940 -- # kill -0 324333 00:27:53.016 23:20:19 -- common/autotest_common.sh@941 -- # uname 00:27:53.016 23:20:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:53.016 23:20:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 324333 00:27:53.016 23:20:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:53.016 23:20:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:53.016 23:20:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 324333' 00:27:53.016 killing process with pid 324333 00:27:53.016 23:20:19 -- common/autotest_common.sh@955 -- # kill 324333 00:27:53.016 23:20:19 -- common/autotest_common.sh@960 -- # wait 324333 00:27:53.275 23:20:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:53.275 23:20:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:53.275 23:20:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:53.275 23:20:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:53.275 23:20:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:53.275 23:20:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:53.275 23:20:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:53.275 23:20:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:55.812 23:20:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:55.812 00:27:55.812 real 0m23.342s 00:27:55.812 user 1m2.095s 00:27:55.812 sys 0m4.565s 00:27:55.812 23:20:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:55.812 23:20:21 -- common/autotest_common.sh@10 -- # set +x 00:27:55.812 ************************************ 00:27:55.812 END TEST nvmf_bdevperf 00:27:55.812 ************************************ 00:27:55.812 23:20:21 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:55.812 23:20:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:55.812 23:20:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:55.812 23:20:21 -- common/autotest_common.sh@10 -- # set +x 00:27:55.812 ************************************ 00:27:55.812 START TEST nvmf_target_disconnect 00:27:55.812 ************************************ 00:27:55.812 23:20:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:55.812 * Looking for test storage... 00:27:55.812 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:55.812 23:20:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:55.812 23:20:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:55.812 23:20:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:55.812 23:20:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:55.812 23:20:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:55.812 23:20:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:55.812 23:20:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:55.812 23:20:21 -- scripts/common.sh@335 -- # IFS=.-: 00:27:55.812 23:20:21 -- scripts/common.sh@335 -- # read -ra ver1 00:27:55.812 23:20:21 -- scripts/common.sh@336 -- # IFS=.-: 00:27:55.812 23:20:21 -- scripts/common.sh@336 -- # read -ra ver2 00:27:55.812 23:20:21 -- scripts/common.sh@337 -- # local 'op=<' 00:27:55.812 23:20:21 -- scripts/common.sh@339 -- # ver1_l=2 00:27:55.812 23:20:21 -- scripts/common.sh@340 -- # ver2_l=1 00:27:55.812 23:20:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:55.812 23:20:21 -- scripts/common.sh@343 -- # case "$op" in 00:27:55.812 23:20:21 -- scripts/common.sh@344 -- # : 1 00:27:55.812 23:20:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:55.812 23:20:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:55.812 23:20:21 -- scripts/common.sh@364 -- # decimal 1 00:27:55.812 23:20:21 -- scripts/common.sh@352 -- # local d=1 00:27:55.812 23:20:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:55.812 23:20:21 -- scripts/common.sh@354 -- # echo 1 00:27:55.812 23:20:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:55.812 23:20:21 -- scripts/common.sh@365 -- # decimal 2 00:27:55.812 23:20:21 -- scripts/common.sh@352 -- # local d=2 00:27:55.812 23:20:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:55.812 23:20:21 -- scripts/common.sh@354 -- # echo 2 00:27:55.812 23:20:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:55.812 23:20:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:55.812 23:20:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:55.812 23:20:21 -- scripts/common.sh@367 -- # return 0 00:27:55.812 23:20:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:55.812 23:20:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:55.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:55.812 --rc genhtml_branch_coverage=1 00:27:55.812 --rc genhtml_function_coverage=1 00:27:55.812 --rc genhtml_legend=1 00:27:55.812 --rc geninfo_all_blocks=1 00:27:55.812 --rc geninfo_unexecuted_blocks=1 00:27:55.812 00:27:55.812 ' 00:27:55.812 23:20:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:55.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:55.812 --rc genhtml_branch_coverage=1 00:27:55.812 --rc genhtml_function_coverage=1 00:27:55.812 --rc genhtml_legend=1 00:27:55.812 --rc geninfo_all_blocks=1 00:27:55.812 --rc geninfo_unexecuted_blocks=1 00:27:55.812 00:27:55.812 ' 00:27:55.812 23:20:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:55.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:55.812 --rc genhtml_branch_coverage=1 00:27:55.812 --rc genhtml_function_coverage=1 00:27:55.812 --rc genhtml_legend=1 00:27:55.812 --rc geninfo_all_blocks=1 00:27:55.812 --rc geninfo_unexecuted_blocks=1 00:27:55.812 00:27:55.812 ' 00:27:55.812 23:20:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:55.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:55.812 --rc genhtml_branch_coverage=1 00:27:55.812 --rc genhtml_function_coverage=1 00:27:55.812 --rc genhtml_legend=1 00:27:55.812 --rc geninfo_all_blocks=1 00:27:55.812 --rc geninfo_unexecuted_blocks=1 00:27:55.812 00:27:55.812 ' 00:27:55.812 23:20:21 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:55.812 23:20:21 -- nvmf/common.sh@7 -- # uname -s 00:27:55.812 23:20:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:55.812 23:20:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:55.812 23:20:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:55.812 23:20:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:55.812 23:20:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:55.812 23:20:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:55.812 23:20:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:55.812 23:20:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:55.812 23:20:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:55.812 23:20:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:55.812 23:20:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:55.812 23:20:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:55.812 23:20:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:55.812 23:20:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:55.812 23:20:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:55.812 23:20:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:55.812 23:20:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:55.812 23:20:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:55.812 23:20:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:55.812 23:20:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.813 23:20:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.813 23:20:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.813 23:20:21 -- paths/export.sh@5 -- # export PATH 00:27:55.813 23:20:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.813 23:20:21 -- nvmf/common.sh@46 -- # : 0 00:27:55.813 23:20:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:55.813 23:20:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:55.813 23:20:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:55.813 23:20:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:55.813 23:20:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:55.813 23:20:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:55.813 23:20:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:55.813 23:20:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:55.813 23:20:21 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:55.813 23:20:21 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:55.813 23:20:21 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:55.813 23:20:21 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:55.813 23:20:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:55.813 23:20:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:55.813 23:20:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:55.813 23:20:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:55.813 23:20:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:55.813 23:20:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:55.813 23:20:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:55.813 23:20:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:55.813 23:20:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:55.813 23:20:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:55.813 23:20:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:55.813 23:20:21 -- common/autotest_common.sh@10 -- # set +x 00:27:57.718 23:20:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:57.718 23:20:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:57.718 23:20:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:57.718 23:20:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:57.718 23:20:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:57.718 23:20:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:57.718 23:20:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:57.718 23:20:23 -- nvmf/common.sh@294 -- # net_devs=() 00:27:57.718 23:20:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:57.718 23:20:23 -- nvmf/common.sh@295 -- # e810=() 00:27:57.718 23:20:23 -- nvmf/common.sh@295 -- # local -ga e810 00:27:57.718 23:20:23 -- nvmf/common.sh@296 -- # x722=() 00:27:57.718 23:20:23 -- nvmf/common.sh@296 -- # local -ga x722 00:27:57.718 23:20:23 -- nvmf/common.sh@297 -- # mlx=() 00:27:57.718 23:20:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:57.718 23:20:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:57.718 23:20:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:57.718 23:20:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:57.718 23:20:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:57.718 23:20:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:57.718 23:20:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:57.718 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:57.718 23:20:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:57.718 23:20:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:57.718 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:57.718 23:20:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:57.718 23:20:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:57.718 23:20:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:57.718 23:20:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:57.718 23:20:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:57.718 23:20:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:57.718 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:57.718 23:20:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:57.718 23:20:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:57.718 23:20:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:57.718 23:20:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:57.718 23:20:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:57.718 23:20:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:57.718 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:57.718 23:20:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:57.718 23:20:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:57.718 23:20:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:57.718 23:20:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:57.718 23:20:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:57.718 23:20:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:57.718 23:20:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:57.718 23:20:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:57.718 23:20:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:57.718 23:20:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:57.718 23:20:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:57.718 23:20:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:57.718 23:20:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:57.718 23:20:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:57.718 23:20:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:57.718 23:20:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:57.718 23:20:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:57.718 23:20:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:57.718 23:20:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:57.718 23:20:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:57.718 23:20:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:57.718 23:20:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:57.718 23:20:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:57.718 23:20:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:57.718 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:57.718 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:27:57.718 00:27:57.718 --- 10.0.0.2 ping statistics --- 00:27:57.718 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:57.718 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:27:57.718 23:20:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:57.718 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:57.718 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:27:57.718 00:27:57.718 --- 10.0.0.1 ping statistics --- 00:27:57.718 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:57.718 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:27:57.718 23:20:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:57.718 23:20:23 -- nvmf/common.sh@410 -- # return 0 00:27:57.718 23:20:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:57.718 23:20:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:57.718 23:20:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:57.718 23:20:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:57.719 23:20:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:57.719 23:20:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:57.719 23:20:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:57.719 23:20:23 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:57.719 23:20:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:57.719 23:20:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:57.719 23:20:23 -- common/autotest_common.sh@10 -- # set +x 00:27:57.719 ************************************ 00:27:57.719 START TEST nvmf_target_disconnect_tc1 00:27:57.719 ************************************ 00:27:57.719 23:20:23 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:57.719 23:20:23 -- host/target_disconnect.sh@32 -- # set +e 00:27:57.719 23:20:23 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:57.719 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.719 [2024-11-26 23:20:23.991553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.719 [2024-11-26 23:20:23.991756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.719 [2024-11-26 23:20:23.991792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x889b40 with addr=10.0.0.2, port=4420 00:27:57.719 [2024-11-26 23:20:23.991831] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:57.719 [2024-11-26 23:20:23.991853] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:57.719 [2024-11-26 23:20:23.991868] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:57.719 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:57.719 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:57.719 Initializing NVMe Controllers 00:27:57.719 23:20:23 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:57.719 23:20:23 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:57.719 23:20:23 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:57.719 23:20:23 -- common/autotest_common.sh@1142 -- # return 0 00:27:57.719 23:20:23 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:57.719 23:20:23 -- host/target_disconnect.sh@41 -- # set -e 00:27:57.719 00:27:57.719 real 0m0.087s 00:27:57.719 user 0m0.038s 00:27:57.719 sys 0m0.049s 00:27:57.719 23:20:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:57.719 23:20:24 -- common/autotest_common.sh@10 -- # set +x 00:27:57.719 ************************************ 00:27:57.719 END TEST nvmf_target_disconnect_tc1 00:27:57.719 ************************************ 00:27:57.719 23:20:24 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:57.719 23:20:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:57.719 23:20:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:57.719 23:20:24 -- common/autotest_common.sh@10 -- # set +x 00:27:57.719 ************************************ 00:27:57.719 START TEST nvmf_target_disconnect_tc2 00:27:57.719 ************************************ 00:27:57.719 23:20:24 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:57.719 23:20:24 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:57.719 23:20:24 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:57.719 23:20:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:57.719 23:20:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:57.719 23:20:24 -- common/autotest_common.sh@10 -- # set +x 00:27:57.719 23:20:24 -- nvmf/common.sh@469 -- # nvmfpid=327531 00:27:57.719 23:20:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:57.719 23:20:24 -- nvmf/common.sh@470 -- # waitforlisten 327531 00:27:57.719 23:20:24 -- common/autotest_common.sh@829 -- # '[' -z 327531 ']' 00:27:57.719 23:20:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:57.719 23:20:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:57.719 23:20:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:57.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:57.719 23:20:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:57.719 23:20:24 -- common/autotest_common.sh@10 -- # set +x 00:27:57.719 [2024-11-26 23:20:24.073772] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:57.719 [2024-11-26 23:20:24.073864] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:57.719 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.977 [2024-11-26 23:20:24.159325] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:57.977 [2024-11-26 23:20:24.298116] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:57.978 [2024-11-26 23:20:24.298315] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:57.978 [2024-11-26 23:20:24.298361] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:57.978 [2024-11-26 23:20:24.298386] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:57.978 [2024-11-26 23:20:24.298503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:57.978 [2024-11-26 23:20:24.298568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:57.978 [2024-11-26 23:20:24.298596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:57.978 [2024-11-26 23:20:24.298604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:58.912 23:20:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:58.912 23:20:25 -- common/autotest_common.sh@862 -- # return 0 00:27:58.912 23:20:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:58.912 23:20:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:58.912 23:20:25 -- common/autotest_common.sh@10 -- # set +x 00:27:58.912 23:20:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:58.912 23:20:25 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:58.912 23:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.912 23:20:25 -- common/autotest_common.sh@10 -- # set +x 00:27:58.912 Malloc0 00:27:58.912 23:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.912 23:20:25 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:58.912 23:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.912 23:20:25 -- common/autotest_common.sh@10 -- # set +x 00:27:58.912 [2024-11-26 23:20:25.243674] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:58.912 23:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.912 23:20:25 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:58.912 23:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.912 23:20:25 -- common/autotest_common.sh@10 -- # set +x 00:27:58.912 23:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.912 23:20:25 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:58.912 23:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.912 23:20:25 -- common/autotest_common.sh@10 -- # set +x 00:27:58.912 23:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.912 23:20:25 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:58.912 23:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.912 23:20:25 -- common/autotest_common.sh@10 -- # set +x 00:27:58.912 [2024-11-26 23:20:25.271917] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:58.912 23:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.912 23:20:25 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:58.912 23:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.912 23:20:25 -- common/autotest_common.sh@10 -- # set +x 00:27:58.912 23:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.912 23:20:25 -- host/target_disconnect.sh@50 -- # reconnectpid=327691 00:27:58.912 23:20:25 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:58.912 23:20:25 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:59.170 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.087 23:20:27 -- host/target_disconnect.sh@53 -- # kill -9 327531 00:28:01.087 23:20:27 -- host/target_disconnect.sh@55 -- # sleep 2 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 [2024-11-26 23:20:27.295633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Read completed with error (sct=0, sc=8) 00:28:01.087 starting I/O failed 00:28:01.087 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 [2024-11-26 23:20:27.295958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 [2024-11-26 23:20:27.296283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Write completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 Read completed with error (sct=0, sc=8) 00:28:01.088 starting I/O failed 00:28:01.088 [2024-11-26 23:20:27.296609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.088 [2024-11-26 23:20:27.296729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.296864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.296896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.088 qpair failed and we were unable to recover it. 00:28:01.088 [2024-11-26 23:20:27.297008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.297118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.297143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.088 qpair failed and we were unable to recover it. 00:28:01.088 [2024-11-26 23:20:27.297295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.297422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.297447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.088 qpair failed and we were unable to recover it. 00:28:01.088 [2024-11-26 23:20:27.297550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.297637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.297663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.088 qpair failed and we were unable to recover it. 00:28:01.088 [2024-11-26 23:20:27.297756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.297883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.297911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.088 qpair failed and we were unable to recover it. 00:28:01.088 [2024-11-26 23:20:27.298004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.298093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.088 [2024-11-26 23:20:27.298140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.088 qpair failed and we were unable to recover it. 00:28:01.088 [2024-11-26 23:20:27.298273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.298362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.298390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.298522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.298618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.298643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.298731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.298834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.298859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.298993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.299074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.299099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.299205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.299321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.299346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.299435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.299582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.299609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.299707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.299800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.299836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.299934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.300088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.300113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.300233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.300387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.300431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.300546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.300633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.300659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.300750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.300862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.300887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.300980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.301230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.301454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.301671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.301904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.301996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.302021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.302130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.302215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.302258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.302377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.302541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.302584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.302671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.302755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.302780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.302894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.303010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.303051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.303200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.303378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.303403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.303549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.303656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.303681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.303768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.303890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.303915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.304030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.304145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.304170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.304268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.304348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.304373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.304458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.304570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.304597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.304685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.304769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.304794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.089 qpair failed and we were unable to recover it. 00:28:01.089 [2024-11-26 23:20:27.304915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.089 [2024-11-26 23:20:27.305022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.305048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.305161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.305259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.305287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.305434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.305517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.305554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.305645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.305735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.305761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.305844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.305978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.306116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.306350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.306581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.306801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.306940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.307039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.307126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.307155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.307257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.307382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.307410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.307546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.307641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.307666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.307759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.307899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.307925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.308033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.308116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.308141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.308256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.308361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.308387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.308503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.308598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.308625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.308712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.308849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.308879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.309044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.309126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.309152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.309289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.309367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.309392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.309473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.309568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.309598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.309712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.309859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.309884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.310024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.310149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.310190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.310273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.310406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.310447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.310622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.310713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.310738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.310856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.310995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.311020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.311122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.311217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.311245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.090 qpair failed and we were unable to recover it. 00:28:01.090 [2024-11-26 23:20:27.311355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.090 [2024-11-26 23:20:27.311460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.311485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.311644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.311756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.311781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.311892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.311970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.312010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.312104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.312277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.312311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.312454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.312569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.312595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.312729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.312801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.312826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.312908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.313143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.313366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.313604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.313824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.313955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.314094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.314188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.314213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.314322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.314427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.314457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.314597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.314686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.314716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.314833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.314974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.315128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.315357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.315663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.315882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.315982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.316090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.316228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.316254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.316330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.316445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.316471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.316569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.316644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.316670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.316788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.316900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.316925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.317012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.317148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.317174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.317295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.317404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.317429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.317516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.317628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.317653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.317789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.317866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.317891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.317968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.318105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.318130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.091 qpair failed and we were unable to recover it. 00:28:01.091 [2024-11-26 23:20:27.318214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.091 [2024-11-26 23:20:27.318319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.318344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.318420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.318507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.318543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.318685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.318798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.318823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.318937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.319045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.319070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.319177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.319266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.319290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.319402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.319516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.319568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.319686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.319801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.319827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.319913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.320157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.320411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.320665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.320881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.320998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.321109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.321298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.321603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.321857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.321966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.322080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.322218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.322243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.322353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.322529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.322554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.322670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.322782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.322808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.092 [2024-11-26 23:20:27.322887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.322991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.092 [2024-11-26 23:20:27.323016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.092 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.323130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.323209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.323233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.323371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.323477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.323501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.323642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.323757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.323783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.323900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.324026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.324055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.324188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.324303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.324330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.324415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.324534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.324560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.324681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.324829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.324854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.324993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.325104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.325129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.325216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.325324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.325349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.325465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.325559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.325584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.325667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.325779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.325804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.325943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.326078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.326103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.326222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.326341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.326367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.326479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.326600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.326645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.326757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.326875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.326899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.327004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.327140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.327164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.327275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.327389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.327413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.327518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.327610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.327634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.327752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.327868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.327893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.328047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.328166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.328193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.328293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.328430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.328455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.328564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.328677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.328702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.328844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.328961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.328986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.329126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.329207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.329232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.329317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.329426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.329452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.329538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.329627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.329653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.329767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.329852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.329878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.329990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.330098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.330123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.093 qpair failed and we were unable to recover it. 00:28:01.093 [2024-11-26 23:20:27.330206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.093 [2024-11-26 23:20:27.330293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.330318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.330429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.330539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.330565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.330674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.330813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.330837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.330928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.331187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.331383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.331611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.331878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.331991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.332115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.332340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.332595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.332840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.332975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.333067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.333147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.333172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.333313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.333399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.333424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.333559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.333645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.333669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.333780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.333863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.333888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.334000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.334087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.334113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.334230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.334360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.334389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.334522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.334645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.334670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.334780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.334889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.334914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.334989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.335073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.335099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.335186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.335302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.335327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.335443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.335550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.335577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.335714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.335800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.335825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.335902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.336037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.336062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.094 qpair failed and we were unable to recover it. 00:28:01.094 [2024-11-26 23:20:27.336175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.094 [2024-11-26 23:20:27.336287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.336311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.336419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.336504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.336554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.336726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.336845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.336870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.336986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.337072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.337097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.337236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.337356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.337397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.337547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.337659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.337686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.337766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.337877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.337903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.338023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.338133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.338158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.338296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.338408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.338432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.338520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.338666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.338692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.338807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.338891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.338915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.339028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.339108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.339133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.339223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.339306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.339331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.339472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.339558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.339583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.339695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.339784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.339808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.339916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.340135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.340353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.340577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.340774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.340915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.341055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.341191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.341216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.341369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.341504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.341537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.341698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.341784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.341808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.341923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.342008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.342033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.342149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.342317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.342342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.342431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.342514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.342544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.342697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.342792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.342818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.342949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.343031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.343056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.343132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.343266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.095 [2024-11-26 23:20:27.343291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.095 qpair failed and we were unable to recover it. 00:28:01.095 [2024-11-26 23:20:27.343375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.343460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.343485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.343596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.343714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.343738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.343864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.343993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.344106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.344358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.344645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.344857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.344987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.345101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.345199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.345223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.345335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.345447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.345472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.345558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.345670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.345695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.345808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.345948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.345973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.346088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.346210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.346252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.346340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.346450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.346491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.346634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.346721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.346747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.346857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.346995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.347025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.347130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.347273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.347298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.347444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.347554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.347580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.347689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.347775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.347800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.347910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.348134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.348329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.348522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.348742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.348907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.348995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.349116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.349143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.349311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.349440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.349471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.349584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.349692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.349716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.349801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.349941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.349966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.350048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.350159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.350185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.096 [2024-11-26 23:20:27.350296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.350401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.096 [2024-11-26 23:20:27.350427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.096 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.350533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.350615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.350639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.350779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.350890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.350915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.351025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.351162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.351187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.351268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.351350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.351375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.351464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.351551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.351577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.351691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.351798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.351827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.351920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.352163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.352388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.352650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.352869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.352981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.353064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.353148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.353173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.353258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.353416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.353456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.353547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.353659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.353685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.353827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.353911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.353935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.354039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.354123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.354154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.354273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.354409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.354437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.354568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.354718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.354743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.354847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.355025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.355050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.355166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.355303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.355330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.355460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.355610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.355637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.355728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.355814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.355838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.355922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.356017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.356042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.097 qpair failed and we were unable to recover it. 00:28:01.097 [2024-11-26 23:20:27.356144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.356220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.097 [2024-11-26 23:20:27.356245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.356363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.356475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.356500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.356638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.356751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.356777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.356891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.357135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.357385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.357639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.357848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.357959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.358048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.358163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.358188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.358295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.358376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.358400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.358480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.358642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.358685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.358799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.358935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.358960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.359072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.359153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.359177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.359285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.359372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.359398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.359499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.359665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.359692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.359806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.359895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.359920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.360002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.360111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.360135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.360252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.360368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.360393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.360483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.360598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.360623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.360706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.360795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.360820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.360936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.361072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.361096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.361234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.361385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.361409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.361551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.361672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.361698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.361780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.361866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.361891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.362003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.362139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.362164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.362307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.362422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.362447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.362594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.362704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.362730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.362811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.362927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.362951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.363042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.363125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.098 [2024-11-26 23:20:27.363151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.098 qpair failed and we were unable to recover it. 00:28:01.098 [2024-11-26 23:20:27.363289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.363409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.363435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.363551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.363632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.363657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.363766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.363900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.363927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.364050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.364177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.364216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.364357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.364469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.364493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.364617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.364731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.364757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.364861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.364969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.364993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.365100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.365211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.365235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.365352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.365480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.365508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.365639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.365724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.365748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.365893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.365976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.366001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.366082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.366190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.366216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.366335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.366483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.366509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.366601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.366740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.366765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.366857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.366980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.367008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.367152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.367299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.367339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.367454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.367544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.367571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.367650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.367791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.367816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.367930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.368132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.368357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.368558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.368805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.368919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.369031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.369230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.369485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.369680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.369897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.369998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.099 qpair failed and we were unable to recover it. 00:28:01.099 [2024-11-26 23:20:27.370109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.370224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.099 [2024-11-26 23:20:27.370249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.370359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.370476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.370503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.370646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.370767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.370792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.370873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.370983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.371008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.371093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.371229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.371254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.371368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.371478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.371503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.371640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.371787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.371817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.371922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.372098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.372142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.372248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.372367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.372392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.372476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.372561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.372589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.372701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.372843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.372869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.373008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.373120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.373145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.373226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.373339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.373366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.373512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.373623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.373652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.373829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.374022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.374047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.374187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.374282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.374307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.374424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.374511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.374542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.374682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.374799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.374827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.374924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.375174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.375431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.375658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.375856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.375996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.376079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.376154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.376179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.376295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.376409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.376435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.376542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.376628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.376653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.376760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.376857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.376883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.376972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.377057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.377083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.377203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.377316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.100 [2024-11-26 23:20:27.377342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.100 qpair failed and we were unable to recover it. 00:28:01.100 [2024-11-26 23:20:27.377419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.377532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.377559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.377700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.377786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.377812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.377932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.378179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.378401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.378635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.378879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.378986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.379090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.379210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.379236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.379355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.379469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.379496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.379594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.379686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.379711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.379819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.379896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.379921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.380034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.380112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.380137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.380255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.380366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.380391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.380506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.380623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.380649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.380764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.380889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.380914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.380998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.381104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.381129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.381237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.381347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.381373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.381459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.381573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.381599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.381680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.381789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.381814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.381953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.382216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.382439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.382670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.382854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.382986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.383102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.383194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.383219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.101 qpair failed and we were unable to recover it. 00:28:01.101 [2024-11-26 23:20:27.383329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.101 [2024-11-26 23:20:27.383471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.383497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.383591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.383697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.383723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.383836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.383945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.383974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.384082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.384171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.384196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.384274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.384385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.384410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.384530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.384609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.384635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.384718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.384856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.384881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.384998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.385088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.385114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.385226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.385365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.385391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.385502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.385620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.385645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.385735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.385810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.385835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.385953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.386092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.386116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.386224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.386298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.386327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.386439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.386534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.386570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.386688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.386832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.386858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.386941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.387060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.387086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.387166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.387286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.387311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.387420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.387501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.387542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.387628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.387712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.387738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.387892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.388006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.388031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.388121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.388257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.388283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.388421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.388515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.388547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.388633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.388742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.388772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.388914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.389158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.389374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.389585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.389806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.389907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.102 [2024-11-26 23:20:27.389990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.390097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.102 [2024-11-26 23:20:27.390123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.102 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.390205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.390317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.390342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.390455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.390548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.390575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.390658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.390772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.390798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.390911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.391165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.391379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.391633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.391882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.391993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.392019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.392129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.392251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.392276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.392391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.392537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.392563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.392700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.392819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.392845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.392934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.393138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.393386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.393655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.393855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.393989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.394069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.394180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.394206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.394326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.394429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.394454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.394591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.394737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.394762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.394850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.394934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.394959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.395069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.395184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.395209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.395291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.395432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.395457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.395546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.395631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.395656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.395761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.395882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.395907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.396024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.396100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.396125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.396265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.396358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.396383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.396523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.396610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.396635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.396747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.396852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.396877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.103 qpair failed and we were unable to recover it. 00:28:01.103 [2024-11-26 23:20:27.396987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.103 [2024-11-26 23:20:27.397070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.397095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.397208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.397343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.397368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.397519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.397633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.397659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.397744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.397832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.397858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.397948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.398087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.398112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.398196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.398307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.398332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.398441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.398557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.398583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.398674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.398813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.398838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.398944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.399048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.399073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.399184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.399296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.399321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.399429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.399544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.399571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.399714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.399801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.399827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.399942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.400190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.400412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.400641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.400863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.400975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.401086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.401298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.401548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.401824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.401957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.402041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.402159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.402185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.402301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.402381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.402406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.402555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.402661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.402686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.402800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.402882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.402907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.402996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.403103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.403129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.403251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.403363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.403390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.403501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.403638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.403665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.104 qpair failed and we were unable to recover it. 00:28:01.104 [2024-11-26 23:20:27.403775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.403865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.104 [2024-11-26 23:20:27.403891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.404005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.404111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.404136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.404220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.404362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.404387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.404507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.404606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.404631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.404708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.404822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.404848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.404986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.405090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.405115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.405231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.405353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.405378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.405466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.405588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.405613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.405729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.405809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.405834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.405922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.406164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.406408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.406656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.406867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.406982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.407096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.407204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.407229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.407313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.407389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.407414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.407493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.407576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.407603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.407721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.407840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.407866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.407980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.408201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.408412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.408659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.408882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.408995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.409020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.409130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.409241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.409267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.409385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.409517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.409547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.409629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.409746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.409771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.409880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.409994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.410019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.410126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.410242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.410267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.410366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.410501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.105 [2024-11-26 23:20:27.410548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.105 qpair failed and we were unable to recover it. 00:28:01.105 [2024-11-26 23:20:27.410670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.410762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.410789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.410909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.411020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.411045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.411133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.411243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.411267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.411386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.411536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.411562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.411701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.411830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.411858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.411983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.412106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.412134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.412274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.412391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.412416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.412534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.412726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.412751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.412868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.412988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.413015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.413184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.413274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.413301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.413433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.413536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.413579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.413693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.413776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.413802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.413940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.414067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.414095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.414257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.414385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.414410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.414542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.414629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.414655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.414768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.414878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.414903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.415012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.415122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.415147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.415258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.415405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.415431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.415546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.415625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.415650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.415740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.415938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.415964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.416081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.416205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.416232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.416347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.416470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.416498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.416629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.416743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.416784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.416901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.417021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.417050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.106 qpair failed and we were unable to recover it. 00:28:01.106 [2024-11-26 23:20:27.417211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.417320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.106 [2024-11-26 23:20:27.417346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.417479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.417609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.417634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.417783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.417887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.417911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.418101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.418245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.418270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.418360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.418444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.418469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.418593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.418703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.418732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.418852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.418989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.419014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.419130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.419213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.419239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.419331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.419441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.419467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.419556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.419687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.419715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.419864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.420020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.420046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.420127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.420267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.420293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.420404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.420547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.420573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.420700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.420828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.420854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.420968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.421112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.421137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.421251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.421357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.421383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.421496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.421618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.421644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.421757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.421836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.421862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.422000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.422244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.422428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.422679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.422897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.422979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.423117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.423311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.423562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.423815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.423912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.424053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.424141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.424166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.424251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.424359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.107 [2024-11-26 23:20:27.424384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.107 qpair failed and we were unable to recover it. 00:28:01.107 [2024-11-26 23:20:27.424473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.424587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.424613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.424706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.424823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.424848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.424958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.425035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.425060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.425201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.425287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.425314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.425422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.425541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.425566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.425674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.425753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.425779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.425892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.426117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.426366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.426588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.426775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.426903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.427042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.427186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.427211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.427298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.427374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.427399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.427481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.427591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.427617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.427709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.427793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.427818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.427898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.428013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.428038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.428148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.428260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.428290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.428403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.428544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.428570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.428710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.428822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.428847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.428955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.429066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.429092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.429168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.429280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.429306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.429410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.429515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.429546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.429656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.429772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.429797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.429884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.430160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.430385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.430618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.430880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.430990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.431015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.108 qpair failed and we were unable to recover it. 00:28:01.108 [2024-11-26 23:20:27.431094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.431179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.108 [2024-11-26 23:20:27.431204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.431322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.431428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.431454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.431569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.431659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.431684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.431761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.431878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.431903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.432019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.432127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.432152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.432236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.432319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.432344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.432421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.432570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.432596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.432737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.432845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.432870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.432953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.433066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.433091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.433206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.433325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.433350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.433461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.433585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.433612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.433698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.433828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.433869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.433946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.434172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.434417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.434621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.434871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.434984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.435136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.435388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.435606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.435811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.435919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.436034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.436142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.436167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.436286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.436367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.436393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.436500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.436618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.436644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.436758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.436836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.436861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.436972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.437132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.437159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.437291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.437411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.437438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.437571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.437650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.437675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.437790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.437905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.109 [2024-11-26 23:20:27.437930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.109 qpair failed and we were unable to recover it. 00:28:01.109 [2024-11-26 23:20:27.438128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.438252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.438281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.438384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.438505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.438539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.438747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.438876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.438905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.439038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.439185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.439211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.439350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.439456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.439484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.439602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.439743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.439768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.439868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.440016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.440044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.440177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.440312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.440338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.440453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.440535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.440560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.440700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.440815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.440841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.440972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.441074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.441101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.441248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.441422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.441447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.441535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.441612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.441637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.441722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.441835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.441861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.441984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.442102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.442131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.442229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.442322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.442350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.442499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.442667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.442693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.442803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.442883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.442908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.443022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.443162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.443187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.443317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.443402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.443431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.443567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.443697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.443722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.443828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.443941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.443968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.444055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.444161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.444186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.444314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.444450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.444474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.444604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.444711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.444736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.444881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.445020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.445045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.445129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.445212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.445236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.445328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.445406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.445432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.110 [2024-11-26 23:20:27.445536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.445687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.110 [2024-11-26 23:20:27.445727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.110 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.445849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.445959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.445985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.446117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.446203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.446228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.446332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.446444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.446486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.446624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.446735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.446776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.446901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.446988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.447017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.447182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.447265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.447290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.447374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.447480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.447504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.447617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.447750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.447779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.447902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.448164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.448383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.448588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.448853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.448955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.449094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.449180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.449205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.449332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.449414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.449439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.449549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.449626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.449652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.449765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.449873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.449899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.450007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.450089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.450114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.450199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.450323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.450364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.450477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.450599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.450628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.450781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.450899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.450924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.451063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.451152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.451177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.451293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.451380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.451405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.451552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.451682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.451710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.451837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.451926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.451955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.111 qpair failed and we were unable to recover it. 00:28:01.111 [2024-11-26 23:20:27.452082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.111 [2024-11-26 23:20:27.452177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.452202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.452340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.452500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.452533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.452627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.452772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.452797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.452918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.453171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.453392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.453681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.453912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.453994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.454019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.454124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.454240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.454265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.454403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.454489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.454538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.454642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.454753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.454778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.454886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.455016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.455044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.455145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.455228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.455254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.455349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.455516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.455549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.455679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.455832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.455859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.455953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.456049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.456077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.456182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.456377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.456402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.456480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.456570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.456597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.456716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.456883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.456908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.456994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.457099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.457123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.457198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.457312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.457337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.457418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.457554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.457581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.457664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.457778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.457803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.457962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.458081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.458110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.458218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.458324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.458349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.458433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.458563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.458592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.458716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.458838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.458866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.458982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.459076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.459105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.112 qpair failed and we were unable to recover it. 00:28:01.112 [2024-11-26 23:20:27.459211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.112 [2024-11-26 23:20:27.459297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.459323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.459408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.459516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.459552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.459673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.459799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.459824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.459938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.460126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.460317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.460609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.460819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.460926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.461039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.461119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.461148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.461263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.461351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.461376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.461459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.461554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.461580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.461696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.461793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.461821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.461950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.462030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.462055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.462136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.462242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.462269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.462355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.462474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.462517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.462636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.462786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.462813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.462958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.463041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.463067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.463203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.463338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.463363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.463443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.463566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.463600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.463701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.463824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.463853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.464000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.464109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.464135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.464260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.464352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.113 [2024-11-26 23:20:27.464379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.113 qpair failed and we were unable to recover it. 00:28:01.113 [2024-11-26 23:20:27.464538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.464654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.464679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.439 qpair failed and we were unable to recover it. 00:28:01.439 [2024-11-26 23:20:27.464790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.464888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.464912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.439 qpair failed and we were unable to recover it. 00:28:01.439 [2024-11-26 23:20:27.465008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.465138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.465164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.439 qpair failed and we were unable to recover it. 00:28:01.439 [2024-11-26 23:20:27.465285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.465429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.465456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.439 qpair failed and we were unable to recover it. 00:28:01.439 [2024-11-26 23:20:27.465563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.465681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.439 [2024-11-26 23:20:27.465706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.439 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.465831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.465929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.465953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.466040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.466145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.466176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.466271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.466354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.466379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.466480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.466591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.466623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.466709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.466798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.466841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.466952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.467059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.467085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.467174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.467279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.467304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.467413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.467546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.467587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.467670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.467755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.467782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.467941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.468062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.468087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.468191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.468288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.468323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.468447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.468562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.468593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.468679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.468801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.468830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.468962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.469065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.469096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.469211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.469308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.469341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.469477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.469632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.469669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.469799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.469967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.470002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.470161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.470291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.470327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.470463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.470612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.470649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.470803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.470925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.440 [2024-11-26 23:20:27.470956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.440 qpair failed and we were unable to recover it. 00:28:01.440 [2024-11-26 23:20:27.471098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.471244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.471280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.471468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.471630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.471662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.471799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.471960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.472109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.472357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.472621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.472838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.472967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.473063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.473193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.473218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.473330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.473404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.473429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.473546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.473659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.473684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.473796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.473897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.473924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.474012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.474161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.474189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.474292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.474424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.474449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.474567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.474654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.474678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.474786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.474902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.474926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.475069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.475195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.475222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.475307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.475426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.475454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.475576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.475694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.475719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.475834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.475911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.475935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.476045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.476206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.476231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.476338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.476477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.476501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.476601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.476683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.476708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.441 qpair failed and we were unable to recover it. 00:28:01.441 [2024-11-26 23:20:27.476809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.476927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.441 [2024-11-26 23:20:27.476967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.477052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.477122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.477145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.477252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.477358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.477382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.477483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.477605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.477630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.477768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.477844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.477868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.477972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.478125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.478152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.478275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.478391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.478418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.478573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.478655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.478679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.478757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.478886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.478913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.479009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.479096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.479125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.479280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.479417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.479445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.479577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.479721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.479745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.479845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.479964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.479992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.480142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.480293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.480320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.480452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.480564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.480605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.480686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.480797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.480820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.480923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.481029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.481054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.481200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.481355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.481380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.481514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.481650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.481674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.481810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.481946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.481970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.482080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.482202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.442 [2024-11-26 23:20:27.482234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.442 qpair failed and we were unable to recover it. 00:28:01.442 [2024-11-26 23:20:27.482355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.482439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.482466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.482587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.482668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.482693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.482784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.482872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.482896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.483033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.483199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.483224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.483364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.483469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.483496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.483646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.483736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.483761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.483851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.483930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.483954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.484087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.484173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.484215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.484339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.484470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.484493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.484607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.484747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.484775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.484915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.485132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.485351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.485598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.485823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.485932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.486017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.486179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.486206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.486329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.486433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.486458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.486569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.486683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.486707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.486787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.486895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.486921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.487056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.487175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.487217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.487329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.487437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.487479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.443 qpair failed and we were unable to recover it. 00:28:01.443 [2024-11-26 23:20:27.487588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.487692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.443 [2024-11-26 23:20:27.487716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.487802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.487882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.487906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.488021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.488130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.488154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.488285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.488408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.488435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.488556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.488677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.488703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.488838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.488952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.488975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.489110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.489197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.489223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.489346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.489442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.489469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.489588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.489679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.489720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.489836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.489950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.489974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.490083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.490170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.490196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.490318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.490450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.490473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.490579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.490707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.490733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.490870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.490960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.490984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.491096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.491209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.491233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.491393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.491512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.491544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.491665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.491758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.491786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.491895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.491974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.491998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.492116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.492274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.492300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.492397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.492492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.492519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.492655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.492768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.492792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.492905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.493008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.493032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.444 qpair failed and we were unable to recover it. 00:28:01.444 [2024-11-26 23:20:27.493157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.444 [2024-11-26 23:20:27.493250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.493277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.493413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.493499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.493529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.493673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.493797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.493840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.493980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.494087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.494111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.494214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.494306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.494332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.494454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.494599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.494624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.494702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.494826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.494849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.494959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.495071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.495095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.495232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.495332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.495359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.495474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.495625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.495650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.495788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.495890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.495917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.496026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.496132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.496157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.496291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.496377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.496418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.496530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.496610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.496635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.496715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.496826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.496851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.497002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.497085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.497109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.497219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.497383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.497408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.445 qpair failed and we were unable to recover it. 00:28:01.445 [2024-11-26 23:20:27.497531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.497613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.445 [2024-11-26 23:20:27.497641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.497735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.497868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.497909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.498049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.498156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.498179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.498287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.498365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.498389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.498569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.498657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.498681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.498773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.498891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.498915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.499067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.499177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.499201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.499338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.499472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.499500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.499624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.499763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.499788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.499924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.500076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.500103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.500237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.500342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.500365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.500484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.500577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.500602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.500725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.500842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.500868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.501018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.501112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.501136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.501222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.501336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.501361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.501449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.501562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.501587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.501737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.501843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.501867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.501961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.502071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.502113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.502213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.502345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.502370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.502499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.502653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.502681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.502809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.502933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.502959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.446 qpair failed and we were unable to recover it. 00:28:01.446 [2024-11-26 23:20:27.503043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.446 [2024-11-26 23:20:27.503175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.503198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.503328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.503451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.503477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.503613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.503694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.503718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.503813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.503962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.503989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.504087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.504218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.504241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.504355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.504436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.504460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.504544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.504682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.504709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.504793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.504963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.504987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.505100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.505257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.505283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.505413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.505500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.505529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.505666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.505753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.505780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.505903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.506037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.506061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.506205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.506301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.506328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.506438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.506550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.506575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.506706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.506784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.506811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.506933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.507052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.507079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.507214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.507348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.507373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.507448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.507533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.507558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.507669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.507754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.507778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.507869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.508052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.508076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.508202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.508316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.508340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.447 qpair failed and we were unable to recover it. 00:28:01.447 [2024-11-26 23:20:27.508450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.508545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.447 [2024-11-26 23:20:27.508570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.508701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.508813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.508837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.508948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.509084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.509124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.509300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.509404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.509430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.509521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.509681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.509707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.509818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.509899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.509939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.510069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.510196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.510222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.510346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.510463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.510489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.510609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.510697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.510721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.510831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.510917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.510965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.511056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.511175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.511202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.511356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.511448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.511474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.511579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.511697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.511722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.511800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.511914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.511939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.512023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.512153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.512182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.512314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.512392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.512415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.512539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.512629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.512653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.512765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.512930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.512954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.513069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.513192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.513219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.513344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.513434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.513460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.513570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.513679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.513703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.513833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.513912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.513938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.514062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.514144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.448 [2024-11-26 23:20:27.514170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.448 qpair failed and we were unable to recover it. 00:28:01.448 [2024-11-26 23:20:27.514268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.514348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.514376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.514479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.514573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.514599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.514757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.514876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.514903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.515054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.515210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.515235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.515351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.515476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.515503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.515682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.515839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.515868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.516004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.516105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.516132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.516229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.516315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.516342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.516458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.516572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.516598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.516714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.516797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.516823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.516941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.517136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.517334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.517567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.517818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.517912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.518020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.518169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.518194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.518306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.518382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.518406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.518495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.518630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.518658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.518786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.518879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.518906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.519028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.519176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.519203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.519341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.519432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.519459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.449 [2024-11-26 23:20:27.519574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.519683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.449 [2024-11-26 23:20:27.519710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.449 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.519811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.519899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.519926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.520009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.520134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.520161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.520252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.520340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.520365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.520457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.520537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.520562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.520717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.520810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.520837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.520960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.521048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.521076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.521197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.521312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.521340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.521470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.521591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.521617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.521705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.521786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.521809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.521914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.522048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.522074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.522189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.522307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.522334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.522494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.522639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.522663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.522746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.522899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.522926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.523010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.523114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.523138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.523255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.523378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.523405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.523544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.523657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.523682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.523798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.523884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.523910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.524004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.524116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.524143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.524268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.524437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.524461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.524557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.524667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.524692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.524773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.524876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.524899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.450 qpair failed and we were unable to recover it. 00:28:01.450 [2024-11-26 23:20:27.525014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.450 [2024-11-26 23:20:27.525116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.525143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.525233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.525381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.525407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.525491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.525621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.525645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.525734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.525824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.525848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.525935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.526074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.526102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.526216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.526325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.526349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.526464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.526541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.526567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.526652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.526808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.526835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.526984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.527072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.527099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.527220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.527303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.527329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.527454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.527566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.527591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.527719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.527803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.527830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.527979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.528191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.528450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.528679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.528907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.528998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.529116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.529391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.529642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.451 qpair failed and we were unable to recover it. 00:28:01.451 [2024-11-26 23:20:27.529853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.451 [2024-11-26 23:20:27.529984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.530064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.530172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.530196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.530310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.530393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.530417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.530506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.530664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.530688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.530799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.530926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.530952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.531082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.531172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.531215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.531326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.531437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.531461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.531553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.531645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.531669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.531783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.531901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.531927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.532079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.532174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.532214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.532314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.532464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.532491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.532624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.532735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.532760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.532866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.532991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.533019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.533145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.533263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.533290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.533420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.533530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.533556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.533673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.533793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.533821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.533919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.534010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.534037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.534163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.534258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.534285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.534420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.534537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.534563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.534695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.534819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.534860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.534942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.535055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.535079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.452 qpair failed and we were unable to recover it. 00:28:01.452 [2024-11-26 23:20:27.535218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.452 [2024-11-26 23:20:27.535302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.535344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.535485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.535626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.535651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.535785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.535913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.535940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.536056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.536158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.536182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.536264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.536378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.536402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.536548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.536632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.536656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.536787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.536876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.536902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.537057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.537139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.537163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.537269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.537419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.537443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.537581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.537687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.537711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.537818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.537909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.537935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.538085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.538182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.538205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.538360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.538481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.538507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.538632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.538723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.538747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.538857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.538960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.538988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.539075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.539155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.539179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.539284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.539394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.539418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.539505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.539611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.539636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.539744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.539854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.539895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.540042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.540160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.540186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.540272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.540403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.540427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.453 qpair failed and we were unable to recover it. 00:28:01.453 [2024-11-26 23:20:27.540513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.453 [2024-11-26 23:20:27.540638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.540661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.540748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.540880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.540907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.541055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.541181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.541208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.541336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.541459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.541486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.541630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.541718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.541742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.541860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.542023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.542051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.542134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.542278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.542304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.542421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.542511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.542544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.542679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.542790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.542813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.542930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.543202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.543443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.543679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.543916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.543991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.544015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.544128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.544231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.544257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.544378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.544462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.544489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.544650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.544769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.544793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.544961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.545072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.545096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.545208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.545281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.545305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.545386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.545528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.545552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.545702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.545785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.545811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.545905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.546011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.546036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.546110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.546267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.546295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.454 qpair failed and we were unable to recover it. 00:28:01.454 [2024-11-26 23:20:27.546384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.454 [2024-11-26 23:20:27.546497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.546529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.546636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.546721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.546747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.546847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.546985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.547093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.547326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.547627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.547824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.547929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.548056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.548189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.548213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.548335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.548406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.548430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.548572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.548675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.548699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.548854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.548968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.548992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.549106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.549228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.549255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.549344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.549426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.549452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.549613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.549697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.549721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.549846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.549966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.549993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.550105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.550194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.550220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.550342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.550427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.550454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.550571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.550682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.550706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.550844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.550975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.551002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.551124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.551272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.551299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.551397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.551517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.551548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.551652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.551740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.455 [2024-11-26 23:20:27.551771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.455 qpair failed and we were unable to recover it. 00:28:01.455 [2024-11-26 23:20:27.551849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.551990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.552015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.552142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.552237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.552266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.552363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.552481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.552510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.552631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.552747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.552772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.552889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.552998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.553022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.553191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.553278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.553302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.553442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.553553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.553580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.553706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.553816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.553840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.553920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.554026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.554051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.554180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.554318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.554347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.554481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.554580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.554607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.554743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.554824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.554850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.554956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.555157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.555342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.555577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.555796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.555915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.556030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.556190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.556215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.556297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.556431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.556458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.556584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.556660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.556684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.556794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.556905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.556929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.557013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.557099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.557123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.456 qpair failed and we were unable to recover it. 00:28:01.456 [2024-11-26 23:20:27.557201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.557353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.456 [2024-11-26 23:20:27.557381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.557530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.557623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.557648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.557781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.557877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.557905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.558019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.558105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.558132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.558272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.558363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.558390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.558540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.558651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.558675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.558773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.558851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.558876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.558977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.559104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.559131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.559240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.559354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.559378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.559537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.559645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.559670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.559772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.559900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.559925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.560019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.560148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.560175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.560308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.560445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.560470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.560564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.560650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.560674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.560756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.560855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.560883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.561002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.561085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.561113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.561276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.561355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.561381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.561462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.561570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.561595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.561729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.561869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.561895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.562056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.562179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.457 [2024-11-26 23:20:27.562204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.457 qpair failed and we were unable to recover it. 00:28:01.457 [2024-11-26 23:20:27.562296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.562427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.562455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.562592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.562685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.562710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.562814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.562928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.562956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.563061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.563175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.563202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.563320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.563399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.563425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.563549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.563687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.563713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.563825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.563935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.563965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.564088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.564175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.564203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.564301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.564434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.564459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.564547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.564663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.564687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.564786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.564921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.564948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.565034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.565156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.565199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.565279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.565392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.565417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.565582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.565697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.565721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.565815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.565923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.565947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.566063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.566151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.566178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.566273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.566421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.566445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.566563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.566705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.566729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.566828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.566924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.566955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.567053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.567176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.567203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.567352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.567450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.567476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.458 [2024-11-26 23:20:27.567613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.567703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.458 [2024-11-26 23:20:27.567728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.458 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.567804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.567880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.567904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.568034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.568129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.568153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.568268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.568403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.568429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.568562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.568675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.568699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.568827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.568976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.569001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.569101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.569232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.569260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.569379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.569465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.569492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.569660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.569772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.569797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.569957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.570060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.570085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.570182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.570267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.570294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.570408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.570543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.570586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.570666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.570757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.570781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.570876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.571141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.571355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.571652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.571875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.571980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.572081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.572202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.572228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.572328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.572472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.572513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.572611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.572721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.572746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.572842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.572936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.572959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.459 [2024-11-26 23:20:27.573037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.573183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.459 [2024-11-26 23:20:27.573207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.459 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.573300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.573408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.573434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.573565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.573647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.573671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.573755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.573932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.573956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.574038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.574144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.574167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.574274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.574387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.574411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.574533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.574613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.574640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.574735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.574836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.574877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.575021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.575135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.575175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.575269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.575358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.575386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.575516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.575634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.575659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.575747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.575855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.575880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.575958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.576090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.576118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.576237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.576355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.576382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.576478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.576568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.576593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.576683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.576821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.576845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.576930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.577087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.577114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.577231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.577361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.577388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.577521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.577642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.577666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.577766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.577860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.577886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.578012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.578118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.578142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.578218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.578298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.578322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.578431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.578539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.460 [2024-11-26 23:20:27.578564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.460 qpair failed and we were unable to recover it. 00:28:01.460 [2024-11-26 23:20:27.578646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.578731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.578757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.578849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.578929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.578953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.579027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.579157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.579185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.579317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.579398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.579427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.579505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.579617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.579644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.579728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.579876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.579903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.579999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.580095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.580137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.580253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.580386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.580411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.580537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.580641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.580665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.580783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.580880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.580906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.581021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.581142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.581168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.581308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.581389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.581418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.581507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.581629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.581654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.581779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.581901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.581927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.582037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.582148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.582175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.582341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.582422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.582445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.582571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.582667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.582693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.582807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.582914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.582939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.583098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.583221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.583245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.583333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.583412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.583436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.583519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.583631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.583658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.583757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.583868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.583894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.461 qpair failed and we were unable to recover it. 00:28:01.461 [2024-11-26 23:20:27.583986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.461 [2024-11-26 23:20:27.584102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.584129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.584237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.584340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.584363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.584482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.584617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.584645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.584749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.584867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.584893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.585022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.585119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.585143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.585233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.585338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.585362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.585484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.585643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.585670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.585795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.585881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.585907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.586002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.586120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.586147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.586256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.586369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.586393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.586502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.586603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.586630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.586764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.586842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.586867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.586987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.587117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.587144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.587257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.587413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.587440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.587579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.587692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.587716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.587853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.587944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.587970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.588063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.588185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.588211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.588317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.588414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.588438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.588534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.588698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.588726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.588857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.588940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.588964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.589052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.589208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.589236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.589343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.589432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.589458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.462 qpair failed and we were unable to recover it. 00:28:01.462 [2024-11-26 23:20:27.589553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.462 [2024-11-26 23:20:27.589664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.589690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.589780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.589887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.589916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.590058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.590144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.590169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.590276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.590396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.590422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.590499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.590589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.590613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.590751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.590879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.590902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.590976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.591128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.591155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.591269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.591407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.591432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.591508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.591631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.591655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.591788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.591912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.591939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.592034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.592169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.592198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.592340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.592452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.592475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.592582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.592699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.592726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.592873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.592967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.592994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.593149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.593244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.593270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.593406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.593509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.593550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.593661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.593824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.593852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.593946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.594074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.594101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.463 qpair failed and we were unable to recover it. 00:28:01.463 [2024-11-26 23:20:27.594282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.594362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.463 [2024-11-26 23:20:27.594386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.594486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.594624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.594649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.594760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.594844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.594875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.595001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.595131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.595158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.595251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.595376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.595404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.595542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.595627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.595651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.595744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.595870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.595898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.596053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.596139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.596163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.596270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.596348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.596372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.596485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.596575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.596599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.596680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.596794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.596818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.596944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.597065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.597093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.597223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.597319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.597346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.597476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.597553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.597577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.597656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.597795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.597823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.597954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.598069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.598094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.598201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.598308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.598332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.598451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.598576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.598601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.598730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.598822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.598850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.599002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.599130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.599156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.599277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.599391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.599416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.599497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.599590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.599615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.464 qpair failed and we were unable to recover it. 00:28:01.464 [2024-11-26 23:20:27.599729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.599836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.464 [2024-11-26 23:20:27.599864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.600008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.600091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.600115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.600239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.600347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.600374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.600538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.600614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.600639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.600737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.600872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.600897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.601013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.601116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.601159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.601293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.601405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.601429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.601570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.601645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.601670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.601808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.601930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.601958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.602050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.602213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.602240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.602383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.602474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.602501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.602622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.602705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.602730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.602811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.602898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.602925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.603085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.603170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.603207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.603337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.603451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.603475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.603587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.603698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.603722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.603809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.603954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.603981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.604072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.604226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.604251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.604342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.604489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.604516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.604658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.604791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.604816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.604950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.605030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.605057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.605173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.605297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.605325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.605422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.605518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.465 [2024-11-26 23:20:27.605554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.465 qpair failed and we were unable to recover it. 00:28:01.465 [2024-11-26 23:20:27.605682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.605763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.605787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.605914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.606039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.606064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.606182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.606280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.606322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.606425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.606589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.606614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.606731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.606812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.606836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.606925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.607116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.607380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.607643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.607865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.607975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.608098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.608316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.608585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.608787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.608998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.609074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.609154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.609178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.609292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.609377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.609405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.609535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.609639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.609663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.609771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.609893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.609921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.610017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.610111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.610137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.610276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.610367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.610394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.610499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.610617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.610642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.610750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.610871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.466 [2024-11-26 23:20:27.610898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.466 qpair failed and we were unable to recover it. 00:28:01.466 [2024-11-26 23:20:27.611021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.611138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.611165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.611320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.611413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.611438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.611550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.611632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.611657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.611833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.611947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.611972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.612077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.612174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.612201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.612295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.612415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.612443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.612606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.612686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.612709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.612802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.612880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.612905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.612987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.613116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.613143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.613233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.613331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.613357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.613498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.613654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.613678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.613769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.613907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.613950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.614042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.614153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.614177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.614291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.614390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.614417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.614550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.614660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.614684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.614768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.614879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.614905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.615039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.615172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.615197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.615284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.615371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.615395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.615507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.615608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.615632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.615747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.615854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.615880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.615999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.616087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.616114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.467 [2024-11-26 23:20:27.616256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.616331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.467 [2024-11-26 23:20:27.616355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.467 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.616470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.616572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.616597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.616770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.616879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.616903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.616984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.617169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.617412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.617637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.617897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.617977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.618000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.618117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.618213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.618240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.618344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.618477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.618504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.618619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.618715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.618739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.618854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.618969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.619129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.619422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.619667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.619891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.619995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.620098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.620205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.620234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.620341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.620454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.620478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.620586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.620730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.620754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.620866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.620980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.621022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.621111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.621207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.621234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.621398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.621534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.621559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.621711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.621840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.621864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.468 [2024-11-26 23:20:27.622012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.622138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.468 [2024-11-26 23:20:27.622166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.468 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.622258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.622376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.622405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.622508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.622608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.622632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.622720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.622797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.622821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.622976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.623093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.623119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.623224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.623315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.623342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.623447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.623560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.623585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.623660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.623757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.623783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.623905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.624062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.624086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.624186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.624287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.624311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.624411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.624569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.624595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.624707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.624809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.624836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.624937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.625029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.625055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.625169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.625270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.625294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.625422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.625535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.625560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.625643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.625722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.625745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.625861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.626016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.626043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.626133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.626220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.626246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.469 qpair failed and we were unable to recover it. 00:28:01.469 [2024-11-26 23:20:27.626359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.626465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.469 [2024-11-26 23:20:27.626490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.626592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.626716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.626741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.626827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.626962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.626989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.627117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.627255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.627282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.627411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.627531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.627557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.627640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.627721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.627774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.627916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.628147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.628330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.628511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.628729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.628826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.628937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.629158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.629377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.629686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.629903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.629992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.630018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.630163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.630253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.630277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.630369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.630473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.630498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.630624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.630757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.630782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.630896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.631030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.631055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.631133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.631238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.631262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.470 qpair failed and we were unable to recover it. 00:28:01.470 [2024-11-26 23:20:27.631398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.631521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.470 [2024-11-26 23:20:27.631567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.631713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.631805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.631831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.631945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.632066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.632094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.632240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.632356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.632379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.632487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.632637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.632665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.632754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.632869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.632900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.633008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.633130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.633173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.633257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.633367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.633391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.633508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.633658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.633686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.633776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.633954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.633978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.634091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.634173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.634198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.634290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.634388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.634415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.634497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.634608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.634632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.634714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.634869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.634896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.635019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.635136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.635163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.635273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.635360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.635384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.635469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.635557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.635582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.635688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.635776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.635800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.635918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.636032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.636056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.636190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.636275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.636300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.636389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.636533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.636559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.636700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.636797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.636824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.471 qpair failed and we were unable to recover it. 00:28:01.471 [2024-11-26 23:20:27.636923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.471 [2024-11-26 23:20:27.637052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.637081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.637180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.637256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.637282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.637397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.637498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.637530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.637651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.637748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.637772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.637932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.638051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.638078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.638221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.638358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.638382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.638484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.638584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.638613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.638741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.638867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.638895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.639008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.639119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.639159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.639265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.639350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.639374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.639506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.639613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.639638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.639723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.639844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.639871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.639967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.640085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.640112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.640220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.640361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.640385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.640553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.640637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.640665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.640770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.640899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.640927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.641055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.641143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.641169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.641325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.641431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.641456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.641585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.641699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.641727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.641826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.641917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.641944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.642059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.642154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.642178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.642294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.642374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.642399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.472 [2024-11-26 23:20:27.642474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.642597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.472 [2024-11-26 23:20:27.642625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.472 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.642760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.642870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.642895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.643007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.643162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.643189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.643308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.643433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.643460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.643548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.643677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.643701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.643783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.643870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.643894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.644012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.644171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.644198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.644299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.644398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.644422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.644534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.644633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.644674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.644789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.644903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.644944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.645036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.645136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.645162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.645287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.645360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.645383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.645522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.645655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.645702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.645789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.645874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.645898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.646016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.646098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.646140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.646337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.646457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.646483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.646602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.646712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.646736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.646825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.646915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.646939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.647050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.647162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.647186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.647294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.647372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.647397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.647512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.647642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.647669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.647805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.647919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.647946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.473 [2024-11-26 23:20:27.648077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.648200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.473 [2024-11-26 23:20:27.648232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.473 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.648335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.648447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.648472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.648605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.648758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.648784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.648918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.649119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.649353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.649656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.649851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.649980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.650086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.650199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.650226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.650319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.650470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.650494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.650659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.650757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.650784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.650892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.651139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.651389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.651580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.651812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.651970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.652072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.652200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.652224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.652360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.652473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.652496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.652617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.652705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.652747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.652863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.653003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.653031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.653160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.653253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.653281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.653415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.653541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.653567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.474 [2024-11-26 23:20:27.653740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.653857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.474 [2024-11-26 23:20:27.653881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.474 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.653964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.654077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.654102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.654178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.654257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.654281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.654417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.654490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.654514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.654664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.654747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.654788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.654903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.655078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.655102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.655218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.655327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.655354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.655511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.655628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.655654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.655758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.655844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.655872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.656010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.656138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.656165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.656286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.656401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.656443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.656531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.656642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.656667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.656805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.656901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.656928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.657077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.657163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.657190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.657293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.657393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.657417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.657498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.657622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.657646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.657734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.657880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.657905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.657987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.658106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.658130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.658244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.658362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.658386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.475 qpair failed and we were unable to recover it. 00:28:01.475 [2024-11-26 23:20:27.658472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.658598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.475 [2024-11-26 23:20:27.658624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.658734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.658850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.658875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.659016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.659106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.659130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.659244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.659351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.659375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.659462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.659577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.659601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.659688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.659798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.659823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.659927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.660181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.660408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.660637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.660885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.660974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.661154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.661412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.661630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.661855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.661996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.662112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.662199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.662224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.662339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.662421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.662446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.662560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.662674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.662699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.662787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.662864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.662889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.662972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.663114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.663138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.663224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.663313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.663337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.663427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.663511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.663542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.476 qpair failed and we were unable to recover it. 00:28:01.476 [2024-11-26 23:20:27.663641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.476 [2024-11-26 23:20:27.663722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.663747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.663868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.663954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.663982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.664091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.664227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.664254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.664339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.664452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.664480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.664620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.664702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.664726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.664834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.664953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.664980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.665077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.665205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.665233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.665336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.665447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.665475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.665587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.665679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.665705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.665792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.665871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.665895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.665998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.666081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.666109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.666238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.666350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.666377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.666465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.666600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.666626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.666716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.666795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.666820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.666918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.667186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.667404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.667626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.667848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.667987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.668119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.668244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.668272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.668366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.668498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.668531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.668664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.668753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.668777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.477 [2024-11-26 23:20:27.668881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.668970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.477 [2024-11-26 23:20:27.668997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.477 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.669085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.669233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.669260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.669394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.669482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.669510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.669621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.669706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.669730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.669839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.669955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.669982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.670103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.670226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.670253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.670378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.670474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.670516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.670610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.670710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.670735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.670866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.670961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.670988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.671077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.671192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.671219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.671321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.671446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.671473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.671582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.671658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.671682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.671765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.671872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.671896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.671999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.672120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.672149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.672281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.672403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.672430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.672518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.672623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.672648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.672732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.672819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.672843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.672931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.673046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.673075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.673205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.673327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.673354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.673436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.673531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.673579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.673672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.673780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.673804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.673906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.674066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.674106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.674235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.674331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.674358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.478 qpair failed and we were unable to recover it. 00:28:01.478 [2024-11-26 23:20:27.674470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.674587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.478 [2024-11-26 23:20:27.674612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.674684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.674763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.674786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.674918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.675002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.675029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.675156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.675239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.675267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.675355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.675560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.675585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.675681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.675761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.675786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.675940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.676032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.676060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.676205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.676343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.676371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.676470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.676593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.676618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.676703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.676777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.676807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.676935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.677051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.677079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.677241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.677369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.677395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.677485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.677599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.677624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.677715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.677804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.677827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.677962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.678076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.678102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.678238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.678328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.678355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.678448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.678575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.678600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.678689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.678768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.678793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.678928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.679010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.679038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.679155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.679273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.679301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.679434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.679575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.679601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.679696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.679805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.679841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.479 qpair failed and we were unable to recover it. 00:28:01.479 [2024-11-26 23:20:27.679962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.479 [2024-11-26 23:20:27.680075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.680100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.680184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.680291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.680317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.680402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.680557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.680593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.680709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.680844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.680869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.680965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.681100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.681128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.681227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.681339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.681367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.681501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.681580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.681605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.681747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.681856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.681880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.681988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.682062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.682086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.682181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.682288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.682313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.682433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.682550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.682594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.682679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.682759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.682785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.682870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.683034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.683062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.683197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.683312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.683336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.683457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.683601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.683627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.683704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.683785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.683810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.683923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.684054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.684081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.684178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.684309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.684333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.684439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.684521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.684579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.684698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.684834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.684858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.684968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.685068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.685097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.480 [2024-11-26 23:20:27.685220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.685319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.480 [2024-11-26 23:20:27.685346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.480 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.685466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.685605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.685630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.685722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.685812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.685841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.685927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.686219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.686477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.686677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.686885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.686983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.687097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.687173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.687197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.687283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.687359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.687384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.687494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.687582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.687608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.687698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.687827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.687855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.688013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.688165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.688197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.688351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.688459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.688484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.688605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.688710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.688735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.688833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.688934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.688958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.689073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.689186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.689211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.689286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.689412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.689453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.689556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.689695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.689719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.689805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.689933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.689960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.481 qpair failed and we were unable to recover it. 00:28:01.481 [2024-11-26 23:20:27.690090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.481 [2024-11-26 23:20:27.690208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.690235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.690357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.690503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.690540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.690647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.690729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.690754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.690869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.690951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.690976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.691118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.691265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.691293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.691417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.691548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.691577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.691699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.691816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.691841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.691985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.692074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.692098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.692212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.692301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.692342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.692500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.692624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.692649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.692763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.692845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.692872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.692949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.693033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.693058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.693150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.693272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.693297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.693441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.693546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.693578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.693681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.693806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.693831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.693961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.694051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.694078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.694179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.694273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.694301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.694446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.694533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.694560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.694644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.694752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.694775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.694905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.695018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.695044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.695167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.695273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.695316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.695434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.695521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.695595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.695680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.695786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.695810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.482 qpair failed and we were unable to recover it. 00:28:01.482 [2024-11-26 23:20:27.695935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.696063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.482 [2024-11-26 23:20:27.696090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.696180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.696263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.696290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.696452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.696561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.696587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.696703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.696789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.696825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.696920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.697036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.697063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.697201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.697314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.697339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.697428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.697599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.697627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.697803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.697884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.697909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.698031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.698115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.698143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.698240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.698360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.698388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.698484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.698645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.698672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.698787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.698870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.698895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.698977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.699060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.699084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.699224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.699313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.699339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.699434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.699605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.699631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.699708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.699828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.699853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.699992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.700212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.700422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.700656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.700884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.700990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.701018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.701131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.701277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.701304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.701447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.701561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.701586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.701670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.701749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.483 [2024-11-26 23:20:27.701773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.483 qpair failed and we were unable to recover it. 00:28:01.483 [2024-11-26 23:20:27.701855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.701994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.702019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.702138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.702250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.702290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.702409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.702500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.702533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.702647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.702729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.702752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.702872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.702996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.703023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.703144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.703299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.703322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.703451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.703576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.703600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.703690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.703807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.703831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.703917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.704173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.704404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.704623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.704842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.704952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.705125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.705241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.705268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.705365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.705478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.705505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.705647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.705762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.705785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.705912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.706129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.706318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.706548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.706777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.706883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.706999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.707086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.707110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.707238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.707354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.707381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.707518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.707616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.707640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.707725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.707838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.707878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.707975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.708072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.708099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.484 qpair failed and we were unable to recover it. 00:28:01.484 [2024-11-26 23:20:27.708224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.484 [2024-11-26 23:20:27.708343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.708370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.708554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.708665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.708689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.708800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.708880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.708904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.709043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.709159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.709186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.709313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.709437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.709465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.709612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.709692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.709718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.709807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.709910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.709937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.710062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.710214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.710241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.710334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.710427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.710454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.710563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.710638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.710662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.710735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.710861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.710887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.710985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.711118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.711142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.711247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.711386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.711409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.711491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.711617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.711642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.711752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.711833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.711858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.711974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.712107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.712135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.712289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.712393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.712417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.712553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.712662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.712687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.712777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.712886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.712927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.713026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.713143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.713185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.713292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.713380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.713422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.713565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.713702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.713730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.713817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.713904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.713928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.714036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.714140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.714166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.714283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.714373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.714398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.714500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.714582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.714607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.714721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.714813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.714837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.485 qpair failed and we were unable to recover it. 00:28:01.485 [2024-11-26 23:20:27.714919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.715000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.485 [2024-11-26 23:20:27.715024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.715159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.715237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.715263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.715349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.715454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.715478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.715591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.715684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.715709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.715794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.715943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.715967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.716052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.716165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.716189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.716293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.716377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.716402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.716540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.716644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.716668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.716748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.716831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.716856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.716963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.717050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.717077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.717211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.717343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.717369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.717461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.717580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.717621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.717702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.717823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.717865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.717961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.718082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.718110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.718239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.718323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.718347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.718482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.718624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.718649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.718736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.718813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.718854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.718945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.719041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.719068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.719202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.719315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.719340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.719429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.719548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.719573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.719662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.719803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.719828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.719970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.720071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.720098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.720257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.720331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.720356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.720478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.720597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.720622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.720712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.720788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.720812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.720952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.721030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.721054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.486 qpair failed and we were unable to recover it. 00:28:01.486 [2024-11-26 23:20:27.721131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.486 [2024-11-26 23:20:27.721244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.721269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.721355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.721468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.721492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.721643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.721762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.721788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.721917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.722054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.722079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.722221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.722332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.722358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.722471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.722583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.722608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.722747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.722832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.722857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.722950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.723092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.723120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.723226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.723313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.723337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.723536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.723619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.723644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.723735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.723853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.723878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.724016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.724097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.724121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.724262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.724371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.724396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.724513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.724607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.724632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.724714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.724837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.724862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.724947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.725192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.725375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.725662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.725912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.725993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.726021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.726161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.726270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.487 [2024-11-26 23:20:27.726312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.487 qpair failed and we were unable to recover it. 00:28:01.487 [2024-11-26 23:20:27.726435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.726538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.726581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.726671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.726759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.726783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.726919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.727008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.727035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.727169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.727250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.727274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.727435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.727561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.727591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.727696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.727819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.727845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.727938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.728182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.728368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.728628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.728851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.728998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.729090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.729171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.729197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.729287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.729436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.729462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.729602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.729688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.729713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.729827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.729933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.729975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.730081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.730190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.730214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.730331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.730419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.730442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.730576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.730726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.730753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.730877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.730975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.731136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.731360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.731658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.731836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.731947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.732052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.732165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.732190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.732274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.732388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.732429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.732519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.732663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.732686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.488 qpair failed and we were unable to recover it. 00:28:01.488 [2024-11-26 23:20:27.732795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.488 [2024-11-26 23:20:27.732962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.732989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.733124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.733239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.733263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.733375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.733531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.733560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.733666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.733807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.733832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.733917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.734033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.734074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.734203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.734316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.734340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.734453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.734622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.734651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.734757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.734843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.734870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.734994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.735098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.735122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.735205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.735311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.735335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.735412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.735516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.735569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.735678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.735788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.735813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.735894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.736147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.736357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.736596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.736861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.736989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.737091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.737168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.737191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.737290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.737405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.737429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.737507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.737622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.737647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.737755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.737931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.737956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.738062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.738165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.738190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.738348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.738470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.738497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.738641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.738754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.738782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.738914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.739065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.739092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.739190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.739328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.739353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.739490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.739609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.739633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.739721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.739827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.739852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.489 qpair failed and we were unable to recover it. 00:28:01.489 [2024-11-26 23:20:27.739937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.489 [2024-11-26 23:20:27.740038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.740064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.740208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.740341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.740365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.740553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.740697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.740721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.740862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.740989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.741016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.741137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.741271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.741299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.741405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.741518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.741555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.741672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.741758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.741782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.741940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.742096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.742120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.742227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.742371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.742398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.742515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.742618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.742642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.742726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.742806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.742829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.742912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.743188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.743411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.743626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.743867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.743998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.744022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.744139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.744274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.744301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.744451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.744593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.744618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.744759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.744859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.744901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.744981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.745091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.745115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.745199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.745298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.745340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.745423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.745508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.745538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.745674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.745765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.745793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.745893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.746064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.746088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.746228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.746321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.746347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.746473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.746625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.746650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.746769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.746893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.746919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.490 qpair failed and we were unable to recover it. 00:28:01.490 [2024-11-26 23:20:27.747011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.747131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.490 [2024-11-26 23:20:27.747173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.747264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.747371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.747394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.747535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.747654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.747679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.747842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.747940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.747966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.748107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.748246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.748270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.748410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.748501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.748535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.748644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.748757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.748781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.748870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.748983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.749007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.749131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.749256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.749282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.749374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.749472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.749514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.749636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.749776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.749800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.749933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.750013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.750039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.750139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.750272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.750296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.750386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.750517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.750552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.750689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.750832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.750855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.750983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.751103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.751129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.751256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.751413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.751440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.751563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.751641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.751665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.751782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.751871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.751894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.752037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.752152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.752176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.752311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.752429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.752455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.752549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.752643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.752668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.752815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.752932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.752955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.753067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.753143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.753167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.753282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.753397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.753439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.753560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.753657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.753684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.753864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.753981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.754004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.754169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.754258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.491 [2024-11-26 23:20:27.754285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.491 qpair failed and we were unable to recover it. 00:28:01.491 [2024-11-26 23:20:27.754413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.754504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.754534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.754652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.754736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.754764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.754876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.754955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.754979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.755108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.755206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.755233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.755371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.755488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.755512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.755630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.755717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.755741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.755851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.755940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.755964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.756062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.756166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.756192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.756286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.756415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.756442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.756600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.756689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.756712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.756796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.756917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.756941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.757070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.757154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.757180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.757279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.757398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.757426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.757529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.757650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.757678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.757844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.757956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.757980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.758112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.758230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.758256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.758424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.758536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.758561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.758715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.758848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.758872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.758955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.759068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.759093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.759221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.759319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.759360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.759443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.759558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.759583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.759697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.759807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.759831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.759975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.760084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.760108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.760207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.760322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.760348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.760446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.760576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.760601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.760711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.760843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.760869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.761011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.761127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.761150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.761232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.761368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.761395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.492 qpair failed and we were unable to recover it. 00:28:01.492 [2024-11-26 23:20:27.761552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.492 [2024-11-26 23:20:27.761685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.761709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.761803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.761887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.761928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.762087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.762195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.762220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.762326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.762460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.762484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.762580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.762696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.762720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.762838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.762981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.763116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.763385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.763617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.763842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.763943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.764052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.764161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.764185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.764315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.764440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.764481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.764610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.764694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.764718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.764797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.764924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.764950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.765061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.765208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.765232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.765320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.765451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.765478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.765600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.765710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.765734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.765823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.765913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.765938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.766053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.766163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.766188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.766319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.766417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.766442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.766561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.766700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.766724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.766807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.766919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.766963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.767067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.767205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.767230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.767339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.767433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.767474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.767561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.767651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.767679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.767819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.767976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.768134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.768386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.768652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.768864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.493 [2024-11-26 23:20:27.768987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.493 qpair failed and we were unable to recover it. 00:28:01.493 [2024-11-26 23:20:27.769124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.769230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.769255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.769419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.769564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.769593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.769746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.769866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.769906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.770021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.770135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.770179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.770285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.770400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.770425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.770518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.770614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.770638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.770725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.770820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.770846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.770975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.771118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.771142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.771283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.771395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.771419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.771542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.771630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.771658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.771759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.771926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.771950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.772056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.772144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.772168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.772278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.772354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.772378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.772463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.772552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.772578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.772693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.772822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.772849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.772948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.773078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.773106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.773229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.773343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.773367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.773444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.773554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.773596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.773694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.773830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.773854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.773981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.774107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.774148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.774306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.774426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.774453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.774595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.774709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.774733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.774876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.774986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.775140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.775384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.775613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.775828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.775987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.776103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.776231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.776256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.494 qpair failed and we were unable to recover it. 00:28:01.494 [2024-11-26 23:20:27.776343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.776428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.494 [2024-11-26 23:20:27.776452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.776541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.776621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.776647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.776759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.776840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.776864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.776999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.777102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.777126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.777201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.777310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.777335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.777418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.777568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.777594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.777715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.777823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.777847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.777979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.778069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.778097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.778236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.778341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.778368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.778484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.778590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.778616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.778729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.778840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.778865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.779004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.779139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.779166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.779329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.779417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.779441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.779518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.779617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.779642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.779757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.779872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.779914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.780000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.780110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.780133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.780270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.780385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.780409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.780496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.780618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.780650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.780770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.780925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.780952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.781071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.781166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.781193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.781320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.781405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.781430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.781511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.781618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.781643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.781785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.781912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.781939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.782067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.782228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.782252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.782331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.782412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.782436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.782543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.782686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.782711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.782796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.782905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.782929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.783003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.783083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.783112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.783226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.783339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.783364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.783486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.783582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.783625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.783715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.783846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.783873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.495 qpair failed and we were unable to recover it. 00:28:01.495 [2024-11-26 23:20:27.783956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.784073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.495 [2024-11-26 23:20:27.784101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.784245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.784319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.784344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.784461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.784544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.784569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.784661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.784800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.784825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.784900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.785041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.785068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.785197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.785306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.785330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.785416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.785564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.785590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.785714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.785790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.785813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.785953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.786067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.786093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.786193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.786304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.786328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.786480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.786626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.786651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.786796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.786962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.786989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.787143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.787266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.787292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.787391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.787531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.787556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.787658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.787780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.787806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.787894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.787988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.788014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.788107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.788234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.788261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.788396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.788507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.788538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.788650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.788777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.788804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.788905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.788986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.789013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.789146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.789235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.789261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.789375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.789487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.789511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.789635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.789779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.789804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.789894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.790032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.790075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.790192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.790340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.790380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.790491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.790611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.790638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.790728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.790855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.496 [2024-11-26 23:20:27.790881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.496 qpair failed and we were unable to recover it. 00:28:01.496 [2024-11-26 23:20:27.791001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.791133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.791161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.791302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.791388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.791415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.791547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.791632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.791656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.791740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.791843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.791871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.792002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.792151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.792178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.792329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.792422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.792448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.792565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.792678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.792702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.792780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.792878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.792904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.793026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.793177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.793217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.793357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.793457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.793484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.793579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.793685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.793710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.793801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.793918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.793942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.794050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.794138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.794162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.794249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.794344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.794370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.794493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.794695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.794720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.794802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.794913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.794938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.795026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.795126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.795152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.795269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.795386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.795413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.497 qpair failed and we were unable to recover it. 00:28:01.497 [2024-11-26 23:20:27.795570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.497 [2024-11-26 23:20:27.795676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.795701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.795796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.795949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.795977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.796076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.796230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.796263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.796363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.796451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.796479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.796591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.796671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.796695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.796813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.796925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.796949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.797071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.797153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.797178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.797298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.797409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.797433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.797579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.797675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.797700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.797818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.797890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.797914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.798017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.798177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.798204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.798327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.798461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.798486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.798578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.798692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.798716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.798861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.798947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.798971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.799067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.799196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.799223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.799325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.799443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.799469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.799581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.799697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.799722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.799848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.799937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.799964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.800093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.800209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.800236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.800326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.800423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.800450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.800563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.800655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.800680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.800764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.800870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.800895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.801033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.801178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.801203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.801323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.801413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.801438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.801516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.801626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.801651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.801737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.801820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.801845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.801960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.802088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.802115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.802221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.802338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.802379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.498 qpair failed and we were unable to recover it. 00:28:01.498 [2024-11-26 23:20:27.802490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.498 [2024-11-26 23:20:27.802618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.802653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.802770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.802902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.802930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.803072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.803231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.803256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.803349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.803468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.803508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.803661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.803742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.803766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.803903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.804024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.804049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.804132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.804241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.804266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.804350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.804448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.804476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.804588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.804719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.804756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.804896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.805170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.805397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.805650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.805904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.805992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.806016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.806197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.806339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.806364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.806531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.806651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.806678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.806806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.806921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.806944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.499 [2024-11-26 23:20:27.807039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.807156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.499 [2024-11-26 23:20:27.807207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.499 qpair failed and we were unable to recover it. 00:28:01.801 [2024-11-26 23:20:27.807344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.807459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.807498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.801 qpair failed and we were unable to recover it. 00:28:01.801 [2024-11-26 23:20:27.807680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.807817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.807865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.801 qpair failed and we were unable to recover it. 00:28:01.801 [2024-11-26 23:20:27.808060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.808194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.808245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.801 qpair failed and we were unable to recover it. 00:28:01.801 [2024-11-26 23:20:27.808444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.808638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.808665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.801 qpair failed and we were unable to recover it. 00:28:01.801 [2024-11-26 23:20:27.808773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.808885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.808912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.801 qpair failed and we were unable to recover it. 00:28:01.801 [2024-11-26 23:20:27.809061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.809180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.809208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.801 qpair failed and we were unable to recover it. 00:28:01.801 [2024-11-26 23:20:27.809342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.809451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.809476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.801 qpair failed and we were unable to recover it. 00:28:01.801 [2024-11-26 23:20:27.809609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.809729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.801 [2024-11-26 23:20:27.809759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.809910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.810049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.810078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.810183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.810283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.810311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.810423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.810504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.810540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.810679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.810827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.810864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.811031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.811157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.811180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.811268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.811400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.811443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.811563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.811654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.811680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.811821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.811948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.811976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.812126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.812288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.812313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.812410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.812564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.812593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.812714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.812798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.812823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.812909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.813031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.813059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.813188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.813276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.813303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.813429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.813560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.813585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.813698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.813816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.813840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.813944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.814064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.814092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.814199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.814333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.814358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.814443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.814535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.814576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.814681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.814817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.814842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.814947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.815059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.815087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.815268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.815357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.815382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.815498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.815591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.815617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.815729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.815875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.815899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.816036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.816126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.816154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.816270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.816391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.816418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.816562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.816666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.816691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.816808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.816884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.816909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.817040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.817136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.802 [2024-11-26 23:20:27.817164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.802 qpair failed and we were unable to recover it. 00:28:01.802 [2024-11-26 23:20:27.817294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.817376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.817402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.817569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.817673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.817698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.817780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.817866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.817891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.817974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.818070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.818098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.818218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.818302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.818344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.818486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.818605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.818631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.818706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.818795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.818820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.818903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.819196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.819442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.819666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.819912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.819995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.820036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.820175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.820304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.820332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.820427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.820550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.820593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.820685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.820794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.820820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.820953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.821086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.821111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.821188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.821264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.821288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.821429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.821567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.821593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.821676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.821757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.821781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.821866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.822117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.822404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.822616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.822816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.822921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.823033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.823144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.823169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.823285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.823388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.823428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.823563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.823682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.823708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.823842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.823992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.824020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.803 [2024-11-26 23:20:27.824175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.824320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.803 [2024-11-26 23:20:27.824347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.803 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.824499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.824614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.824639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.824716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.824851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.824875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.825029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.825124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.825151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.825245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.825370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.825397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.825534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.825663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.825703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.825815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.825923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.825950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.826095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.826210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.826235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.826325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.826404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.826429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.826539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.826690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.826715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.826830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.826937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.826962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.827096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.827225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.827252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.827373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.827496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.827532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.827638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.827724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.827748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.827863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.827941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.827966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.828124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.828247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.828274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.828367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.828494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.828519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.828640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.828721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.828745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.828820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.828937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.828962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.829040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.829174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.829201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.829333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.829424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.829451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.829536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.829632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.829657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.829747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.829818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.829841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.829961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.830039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.830063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.830187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.830306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.830348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.830483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.830588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.830613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.830724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.830835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.830860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.830971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.831081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.831108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.831227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.831314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.831340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.804 qpair failed and we were unable to recover it. 00:28:01.804 [2024-11-26 23:20:27.831433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.804 [2024-11-26 23:20:27.831556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.831599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.831680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.831796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.831819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.831906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.831990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.832105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.832292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.832521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.832768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.832873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.832985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.833152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.833176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.833264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.833404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.833430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.833567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.833661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.833685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.833767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.833899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.833923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.834039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.834196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.834223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.834352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.834461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.834485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.834577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.834685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.834709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.834817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.834914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.834941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.835035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.835152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.835179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.835273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.835409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.835437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.835558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.835669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.835693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.835798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.835907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.835930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.836041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.836162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.836190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.836338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.836462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.836489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.836608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.836725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.836749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.836862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.836988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.837014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.837131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.837311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.837335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.837472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.837609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.837636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.837742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.837886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.837910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.838046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.838141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.838174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.838308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.838440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.838465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.838596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.838684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.805 [2024-11-26 23:20:27.838712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.805 qpair failed and we were unable to recover it. 00:28:01.805 [2024-11-26 23:20:27.838825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.838939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.838964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.839055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.839185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.839213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.839307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.839427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.839453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.839554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.839687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.839712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.839828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.839937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.839961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.840089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.840219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.840259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.840398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.840500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.840534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.840673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.840759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.840782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.840927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.841010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.841035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.841173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.841332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.841356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.841466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.841593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.841621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.841743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.841868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.841895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.842002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.842119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.842144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.842229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.842311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.842335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.842469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.842570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.842598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.842724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.842827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.842851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.842968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.843077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.843102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.843210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.843328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.843352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.843493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.843680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.843706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.843853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.843990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.844016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.844119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.844205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.844229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.844339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.844484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.844509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.806 [2024-11-26 23:20:27.844677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.844831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.806 [2024-11-26 23:20:27.844858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.806 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.844950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.845079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.845102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.845216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.845352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.845376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.845485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.845618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.845646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.845800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.845912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.845939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.846040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.846134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.846163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.846304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.846392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.846416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.846557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.846663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.846692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.846848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.846975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.847003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.847125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.847279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.847307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.847435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.847530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.847554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.847742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.847851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.847875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.847959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.848104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.848128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.848214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.848322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.848347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.848519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.848632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.848657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.848774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.848846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.848870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.848974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.849095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.849119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.849246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.849383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.849407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.849518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.849631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.849655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.849789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.849907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.849935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.850028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.850148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.850175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.850300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.850434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.850459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.850576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.850691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.850715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.850818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.850951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.850976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.851093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.851181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.851226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.851328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.851479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.851520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.851647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.851719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.851747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.851831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.851987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.852015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.852108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.852228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.852257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.807 qpair failed and we were unable to recover it. 00:28:01.807 [2024-11-26 23:20:27.852391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.852530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.807 [2024-11-26 23:20:27.852572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.852667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.852740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.852764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.852874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.852958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.852983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.853120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.853249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.853274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.853383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.853461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.853485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.853609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.853722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.853746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.853891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.853974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.853999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.854126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.854224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.854252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.854355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.854475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.854504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.854648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.854760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.854785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.854871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.855001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.855028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.855181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.855294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.855321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.855438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.855568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.855596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.855713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.855816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.855840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.855976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.856103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.856131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.856248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.856371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.856412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.856505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.856590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.856615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.856706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.856790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.856814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.856926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.857155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.857358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.857554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.857783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.857921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.858035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.858123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.858150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.858238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.858353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.858377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.858464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.858578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.858604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.858743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.858858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.858883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.858964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.859080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.859105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.859191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.859290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.859316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.808 qpair failed and we were unable to recover it. 00:28:01.808 [2024-11-26 23:20:27.859448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.808 [2024-11-26 23:20:27.859566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.859591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.859744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.859859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.859886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.860043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.860130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.860157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.860254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.860370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.860398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.860571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.860650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.860675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.860769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.860893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.860921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.861077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.861197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.861225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.861325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.861441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.861484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.861580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.861664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.861689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.861769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.861911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.861953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.862094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.862199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.862224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.862311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.862422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.862451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.862566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.862650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.862675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.862782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.862859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.862883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.862963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.863074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.863099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.863216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.863314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.863339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.863425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.863563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.863589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.863714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.863832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.863859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.863960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.864063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.864088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.864161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.864275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.864305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.864403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.864504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.864538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.864696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.864786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.864811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.864918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.865181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.865413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.865646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.865882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.865974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.866003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.866119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.866203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.866231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.866329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.866448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.809 [2024-11-26 23:20:27.866472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.809 qpair failed and we were unable to recover it. 00:28:01.809 [2024-11-26 23:20:27.866597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.866699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.866724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.866866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.866952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.866977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.867053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.867169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.867193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.867273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.867379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.867403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.867516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.867637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.867662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.867743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.867831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.867860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.867970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.868059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.868086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.868225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.868331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.868356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.868467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.868551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.868576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.868707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.868804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.868832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.868957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.869044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.869073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.869222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.869358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.869383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.869500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.869629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.869670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.869750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.869860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.869885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.869968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.870074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.870101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.870210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.870297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.870321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.870435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.870561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.870589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.870711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.870784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.870809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.870908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.871034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.871061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.871175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.871259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.871283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.871367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.871506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.871537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.871628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.871735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.871762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.871892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.872019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.872043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.872162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.872271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.872296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.872408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.872517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.872550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.872639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.872732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.810 [2024-11-26 23:20:27.872756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.810 qpair failed and we were unable to recover it. 00:28:01.810 [2024-11-26 23:20:27.872838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.872925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.872951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.873071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.873183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.873208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.873346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.873454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.873479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.873591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.873705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.873730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.873863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.873983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.874143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.874360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.874661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.874876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.874995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.875102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.875205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.875229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.875301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.875391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.875419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.875538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.875636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.875663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.875808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.875948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.875972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.876058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.876141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.876166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.876271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.876403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.876430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.876517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.876623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.876654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.876770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.876918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.876945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.877050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.877149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.877174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.877278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.877409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.877436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.877516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.877709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.877737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.877832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.877922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.877948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.878077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.878157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.878181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.878307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.878427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.878468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.878605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.878737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.878765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.878861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.878973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.879001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.879141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.879256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.879284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.879378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.879491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.879519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.811 qpair failed and we were unable to recover it. 00:28:01.811 [2024-11-26 23:20:27.879632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.811 [2024-11-26 23:20:27.879742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.879766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.879853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.879945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.879972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.880130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.880244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.880271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.880360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.880440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.880465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.880565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.880655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.880680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.880783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.880919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.880944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.881053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.881166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.881190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.881317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.881443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.881471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.881565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.881725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.881750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.881838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.881925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.881966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.882082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.882161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.882185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.882276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.882388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.882413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.882516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.882655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.882683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.882781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.882923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.882948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.883025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.883114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.883139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.883221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.883372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.883397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.883517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.883629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.883671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.883797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.883954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.883982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.884088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.884197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.884223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.884354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.884487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.884512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.884626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.884730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.884755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.884905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.885031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.885055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.885133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.885257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.885282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.885366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.885481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.885505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.885654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.885775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.885803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.885939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.886028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.886053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.886195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.886312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.886337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.886476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.886610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.886638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.886724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.886815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.886844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.812 qpair failed and we were unable to recover it. 00:28:01.812 [2024-11-26 23:20:27.886951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.812 [2024-11-26 23:20:27.887082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.887109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.887243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.887322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.887346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.887453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.887538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.887563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.887652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.887801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.887829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.887987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.888134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.888162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.888271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.888395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.888423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.888515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.888624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.888649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.888765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.888920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.888945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.889056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.889191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.889219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.889358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.889472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.889496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.889630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.889758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.889786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.889878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.890026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.890050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.890167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.890246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.890288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.890416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.890532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.890558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.890692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.890789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.890818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.890987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.891065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.891089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.891182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.891284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.891312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.891442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.891551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.891577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.891662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.891737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.891762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.891903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.892056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.892080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.892218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.892343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.892388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.892502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.892645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.892671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.892804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.892890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.892918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.893014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.893139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.893164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.893274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.893387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.893412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.893493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.893629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.893655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.893796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.893958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.893982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.894095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.894168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.894193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.813 qpair failed and we were unable to recover it. 00:28:01.813 [2024-11-26 23:20:27.894313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.813 [2024-11-26 23:20:27.894390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.894415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.894531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.894643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.894668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.894755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.894863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.894899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.895042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.895132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.895157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.895299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.895384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.895409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.895501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.895609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.895634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.895721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.895847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.895873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.895978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.896061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.896085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.896199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.896327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.896355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.896489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.896620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.896645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.896774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.896899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.896942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.897029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.897106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.897131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.897238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.897345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.897369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.897465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.897586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.897611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.897746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.897881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.897905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.898041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.898126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.898150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.898292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.898417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.898441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.898538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.898631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.898656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.898750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.898891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.898919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.899037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.899124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.899152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.899250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.899384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.899408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.899492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.899606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.899632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.899723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.899800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.899824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.899937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.900029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.900053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.900144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.900253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.900278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.900376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.900495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.900523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.900640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.900754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.900779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.900912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.901012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.901040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.901127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.901245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.901271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.814 qpair failed and we were unable to recover it. 00:28:01.814 [2024-11-26 23:20:27.901406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.814 [2024-11-26 23:20:27.901517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.901593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.901711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.901839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.901866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.902014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.902129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.902157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.902289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.902398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.902423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.902512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.902608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.902633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.902762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.902887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.902912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.902990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.903098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.903140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.903266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.903401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.903428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.903570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.903659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.903697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.903809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.903900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.903924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.904015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.904142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.904166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.904255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.904369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.904395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.904487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.904600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.904625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.904754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.904905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.904945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.905033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.905232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.905416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.905612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.905813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.905960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.906095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.906207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.906235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.906354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.906481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.906508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.906658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.906738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.906763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.906845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.906953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.906978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.907099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.907224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.907251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.907406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.907485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.907509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.815 qpair failed and we were unable to recover it. 00:28:01.815 [2024-11-26 23:20:27.907623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.907748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.815 [2024-11-26 23:20:27.907772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.907895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.908050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.908077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.908174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.908260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.908288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.908399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.908515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.908548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.908626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.908738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.908763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.908886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.909029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.909053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.909164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.909286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.909311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.909424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.909558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.909587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.909723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.909856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.909884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.909966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.910064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.910091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.910222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.910349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.910373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.910484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.910603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.910628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.910750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.910885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.910925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.911043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.911126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.911167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.911279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.911375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.911400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.911492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.911628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.911655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.911770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.911873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.911900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.912057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.912196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.912221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.912295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.912406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.912432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.912571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.912653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.912678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.912798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.912920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.912947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.913040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.913136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.913163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.913288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.913438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.913465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.913616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.913710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.913734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.913825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.913902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.913927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.914066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.914205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.914232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.914347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.914504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.914534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.914619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.914809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.914834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.914991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.915108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.915133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.816 qpair failed and we were unable to recover it. 00:28:01.816 [2024-11-26 23:20:27.915240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.816 [2024-11-26 23:20:27.915360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.915387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.915537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.915667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.915694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.915825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.915946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.915970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.916098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.916218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.916247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.916381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.916492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.916517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.916654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.916750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.916778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.916878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.916996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.917021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.917144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.917240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.917282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.917395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.917550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.917581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.917778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.917927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.917954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.918113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.918228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.918253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.918419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.918515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.918558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.918679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.918771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.918805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.918925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.919047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.919087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.919197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.919317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.919342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.919459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.919559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.919607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.919684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.919765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.919800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.919943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.920098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.920123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.920264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.920407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.920431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.920565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.920687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.920711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.920839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.920959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.920987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.921102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.921227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.921255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.921422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.921536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.921562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.921713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.921819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.921844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.921957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.922037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.922061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.922182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.922285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.922326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.922466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.922594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.922619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.922751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.922872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.922900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.922998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.923081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.923109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.817 qpair failed and we were unable to recover it. 00:28:01.817 [2024-11-26 23:20:27.923234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.817 [2024-11-26 23:20:27.923350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.923377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.923488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.923589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.923615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.923700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.923818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.923843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.923975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.924070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.924097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.924211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.924333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.924360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.924472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.924591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.924616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.924727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.924860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.924887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.925031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.925137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.925162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.925305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.925431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.925459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.925601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.925712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.925737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.925866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.925987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.926015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.926176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.926327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.926355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.926475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.926616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.926641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.926729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.926851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.926875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.926958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.927106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.927133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.927288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.927372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.927399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.927593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.927732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.927756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.927898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.928050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.928098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.928213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.928366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.928409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.928487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.928640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.928666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.928778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.928889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.928915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.929036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.929186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.929211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.929326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.929410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.929437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.929587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.929747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.929780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.929912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.930011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.930041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.930164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.930313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.930342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.930437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.930565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.930592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.930724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.930873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.930901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.818 [2024-11-26 23:20:27.931020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.931139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.818 [2024-11-26 23:20:27.931167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.818 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.931315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.931439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.931467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.931588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.931697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.931726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.931852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.931969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.931998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.932099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.932220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.932250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.932341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.932469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.932497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.932628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.932747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.932772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.932901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.932993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.933112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.933310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.933546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.933804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.933932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.934046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.934160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.934189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.934310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.934458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.934487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.934636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.934719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.934745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.934899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.935028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.935057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.935146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.935234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.935263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.935417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.935511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.935551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.935654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.935762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.935787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.935935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.936069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.936097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.936216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.936328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.936355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.936446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.936539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.936580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.936723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.936854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.936881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.937019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.937135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.937163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.937284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.937381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.937409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.937501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.937673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.937699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.937787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.937923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.937948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.938066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.938156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.938184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.938307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.938435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.938464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.819 qpair failed and we were unable to recover it. 00:28:01.819 [2024-11-26 23:20:27.938556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.819 [2024-11-26 23:20:27.938686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.938712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.938815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.938939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.938967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.939143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.939247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.939273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.939402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.939521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.939571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.939682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.939838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.939865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.939997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.940112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.940140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.940243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.940371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.940416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.940495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.940586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.940611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.940721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.940797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.940838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.940971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.941066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.941094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.941221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.941362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.941390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.941515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.941646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.941671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.941787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.941941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.941968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.942055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.942144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.942174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.942322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.942416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.942444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.942546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.942699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.942724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.942805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.942915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.942962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.943068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.943188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.943217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.943324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.943473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.943498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.943600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.943717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.943742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.943822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.943928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.943954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.944060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.944159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.944188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.944290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.944407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.944432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.944515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.944643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.944669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.944784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.944904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.820 [2024-11-26 23:20:27.944932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.820 qpair failed and we were unable to recover it. 00:28:01.820 [2024-11-26 23:20:27.945057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.945213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.945240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.945374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.945488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.945517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.945633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.945748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.945776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.945894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.946014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.946044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.946184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.946317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.946342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.946455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.946549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.946575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.946708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.946827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.946855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.946976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.947090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.947118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.947234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.947321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.947349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.947465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.947574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.947599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.947712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.947824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.947849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.947978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.948105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.948151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.948233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.948344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.948369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.948482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.948595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.948621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.948721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.948837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.948864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.948984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.949132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.949172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.949280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.949372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.949414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.949552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.949638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.949664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.949783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.949886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.949913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.950060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.950181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.950224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.950344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.950430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.950455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.950566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.950683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.950708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.950838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.950964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.950992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.951113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.951201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.951229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.951360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.951444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.951469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.951603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.951719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.951744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.951853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.951941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.951967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.952072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.952235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.952262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.821 qpair failed and we were unable to recover it. 00:28:01.821 [2024-11-26 23:20:27.952381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.952479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.821 [2024-11-26 23:20:27.952506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.952631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.952737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.952761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.952892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.952969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.952998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.953086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.953211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.953239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.953349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.953442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.953469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.953581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.953691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.953716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.953828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.953976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.954001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.954151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.954307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.954332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.954471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.954634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.954676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.954766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.954904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.954929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.955059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.955173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.955198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.955286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.955456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.955481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.955565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.955687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.955712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.955798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.955880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.955905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.956039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.956163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.956191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.956340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.956505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.956540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.956675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.956792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.956817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.956925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.957035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.957061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.957187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.957310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.957339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.957466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.957587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.957616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.957772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.957898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.957926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.958052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.958161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.958186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.958278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.958381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.958408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.958501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.958637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.958663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.958751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.958907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.958935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.959067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.959209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.959235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.959366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.959505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.959561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.959700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.959827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.959855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.822 qpair failed and we were unable to recover it. 00:28:01.822 [2024-11-26 23:20:27.959980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.960070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.822 [2024-11-26 23:20:27.960097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.960254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.960360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.960385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.960496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.960588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.960614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.960778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.960905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.960932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.961055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.961184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.961209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.961287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.961424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.961449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.961594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.961686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.961711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.961826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.961940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.961983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.962104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.962234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.962259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.962377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.962463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.962488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.962593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.962683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.962709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.962792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.962905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.962946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.963078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.963195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.963223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.963352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.963437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.963462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.963565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.963654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.963679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.963846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.964011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.964036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.964155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.964258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.964286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.964414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.964520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.964571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.964702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.964785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.964810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.964923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.965054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.965082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.965237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.965383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.965410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.965508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.965625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.965650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.965780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.965875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.965919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.966036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.966114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.966140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.966245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.966347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.966371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.966455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.966548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.966575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.966703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.966816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.966841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.966951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.967076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.967104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.967201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.967290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.823 [2024-11-26 23:20:27.967321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.823 qpair failed and we were unable to recover it. 00:28:01.823 [2024-11-26 23:20:27.967447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.967556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.967582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.967663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.967807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.967832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.967973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.968079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.968104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.968182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.968291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.968316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.968436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.968519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.968552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.968680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.968833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.968858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.968972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.969086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.969130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.969276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.969393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.969420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.969515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.969640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.969666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.969747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.969875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.969904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.970028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.970110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.970138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.970235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.970356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.970385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.970507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.970662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.970688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.970822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.970971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.970999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.971153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.971262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.971287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.971378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.971468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.971494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.971612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.971728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.971753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.971887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.972021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.972049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.972141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.972236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.972261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.972371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.972490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.972519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.972662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.972769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.972794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.972934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.973065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.973094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.973270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.973378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.973403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.973481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.973637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.973679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.973798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.973906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.824 [2024-11-26 23:20:27.973932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.824 qpair failed and we were unable to recover it. 00:28:01.824 [2024-11-26 23:20:27.974042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.974118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.974143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.974306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.974401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.974431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.974558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.974678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.974706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.974788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.974904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.974931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.975082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.975224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.975252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.975352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.975468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.975496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.975679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.975809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.975838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.975961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.976071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.976097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.976206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.976293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.976328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.976459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.976576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.976603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.976688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.976773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.976800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.976881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.977020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.977046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.977211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.977327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.977356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.977444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.977576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.977602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.977720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.977838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.977865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.977978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.978116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.978142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.978286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.978399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.978428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.978555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.978693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.978722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.978851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.978945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.978974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.979102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.979179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.979205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.979362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.979464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.979492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.979602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.979735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.979762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.979860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.979996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.980025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.980166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.980283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.980309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.980398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.980554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.980592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.980715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.980858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.980886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.981004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.981141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.981171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.981261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.981369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.981395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.825 qpair failed and we were unable to recover it. 00:28:01.825 [2024-11-26 23:20:27.981479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.981568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.825 [2024-11-26 23:20:27.981595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.981755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.981868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.981897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.982022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.982136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.982165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.982302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.982441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.982467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.982586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.982712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.982746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.982849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.982965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.983009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.983124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.983239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.983283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.983384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.983497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.983567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.983702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.983875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.983901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.984039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.984183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.984210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.984326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.984461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.984491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.984652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.984796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.984822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.984938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.985077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.985106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.985266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.985417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.985443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.985572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.985719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.985754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.985883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.985998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.986024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.986102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.986216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.986245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.986339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.986498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.986533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.986673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.986749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.986775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.986923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.987038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.987065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.987234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.987330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.987360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.987491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.987606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.987633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.987789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.987938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.987980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.988096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.988210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.988237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.988357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.988445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.988479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.988614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.988733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.988762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.988888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.989008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.989034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.989141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.989256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.989282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.989416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.989577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.989607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.826 qpair failed and we were unable to recover it. 00:28:01.826 [2024-11-26 23:20:27.989728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.826 [2024-11-26 23:20:27.989895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.989937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.990052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.990159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.990185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.990328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.990468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.990494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.990614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.990751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.990791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.990917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.991041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.991071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.991184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.991300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.991334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.991494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.991610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.991638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.991750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.991826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.991852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.991966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.992119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.992148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.992264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.992382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.992410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.992545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.992639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.992665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.992777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.992924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.992951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.993032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.993171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.993197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.993308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.993428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.993458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.993607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.993715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.993742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.993857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.993968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.993994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.994128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.994256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.994282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.994391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.994557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.994590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.994673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.994833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.994872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.995008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.995148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.995174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.995288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.995429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.995455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.995545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.995662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.995688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.995770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.995886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.995927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.996043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.996190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.996216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.996332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.996464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.996493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.996628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.996770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.996799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.996922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.997036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.997062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.997140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.997249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.997275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.827 [2024-11-26 23:20:27.997435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.997592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.827 [2024-11-26 23:20:27.997619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.827 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.997764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.997911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.997940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.998037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.998189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.998217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.998321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.998404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.998431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.998520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.998608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.998634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.998742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.998852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.998895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.999045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.999132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.999158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.999270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.999352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.999379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.999554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.999669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.999697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:27.999813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.999928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:27.999954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.000072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.000155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.000181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.000297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.000378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.000405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.000516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.000605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.000631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.000706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.000845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.000871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.001029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.001184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.001226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.001335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.001522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.001578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.001709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.001869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.001898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.001999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.002120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.002150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.002271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.002394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.002422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.002541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.002663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.002690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.002843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.002942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.002986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.003124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.003249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.003278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.003391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.003486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.003516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.003635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.003743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.003770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.003859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.003946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.003973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.004080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.004215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.004241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.004338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.004453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.004482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.004602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.004722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.004748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.004854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.004936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.004962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.828 qpair failed and we were unable to recover it. 00:28:01.828 [2024-11-26 23:20:28.005069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.828 [2024-11-26 23:20:28.005178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.005205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.005359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.005445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.005475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.005625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.005735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.005762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.005889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.006051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.006077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.006186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.006318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.006347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.006472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.006613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.006641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.006783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.006901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.006927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.007041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.007125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.007152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.007242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.007378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.007404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.007518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.007634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.007660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.007736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.007883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.007910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.008071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.008229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.008258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.008349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.008472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.008501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.008642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.008726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.008752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.008882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.008985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.009016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.009163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.009339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.009383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.009523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.009654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.009680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.009791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.009945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.009988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.010182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.010327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.010353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.010473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.010601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.010629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.010800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.010905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.010932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.011054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.011155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.011182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.011297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.011434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.011461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.011607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.011761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.011804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.011927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.012057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.829 [2024-11-26 23:20:28.012083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.829 qpair failed and we were unable to recover it. 00:28:01.829 [2024-11-26 23:20:28.012199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.012311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.012338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.012450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.012591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.012618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.012730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.012881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.012908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.013026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.013143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.013169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.013262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.013350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.013377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.013494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.013597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.013624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.013744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.013859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.013885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.013965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.014079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.014106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.014254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.014359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.014385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.014497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.014615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.014643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.014734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.014840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.014867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.014978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.015072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.015099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.015216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.015302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.015328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.015478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.015609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.015636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.015753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.015880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.015907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.016022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.016102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.016129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.016215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.016327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.016353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.016434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.016549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.016580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.016696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.016841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.016869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.016954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.017097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.017124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.017240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.017358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.017385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.017466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.017568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.017596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.017739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.017838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.017864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.017959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.018065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.018091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.018231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.018377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.018404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.018510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.018627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.018657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.018828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.018915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.018942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.019054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.019197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.019224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.830 qpair failed and we were unable to recover it. 00:28:01.830 [2024-11-26 23:20:28.019340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.830 [2024-11-26 23:20:28.019423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.019450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.019599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.019740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.019766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.019885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.019996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.020111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.020330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.020612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.020848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.020989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.021129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.021237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.021263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.021377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.021461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.021489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.021622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.021774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.021824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.021919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.022035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.022063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.022183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.022291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.022318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.022429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.022541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.022577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.022699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.022847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.022874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.023019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.023132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.023159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.023268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.023407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.023434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.023587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.023773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.023823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.023954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.024082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.024108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.024217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.024301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.024327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.024419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.024537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.024573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.024682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.024826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.024853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.024969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.025053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.025081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.025168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.025291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.025319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.025458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.025544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.025571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.025686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.025773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.025801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.025919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.026001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.026028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.026171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.026278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.026308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.026391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.026477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.026504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.026621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.026737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.831 [2024-11-26 23:20:28.026763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.831 qpair failed and we were unable to recover it. 00:28:01.831 [2024-11-26 23:20:28.026873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.026988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.027015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.027126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.027262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.027289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.027397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.027535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.027563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.027674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.027750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.027778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.027897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.028119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.028372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.028578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.028839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.028980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.029121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.029375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.029645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.029872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.029980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.030073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.030216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.030243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.030358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.030474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.030500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.030603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.030716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.030743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.030829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.030967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.030994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.031072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.031154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.031186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.031269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.031348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.031376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.031495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.031624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.031652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.031763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.031882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.031909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.031988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.032114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.032140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.032260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.032369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.032395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.032513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.032596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.032623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.032710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.032789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.032816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.032932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.033046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.033073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.033157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.033263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.033289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.033436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.033519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.033559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.832 [2024-11-26 23:20:28.033706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.033847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.832 [2024-11-26 23:20:28.033873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.832 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.033962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.034082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.034108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.034223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.034330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.034356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.034474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.034628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.034674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.034807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.034959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.035003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.035117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.035201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.035227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.035333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.035454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.035480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.035617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.035739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.035766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.035904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.036022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.036048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.036155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.036269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.036297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.036388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.036501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.036534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.036627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.036717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.036743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.036861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.037136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.037358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.037592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.037844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.037985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.038103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.038189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.038216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.038294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.038383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.038410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.038548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.038659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.038686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.038765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.038905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.038932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.039044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.039191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.039217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.039333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.039416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.039443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.039587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.039695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.039722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.039832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.039918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.039944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.040060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.040167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.833 [2024-11-26 23:20:28.040194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.833 qpair failed and we were unable to recover it. 00:28:01.833 [2024-11-26 23:20:28.040307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.040433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.040459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.040608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.040749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.040776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.040912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.041039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.041066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.041182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.041299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.041326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.041412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.041492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.041519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.041662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.041781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.041810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.041943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.042089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.042116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.042200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.042313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.042340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.042457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.042567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.042594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.042683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.042790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.042817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.042936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.043048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.043075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.043191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.043301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.043327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.043413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.043495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.043522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.043667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.043840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.043888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.044010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.044148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.044175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.044315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.044435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.044462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.044587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.044694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.044722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.044884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.045023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.045049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.045187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.045280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.045306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.045416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.045543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.045571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.045680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.045764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.045790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.045927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.046044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.046070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.046151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.046247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.046272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.047356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.047487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.047514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.047651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.047753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.047782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.048563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.048709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.048739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.048824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.048947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.048975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.049070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.049192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.049219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.834 qpair failed and we were unable to recover it. 00:28:01.834 [2024-11-26 23:20:28.049340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.834 [2024-11-26 23:20:28.049433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.049460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.049554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.049681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.049710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.049835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.049921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.049949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.050029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.050116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.050143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.050229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.050348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.050379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.050459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.050553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.050584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.050677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.050792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.050819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.050917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.051006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.051034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.051126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.051211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.051239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.051355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.051475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.051502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.051644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.051779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.051809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.051951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.052062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.052089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.052212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.052300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.052327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.052443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.052516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.052554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.052661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.052756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.052794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.052890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.053012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.053042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.053154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.053259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.053305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.053399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.053506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.053539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.053662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.053789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.053817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.053939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.054084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.054111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.054195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.054343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.054372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.054465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.054614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.054642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.054783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.054859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.054885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.054991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.055138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.055167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.055278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.055415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.055444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.055539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.055651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.055678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.055769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.055885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.055911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.056054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.056165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.056192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.056264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.056345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.056371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.835 qpair failed and we were unable to recover it. 00:28:01.835 [2024-11-26 23:20:28.056488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.835 [2024-11-26 23:20:28.056590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.056617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.056761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.056956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.056982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.057059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.057197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.057223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.057307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.057424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.057450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.057562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.057680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.057705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.057811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.057891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.057917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.058054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.058178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.058207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.058334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.058472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.058503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.058711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.058809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.058834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.058969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.059070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.059098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.059268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.059397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.059423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.059568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.059645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.059671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.059760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.059876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.059905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.060002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.060088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.060117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.060239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.060402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.060445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.060585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.060679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.060706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.060798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.060960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.060992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.061085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.061249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.061292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.061430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.061521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.061574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.061662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.061746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.061771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.061848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.061936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.061961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.062080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.062168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.062192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.062305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.062414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.062438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.062517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.062615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.062640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.062725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.062843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.062869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.062953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.063067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.063092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.063172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.063252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.063277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.063393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.063500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.063532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-11-26 23:20:28.063630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.063706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.836 [2024-11-26 23:20:28.063731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.063866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.063960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.063984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.064114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.064206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.064234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.064422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.064511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.064547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.064649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.064754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.064778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.064912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.064999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.065149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.065384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.065577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.065772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.065979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.066135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.066258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.066285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.066429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.066547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.066581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.066660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.066741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.066765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.066853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.066959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.066984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.067096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.067229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.067254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.067370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.067454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.067483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.067598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.067683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.067709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.067817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.067980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.068005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.068168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.068255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.068283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.068426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.068542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.068594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.068679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.068771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.068801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.068916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.069051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.069076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.069212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.069368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.069396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.069501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.069624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.069650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.069744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.069847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.069874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.070030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.070120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.070147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.070261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.070355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.070384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.070511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.070644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.070670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.070752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.070859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.070884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.837 qpair failed and we were unable to recover it. 00:28:01.837 [2024-11-26 23:20:28.071020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.837 [2024-11-26 23:20:28.071137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.071164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.071279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.071401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.071446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.071592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.071714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.071739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.071884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.071970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.071998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.072089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.072215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.072243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.072379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.072479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.072508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.072628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.072745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.072769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.072907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.073077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.073102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.073205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.073326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.073353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.073436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.073577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.073602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.073691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.073776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.073810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.073940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.074025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.074058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.074153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.074277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.074306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.074427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.074522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.074595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.074680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.074884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.074909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.075066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.075188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.075216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.075342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.075478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.075503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.075611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.075698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.075722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.075835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.075916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.075959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.076079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.076175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.076202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.076295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.076385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.076413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.076537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.076643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.076668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.076808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.076901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.076927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.077081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.077175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.077202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.077301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.077418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.077445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.838 qpair failed and we were unable to recover it. 00:28:01.838 [2024-11-26 23:20:28.077541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.077632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.838 [2024-11-26 23:20:28.077657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.077795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.077916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.077943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.078094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.078180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.078207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.078304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.078396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.078423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.078508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.078636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.078662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.078815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.078938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.078965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.079056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.079174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.079202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.079331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.079452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.079479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.079625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.079712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.079736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.079831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.079940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.079966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.080097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.080215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.080243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.080397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.080532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.080574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.080663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.080744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.080768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.080891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.080981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.081008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.081096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.081183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.081210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.081314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.081427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.081455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.081602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.081676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.081700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.081792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.081996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.082196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.082428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.082642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.082843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.082940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.083016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.083153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.083180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.083275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.083357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.083399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.083516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.083642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.083666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.083808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.083897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.083923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.084039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.084133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.084160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.084255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.084341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.084383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.084472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.084590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.084616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.839 qpair failed and we were unable to recover it. 00:28:01.839 [2024-11-26 23:20:28.084738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.839 [2024-11-26 23:20:28.084826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.084853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.084971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.085050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.085077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.085170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.085258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.085285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.085480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.085624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.085649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.085730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.085848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.085872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.085976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.086094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.086121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.086240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.086339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.086367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.086492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.086610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.086634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.086783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.086896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.086942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.087040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.087124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.087151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.087280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.087397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.087424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.087517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.087637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.087662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.087749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.087839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.087864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.087942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.088074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.088102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.088196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.088299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.088324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.088412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.088492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.088516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.088635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.088722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.088747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.088897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.089024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.089051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.089179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.089266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.089293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.089389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.089583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.089609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.089726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.089815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.089839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.089930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.090016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.090040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.090214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.090305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.090346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.090431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.090542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.090567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.090661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.090775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.090799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.090889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.091003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.091036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.091153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.091259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.091286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.091381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.091497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.091530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.091635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.091718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.840 [2024-11-26 23:20:28.091743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.840 qpair failed and we were unable to recover it. 00:28:01.840 [2024-11-26 23:20:28.091895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.091986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.092130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.092403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.092669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.092854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.092963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.093060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.093139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.093164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.093283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.093421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.093449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.093585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.093691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.093716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.093811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.093947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.093973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.094070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.094160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.094188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.094345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.094462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.094486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.094614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.094730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.094754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.094841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.094917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.094942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.095028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.095245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.095489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.095719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.095911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.095988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.096092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.096345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.096553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.096760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.096922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.097033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.097152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.097175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.097285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.097360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.097383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.097537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.097653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.097676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.097756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.097831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.097854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.097959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.098098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.098122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.098204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.098312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.098335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.841 [2024-11-26 23:20:28.098445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.098534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.841 [2024-11-26 23:20:28.098558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.841 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.098667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.098778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.098809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.098916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.099026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.099053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.099140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.099252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.099275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.099422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.099567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.099592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.099702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.099801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.099825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.099912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.100160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.100388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.100637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.100849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.100981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.101065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.101152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.101177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.101266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.101380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.101405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.101500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.101598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.101623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.101715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.101829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.101853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.101962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.102156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.102419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.102648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.102835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.102978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.103053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.103160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.103184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.103260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.103345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.103369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.103477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.103561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.103587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.103675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.103759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.103783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.103928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.104172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.104371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.104601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.104862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.104971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.842 [2024-11-26 23:20:28.105079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.105160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.842 [2024-11-26 23:20:28.105184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.842 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.105269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.105341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.105366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.105471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.105583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.105609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.105725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.105820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.105844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.105977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.106234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.106417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.106656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.106878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.106987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.107121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.107306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.107575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.107776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.107879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.108003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.108226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.108414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.108634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.108858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.108957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.109120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.109232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.109256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.109339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.109417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.109441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.109559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.109643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.109668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.109747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.109873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.109898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.110036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.110119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.110142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.110230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.110343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.110367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.110474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.110558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.110591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.110695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.110778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.843 [2024-11-26 23:20:28.110811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.843 qpair failed and we were unable to recover it. 00:28:01.843 [2024-11-26 23:20:28.110924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.111120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.111341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.111681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.111909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.111980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.112118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.112347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.112623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.112817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.112925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.113015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.113167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.113194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.113292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.113428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.113452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.113539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.113660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.113684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.113767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.113902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.113928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.114038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.114125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.114149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.114235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.115008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.115042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.115184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.115296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.115321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.115468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.115672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.115700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.115823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.115956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.115983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.116104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.116224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.116251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.116372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.116487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.116513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.116626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.116709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.116734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.116824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.116940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.116968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.117093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.117214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.117240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.117329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.117459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.117487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.117611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.117698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.117723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.117822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.117930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.117954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.118084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.118208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.118235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.118353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.118463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.118487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.844 qpair failed and we were unable to recover it. 00:28:01.844 [2024-11-26 23:20:28.118674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.844 [2024-11-26 23:20:28.118759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.118783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.118883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.118960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.118984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.119096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.119175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.119199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.119353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.119440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.119465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.119580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.119698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.119722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.119811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.119944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.119968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.120072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.120155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.120178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.120317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.120441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.120481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.120603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.120688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.120711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.120856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.120996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.121019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.121123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.121241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.121267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.121391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.121493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.121517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.121609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.122381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.122415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.122583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.122696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.122720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.122808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.122912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.122939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.123037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.123124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.123149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.123241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.123344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.123371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.123500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.123655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.123680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.123802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.123922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.123964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.124079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.124221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.124246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.124354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.124472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.124520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.124654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.124777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.124818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.124918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.125042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.125069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.125173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.125289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.125314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.125432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.125543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.125569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.125658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.125733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.125758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.125902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.126137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.126354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.126610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.126874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.126999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.127041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.845 qpair failed and we were unable to recover it. 00:28:01.845 [2024-11-26 23:20:28.127151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.845 [2024-11-26 23:20:28.127265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.127293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.127404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.127516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.127552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.127665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.127750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.127774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.127913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.128143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.128323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.128571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.128767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.128875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.128955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.129064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.129089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.129167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.129301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.129328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.129454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.129596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.129621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.129702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.129791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.129816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.129926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.130035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.130059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.130195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.130307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.130334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.130456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.130589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.130615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.130729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.130890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.130917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.131020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.131130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.131154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.131241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.131377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.131419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.131503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.131607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.131633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.131746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.131871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.131913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.132019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.132126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.132150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.132302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.132429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.132457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.132595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.132686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.132711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.132851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.132986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.133011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.133155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.133305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.133348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.133440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.133598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.133625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.133743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.133899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.133927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.134078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.134177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.134205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.134318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.134465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.134490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.134583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.134691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.134716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.134831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.134965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.134993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.846 qpair failed and we were unable to recover it. 00:28:01.846 [2024-11-26 23:20:28.135113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.135192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.846 [2024-11-26 23:20:28.135220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.135321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.135434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.135459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.135537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.135653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.135677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.135769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.135883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.135909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.136041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.136155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.136183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.136286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.136392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.136417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.136546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.136669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.136694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.136819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.136903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.136928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.137045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.137157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.137182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.137267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.137377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.137418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.137574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.137670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.137696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.137810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.137899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.137925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.138013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.138103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.138128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.138303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.138441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.138466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.138611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.138687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.138712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.138812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.138945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.138972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.139063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.139146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.139172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.139300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.139376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.139400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.139485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.139604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.139630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.139777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.139869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.139897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.140018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.140140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.140172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.140268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.140371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.140396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.140511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.140598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.140624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.140718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.140841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.140869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.140989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.141143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.141170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.141307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.141387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.141412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.141540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.141653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.141678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.847 [2024-11-26 23:20:28.141797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.141916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.847 [2024-11-26 23:20:28.141941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.847 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.142070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.142153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.142181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.142930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.143087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.143116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.143240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.143369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.143393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.143483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.143663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.143688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.143827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.143953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.143979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.144077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.144159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.144183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.144273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.144349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.144374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.144516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.144601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.144630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.144744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.144836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.144862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.144992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.145071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.145095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.145223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.145338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.145365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.145463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.145604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.145631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.145745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.145855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.145891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.146018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.146126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.146150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.146244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.146323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.146347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.146460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.146555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.146589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.848 [2024-11-26 23:20:28.146676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.146811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.848 [2024-11-26 23:20:28.146835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.848 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.146927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.147132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.147321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.147531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.147769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.147928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.148051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.148165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.148189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.148283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.148363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.148388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.148473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.148562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.148587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.148707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.148827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.148852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.148941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.149141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.149367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.149591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.149821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.149933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.150032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.150160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.150188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.150300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.150386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.150410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.150506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.150613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.150638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.150726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.150804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.150828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.150937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.151148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.151397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.151618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.849 qpair failed and we were unable to recover it. 00:28:01.849 [2024-11-26 23:20:28.151861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.849 [2024-11-26 23:20:28.151966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.152045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.152186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.152211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.152295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.152376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.152401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.152485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.152577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.152602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.152690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.152793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.152824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.152938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.153052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.153078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.153244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.153343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.153372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.153502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.153605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.153631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.153720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.153806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.153848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.153980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.154216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.154422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.154658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.154878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.154987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.155097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.155206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.155235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.155346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.155456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.155480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.155573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.155662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.155706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.155802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.155894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.850 [2024-11-26 23:20:28.155918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:01.850 qpair failed and we were unable to recover it. 00:28:01.850 [2024-11-26 23:20:28.156043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.156153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.156199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.144 qpair failed and we were unable to recover it. 00:28:02.144 [2024-11-26 23:20:28.156318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.156431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.156476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.144 qpair failed and we were unable to recover it. 00:28:02.144 [2024-11-26 23:20:28.156621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.156750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.156839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.144 qpair failed and we were unable to recover it. 00:28:02.144 [2024-11-26 23:20:28.157005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.157169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.157195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.144 qpair failed and we were unable to recover it. 00:28:02.144 [2024-11-26 23:20:28.157276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.157399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.157435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.144 qpair failed and we were unable to recover it. 00:28:02.144 [2024-11-26 23:20:28.157605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.157724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.157777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.144 qpair failed and we were unable to recover it. 00:28:02.144 [2024-11-26 23:20:28.157919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.158042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.144 [2024-11-26 23:20:28.158074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.144 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.158181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.158326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.158355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.158470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.158558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.158621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.158744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.158905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.158930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.159021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.159139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.159179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.159315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.159442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.159476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.159573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.159688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.159713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.159800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.159914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.159939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.160028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.160114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.160138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.160217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.160312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.160337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.160453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.160541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.160566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.160652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.160733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.160758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.160884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.161138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.161399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.161620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.161818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.161958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.162072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.162272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.162460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.162667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.162874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.162987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.163121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.163323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.163505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.163718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.163920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.163999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.164024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.164103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.164190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.164214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.164325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.164463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.164487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.164593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.164705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.145 [2024-11-26 23:20:28.164729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.145 qpair failed and we were unable to recover it. 00:28:02.145 [2024-11-26 23:20:28.164849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.164955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.164979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.165055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.165171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.165200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.165295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.165429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.165454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.165565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.165657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.165682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.165773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.165851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.165874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.165955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.166234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.166409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.166613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.166857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.166990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.167106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.167197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.167222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.167303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.167408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.167436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.167539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.167632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.167657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.167735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.167822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.167851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.167995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.168220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.168434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.168642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.168836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.168976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.169089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.169171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.169196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.169309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.169390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.169414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.169518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.169611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.169636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.169723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.169866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.169891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.169970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.170058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.170082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.170175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.170256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.146 [2024-11-26 23:20:28.170280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.146 qpair failed and we were unable to recover it. 00:28:02.146 [2024-11-26 23:20:28.170367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.170475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.170500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.170606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.170696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.170720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.170803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.170878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.170903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.170985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.171064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.171088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.171229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.171344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.171368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.171448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.171539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.171583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.171689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.171773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.171815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.171915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.172137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.172378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.172603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.172787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.172922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.173036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.173227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.173413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.173658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.173864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.173999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.174077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.174191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.174215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.174329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.174414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.174439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.174517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.174604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.174628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.174712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.174782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.174808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.174884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.175020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.175045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.175154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.175230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.175254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.175333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.175416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.175439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.175518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.175651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.147 [2024-11-26 23:20:28.175678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.147 qpair failed and we were unable to recover it. 00:28:02.147 [2024-11-26 23:20:28.175767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.175890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.175917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.176003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.176151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.176178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.176308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.176405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.176448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.176541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.176628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.176654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.176736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.176848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.176871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.176952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.177056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.177084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.177209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.177294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.177321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.177442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.177580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.177606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.177684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.177787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.177815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.177910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.178187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.178436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.178640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.178861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.178982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.179102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.179193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.179221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.179308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.179433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.179460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.179600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.179683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.179707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.179785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.179954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.179995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.180104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.180226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.180253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.180377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.180493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.180521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.180661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.180736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.180761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.180912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.180999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.181026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.181181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.181273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.181301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.181440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.181522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.181556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.148 qpair failed and we were unable to recover it. 00:28:02.148 [2024-11-26 23:20:28.181666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.181774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.148 [2024-11-26 23:20:28.181798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.181933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.182069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.182096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.182248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.182405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.182432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.182563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.182688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.182712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.182849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.182934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.182959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.183103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.183200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.183227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.183356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.183445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.183472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.183565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.183659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.183684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.183809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.183886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.183911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.184035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.184155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.184197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.184356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.184459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.184484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.184604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.184695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.184720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.184805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.184939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.184980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.185073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.185202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.185230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.185330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.185456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.185481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.185567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.185658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.185682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.185784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.185867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.185893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.186042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.186136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.186163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.186259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.186338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.186366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.149 qpair failed and we were unable to recover it. 00:28:02.149 [2024-11-26 23:20:28.186485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.149 [2024-11-26 23:20:28.186601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.186626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.186766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.186887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.186911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.187020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.187112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.187140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.187260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.187356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.187383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.187495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.187624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.187649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.187754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.187835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.187859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.187970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.188043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.188067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.188200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.188349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.188373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.188483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.188597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.188622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.188734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.188847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.188870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.188977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.189144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.189169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.189311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.189478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.189516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.189640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.189752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.189777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.189889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.190025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.190049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.190143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.190257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.190297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.190432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.190553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.190581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.190694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.190801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.190841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.190946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.191035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.191059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.191177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.191309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.191337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.191430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.191550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.191579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.191725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.191825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.191858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.191995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.192108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.192133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.192215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.192324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.192349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.192484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.192625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.192651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.192759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.192871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.150 [2024-11-26 23:20:28.192896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.150 qpair failed and we were unable to recover it. 00:28:02.150 [2024-11-26 23:20:28.193014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.193100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.193125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.193267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.193380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.193408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.193536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.193666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.193690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.193781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.193925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.193949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.194062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.194196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.194221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.194323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.194439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.194466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.194617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.194727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.194752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.194868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.195029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.195054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.195168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.195308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.195333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.195445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.195533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.195559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.195652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.195760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.195784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.195971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.196048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.196073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.196185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.196296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.196321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.196482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.196608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.196635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.196724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.196883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.196911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.196990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.197118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.197143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.197257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.197343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.197368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.197538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.197650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.197677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.197804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.197944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.197968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.198104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.198184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.198224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.198340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.198449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.198474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.198560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.198648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.198672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.198791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.198890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.198917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.199018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.199098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.199122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.151 [2024-11-26 23:20:28.199238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.199356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.151 [2024-11-26 23:20:28.199380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.151 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.199510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.199617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.199642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.199759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.199835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.199859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.199994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.200101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.200124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.200209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.200320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.200345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.200477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.200619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.200644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.200739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.200888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.200913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.200995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.201131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.201156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.201254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.201335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.201360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.201493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.201611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.201636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.201754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.201884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.201911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.202032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.202177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.202204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.202333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.202416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.202440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.202581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.202667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.202691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.202778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.202920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.202945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.203018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.203123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.203147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.203227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.203299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.203323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.203419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.203535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.203561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.203674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.203787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.203811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.203923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.204119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.204312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.204535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.204846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.204975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.152 [2024-11-26 23:20:28.205002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.152 qpair failed and we were unable to recover it. 00:28:02.152 [2024-11-26 23:20:28.205143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.205222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.205246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.205358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.205469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.205510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.205660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.205755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.205779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.205862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.206203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.206390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.206622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.206810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.206952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.207059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.207169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.207198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.207317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.207397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.207422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.207538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.207657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.207681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.207804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.207966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.207993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.208126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.208213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.208238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.208349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.208458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.208482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.208608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.208775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.208799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.208896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.208993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.209019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.209173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.209310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.209335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.209452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.209542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.209585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.209672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.209795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.209819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.209969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.210088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.210113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.210229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.210306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.210331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.210424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.210541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.210593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.210704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.210809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.210833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.210938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.211032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.211059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.211185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.211260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.153 [2024-11-26 23:20:28.211285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.153 qpair failed and we were unable to recover it. 00:28:02.153 [2024-11-26 23:20:28.211417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.211530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.211556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.211668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.211784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.211809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.211947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.212135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.212343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.212642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.212856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.212993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.213077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.213153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.213177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.213285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.213391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.213416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.213533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.213655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.213680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.213767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.213853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.213877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.213972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.214077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.214101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.214176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.214282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.214309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.214469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.214619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.214644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.214750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.214847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.214875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.215010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.215242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.215461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.215645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.215851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.215992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.216016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.216189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.216300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.216326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.216442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.216593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.216618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.216700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.216812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.216854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.216989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.217078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.217103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.217216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.217397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.217421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.154 qpair failed and we were unable to recover it. 00:28:02.154 [2024-11-26 23:20:28.217548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.154 [2024-11-26 23:20:28.217660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.217689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.217812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.217944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.217968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.218054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.218164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.218189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.218305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.218448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.218475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.218653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.218741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.218766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.218854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.218989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.219017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.219142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.219228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.219252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.219356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.219482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.219508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.219673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.219791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.219816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.219896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.220034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.220063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.220149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.220225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.220249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.220361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.220466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.220508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.220656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.220766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.220791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.220872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.221016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.221041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.221150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.221229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.221253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.221328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.221486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.221534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.221621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.221712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.221736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.221915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.222002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.222027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.222106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.222194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.222218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.222349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.222463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.155 [2024-11-26 23:20:28.222491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.155 qpair failed and we were unable to recover it. 00:28:02.155 [2024-11-26 23:20:28.222618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.222756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.222781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.222908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.223030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.223058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.223194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.223305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.223330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.223425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.223581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.223606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.223755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.223841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.223868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.223996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.224113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.224154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.224295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.224381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.224405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.224570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.224671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.224697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.224816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.224950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.224978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.225111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.225219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.225245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.225333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.225445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.225470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.225566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.225683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.225708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.225841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.225974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.226002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.226120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.226260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.226284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.226423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.226566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.226608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.226759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.226873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.226912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.226997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.227218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.227483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.227711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.227906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.227985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.228010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.228116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.228246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.228273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.228376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.228513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.228563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.228706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.228841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.228868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.228994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.229116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.229143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.156 qpair failed and we were unable to recover it. 00:28:02.156 [2024-11-26 23:20:28.229270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.229393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.156 [2024-11-26 23:20:28.229420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.229514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.229630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.229655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.229730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.229855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.229882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.229980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.230129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.230156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.230256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.230360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.230385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.230493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.230632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.230658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.230769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.230871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.230896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.231012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.231179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.231206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.231335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.231449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.231474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.231589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.231713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.231737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.231862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.231945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.231971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.232132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.232270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.232294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.232429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.232530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.232574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.232690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.232798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.232822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.232953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.233064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.233091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.233184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.233271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.233304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.233427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.233551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.233579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.233758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.233868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.233892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.233987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.234108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.234135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.234287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.234408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.234448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.234558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.234681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.234723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.234855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.234941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.234965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.235076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.235180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.235204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.157 qpair failed and we were unable to recover it. 00:28:02.157 [2024-11-26 23:20:28.235294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.235431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.157 [2024-11-26 23:20:28.235459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.235605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.235683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.235708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.235788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.235897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.235921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.236017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.236143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.236184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.236276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.236415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.236443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.236582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.236692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.236717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.236800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.236908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.236932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.237043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.237195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.237222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.237374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.237487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.237514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.237631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.237717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.237742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.237827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.237942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.237966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.238040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.238152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.238176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.238325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.238465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.238490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.238666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.238743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.238767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.238847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.238928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.238952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.239025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.239145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.239172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.239297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.239422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.239450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.239543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.239704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.239729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.239855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.239962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.239986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.240113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.240273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.240297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.240413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.240513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.240546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.240675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.240755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.240780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.240887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.240963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.240987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.158 qpair failed and we were unable to recover it. 00:28:02.158 [2024-11-26 23:20:28.241104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.241178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.158 [2024-11-26 23:20:28.241203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.241320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.241476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.241503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.241608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.241690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.241714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.241822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.241932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.241956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.242045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.242152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.242185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.242308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.242418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.242443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.242552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.242714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.242740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.242873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.242982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.243005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.243091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.243226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.243249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.243428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.243541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.243585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.243665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.243780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.243805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.243933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.244143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.244353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.244612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.244811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.244945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.245065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.245184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.245211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.245303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.245412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.245438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.245523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.245616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.245643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.245783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.245896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.245919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.246001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.246145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.246190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.246307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.246439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.246475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.246653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.246744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.246769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.246882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.246995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.247019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.247132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.247268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.247293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.159 [2024-11-26 23:20:28.247408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.247497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.159 [2024-11-26 23:20:28.247523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.159 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.247614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.247738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.247762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.247909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.247995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.248020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.248106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.248211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.248235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.248344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.248422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.248447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.248564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.248707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.248736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.248848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.248987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.249094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.249312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.249563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.249811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.249974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.250062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.250145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.250169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.250243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.250379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.250403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.250514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.250648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.250673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.250762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.250847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.250871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.250955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.251067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.251091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.251179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.251297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.251321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.251431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.251546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.251570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.251681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.251819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.251843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.251962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.252046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.252070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.252173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.252255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.160 [2024-11-26 23:20:28.252280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.160 qpair failed and we were unable to recover it. 00:28:02.160 [2024-11-26 23:20:28.252370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.252483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.252508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.252607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.252684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.252708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.252818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.252933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.252956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.253039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.253130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.253154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.253266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.253376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.253400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.253483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.253576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.253601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.253717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.253832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.253857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.253941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.254192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.254423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.254669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.254910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.254987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.255125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.255351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.255596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.255818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.255916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.256024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.256225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.256447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.256665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.256883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.256985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.257010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.257141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.257233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.257259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.161 qpair failed and we were unable to recover it. 00:28:02.161 [2024-11-26 23:20:28.257383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.161 [2024-11-26 23:20:28.257498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.257533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.257672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.257783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.257808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.257913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.258120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.258394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.258662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.258865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.258990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.259099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.259289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.259486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.259713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.259816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.259933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.260084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.260108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.260241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.260364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.260391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.260487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.260598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.260628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.260734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.260823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.260851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.260938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.261023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.261049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.261169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.261294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.261321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.261411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.261537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.261562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.261677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.261758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.261782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.261880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.262056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.262083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.262207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.262324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.262350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.262473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.262607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.262632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.262771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.262853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.262877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.262975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.263072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.162 [2024-11-26 23:20:28.263099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.162 qpair failed and we were unable to recover it. 00:28:02.162 [2024-11-26 23:20:28.263241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.263398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.263425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.263511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.263624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.263649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.263787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.263879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.263902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.264017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.264098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.264122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.264288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.264409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.264436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.264581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.264696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.264721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.264833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.264959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.264986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.265106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.265204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.265231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.265355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.265484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.265509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.265631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.265735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.265759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.265880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.266005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.266033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.266132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.266251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.266279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.266421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.266533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.266559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.266679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.266751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.266776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.266939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.267059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.267086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.267212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.267332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.267359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.267482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.267622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.267646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.267739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.267856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.267882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.268006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.268166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.268194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.268348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.268474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.268501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.268655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.268771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.268812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.268931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.269050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.269078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.269186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.269288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.269315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.269445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.269559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.269601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.163 [2024-11-26 23:20:28.269691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.269773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.163 [2024-11-26 23:20:28.269815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.163 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.269966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.270092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.270118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.270202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.270349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.270376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.270521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.270626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.270649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.270766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.270858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.270885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.271007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.271118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.271145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.271307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.271477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.271502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.271627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.271764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.271804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.271900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.272171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.272444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.272700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.272888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.272996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.273123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.273237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.273261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.273372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.273522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.273584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.273662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.273743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.273767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.273883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.273967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.273995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.274137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.274257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.274283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.274444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.274520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.274553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.274686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.274806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.274832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.274983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.275067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.275095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.275267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.275376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.275401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.275478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.275558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.275582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.275700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.275803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.275826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.164 qpair failed and we were unable to recover it. 00:28:02.164 [2024-11-26 23:20:28.275967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.276069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.164 [2024-11-26 23:20:28.276095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.276179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.276261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.276288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.276428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.276567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.276593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.276734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.276847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.276875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.277031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.277148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.277176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.277296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.277428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.277453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.277540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.277648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.277672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.277761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.277895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.277919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.278036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.278121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.278144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.278268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.278388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.278429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.278503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.278629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.278653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.278795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.278874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.278915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.279032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.279132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.279156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.279249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.279359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.279383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.279497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.279615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.279641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.279753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.279863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.279888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.279969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.280133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.280160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.280282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.280403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.280431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.280585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.280725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.280750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.280858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.281129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.281321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.281565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.281827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.281923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.165 qpair failed and we were unable to recover it. 00:28:02.165 [2024-11-26 23:20:28.282066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.282146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.165 [2024-11-26 23:20:28.282189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.282284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.282402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.282428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.282520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.282632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.282656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.282746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.282882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.282907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.283034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.283192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.283216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.283321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.283441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.283483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.283660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.283764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.283789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.283918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.284034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.284061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.284148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.284247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.284275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.284360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.284486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.284514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.284658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.284770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.284794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.284950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.285049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.285076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.285200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.285294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.285319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.285450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.285582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.285611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.285770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.285847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.285871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.285954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.286118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.286145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.286244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.286363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.286389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.286507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.286640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.286664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.286778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.286890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.286915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.166 [2024-11-26 23:20:28.287052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.287152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.166 [2024-11-26 23:20:28.287197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.166 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.287318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.287404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.287427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.287548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.287636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.287677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.287818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.287927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.287951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.288062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.288171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.288195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.288327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.288470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.288494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.288615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.288728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.288752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.288856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.288969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.288992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.289097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.289219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.289245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.289346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.289434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.289461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.289571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.289700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.289724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.289814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.289909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.289934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.290063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.290148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.290176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.290294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.290410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.290437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.290577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.290667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.290691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.290811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.290927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.290951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.291127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.291210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.291234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.291379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.291530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.291558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.291681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.291803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.291827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.291954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.292066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.292090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.292173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.292314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.292340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.292478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.292667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.292693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.292782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.292905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.292931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.293040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.293121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.293145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.167 qpair failed and we were unable to recover it. 00:28:02.167 [2024-11-26 23:20:28.293219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.167 [2024-11-26 23:20:28.293334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.293357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.293467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.293574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.293599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.293707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.293851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.293875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.293950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.294039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.294063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.294178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.294312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.294339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.294507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.294632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.294656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.294768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.294894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.294920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.295057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.295161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.295184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.295294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.295377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.295420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.295536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.295647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.295670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.295781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.295892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.295933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.296068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.296204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.296227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.296361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.296486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.296547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.296668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.296807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.296830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.296970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.297098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.297122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.297230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.297341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.297366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.297514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.297628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.297654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.297741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.297876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.297905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.298001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.298115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.298143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.298282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.298387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.298412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.298544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.298662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.298691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.298814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.298929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.298968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.299072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.299195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.299238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.299353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.299438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.299463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.168 [2024-11-26 23:20:28.299564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.299652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.168 [2024-11-26 23:20:28.299677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.168 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.299760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.299869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.299894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.300033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.300117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.300145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.300270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.300380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.300410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.300529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.300640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.300665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.300753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.300889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.300931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.301043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.301157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.301185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.301283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.301385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.301413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.301542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.301670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.301695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.301808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.301888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.301913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.302002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.302114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.302139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.302282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.302392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.302417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.302498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.302621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.302663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.302782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.302896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.302929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.303064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.303199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.303225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.303315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.303432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.303458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.303573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.303697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.303726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.303854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.304003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.304031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.304127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.304255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.304282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.304446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.304564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.304590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.304697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.304783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.304808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.304901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.305012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.305038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.305155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.305241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.305282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.305412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.305552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.305578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.305731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.305856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.305881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.306011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.306099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.306127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.306275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.306391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.306432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.306589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.306697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.169 [2024-11-26 23:20:28.306723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.169 qpair failed and we were unable to recover it. 00:28:02.169 [2024-11-26 23:20:28.306868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.306987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.307015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.307147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.307289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.307315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.307444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.307604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.307634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.307742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.307850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.307876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.308026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.308135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.308161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.308273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.308430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.308458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.308562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.308738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.308763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.308846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.308985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.309009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.309093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.309212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.309236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.309376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.309477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.309504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.309632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.309750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.309778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.309941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.310028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.310054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.310182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.310302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.310331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.310452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.310600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.310629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.310757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.310890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.310915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.311057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.311170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.311195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.311281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.311397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.311440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.311544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.311660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.311688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.311794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.311884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.311911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.312052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.312141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.312176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.312288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.312401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.312444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.312585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.312688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.312713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.312795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.312869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.170 [2024-11-26 23:20:28.312894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.170 qpair failed and we were unable to recover it. 00:28:02.170 [2024-11-26 23:20:28.313007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.313114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.313139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.313253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.313334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.313360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.313471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.313570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.313615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.313708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.313830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.313856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.313966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.314051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.314077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.314221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.314345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.314374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.314498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.314629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.314655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.314769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.314896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.314922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.315003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.315097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.315123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.315256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.315352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.315395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.315508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.315620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.315647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.315759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.315872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.315914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.316017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.316099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.316124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.316243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.316356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.316386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.316502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.316599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.316625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.316706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.316819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.316844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.316963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.317042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.317066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.317175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.317287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.317315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.317394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.317533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.317559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.317668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.317745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.317770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.171 [2024-11-26 23:20:28.317880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.318022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.171 [2024-11-26 23:20:28.318046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.171 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.318200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.318314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.318342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.318440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.318562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.318591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.318742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.318874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.318902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.319064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.319155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.319181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.319312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.319461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.319502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.319628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.319707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.319734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.319867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.319958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.319985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.320108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.320221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.320247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.320363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.320495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.320530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.320646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.320732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.320757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.320863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.320975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.321103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.321322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.321605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.321829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.321936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.322042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.322124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.322149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.322269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.322402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.322430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.322522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.322708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.322734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.322826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.322968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.322993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.323136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.323273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.323314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.323439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.323559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.323589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.323682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.323834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.323862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.323954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.324046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.324088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.172 qpair failed and we were unable to recover it. 00:28:02.172 [2024-11-26 23:20:28.324200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.172 [2024-11-26 23:20:28.324285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.324310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.324388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.324497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.324522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.324619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.324731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.324773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.324895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.325010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.325039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.325174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.325312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.325338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.325488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.325611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.325639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.325773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.325862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.325889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.326017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.326128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.326156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.326263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.326374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.326400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.326482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.326629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.326655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.326757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.326876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.326917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.327025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.327119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.327145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.327282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.327370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.327412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.327559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.327670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.327697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.327814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.327921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.327949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.328061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.328225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.328250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.328387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.328508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.328540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.328691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.328834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.328859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.329007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.329110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.329139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.329273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.329380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.329406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.329488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.329604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.329634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.329750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.329838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.329863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.330004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.330158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.330186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.173 qpair failed and we were unable to recover it. 00:28:02.173 [2024-11-26 23:20:28.330335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.173 [2024-11-26 23:20:28.330451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.330476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.330590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.330668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.330694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.330778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.330922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.330950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.331047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.331207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.331232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.331373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.331516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.331551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.331640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.331727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.331752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.331882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.332041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.332069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.332160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.332299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.332326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.332454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.332540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.332566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.332683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.332829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.332855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.332965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.333085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.333113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.333261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.333418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.333444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.333555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.333641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.333684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.333818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.333956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.333981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.334118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.334243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.334271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.334446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.334579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.334605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.334720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.334856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.334884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.335021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.335131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.335156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.335309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.335420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.335446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.335568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.335691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.335720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.335838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.335954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.335983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.336112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.336206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.336233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.336306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.336383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.336409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.336515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.336648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.336675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.174 [2024-11-26 23:20:28.336805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.336928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.174 [2024-11-26 23:20:28.336955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.174 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.337125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.337239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.337265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.337375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.337460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.337489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.337634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.337712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.337739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.337828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.337961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.337990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.338156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.338245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.338270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.338367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.338515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.338568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.338679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.338801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.338829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.338948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.339074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.339117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.339202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.339320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.339344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.339507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.339619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.339649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.339772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.339898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.339924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.340008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.340128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.340175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.340332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.340438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.340464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.340604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.340709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.340738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.340872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.341011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.341037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.341212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.341325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.341350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.341474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.341600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.341627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.341710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.341796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.341820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.341913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.342121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.342346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.342552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.342833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.342985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.175 qpair failed and we were unable to recover it. 00:28:02.175 [2024-11-26 23:20:28.343125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.343213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.175 [2024-11-26 23:20:28.343242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.343323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.343430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.343456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.343572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.343650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.343694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.343812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.343904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.343945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.344026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.344112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.344137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.344264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.344377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.344404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.344484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.344607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.344635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.344767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.344904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.344930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.345018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.345128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.345156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.345273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.345388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.345414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.345547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.345669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.345701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.345794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.345885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.345914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.346078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.346153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.346179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.346295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.346398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.346424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.346532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.346658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.346686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.346786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.346922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.346949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.347060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.347142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.347168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.347281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.347389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.347414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.347511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.347659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.347685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.347795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.347916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.347944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.348101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.348220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.348246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.348390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.348508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.348559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.348672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.348749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.348774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.348882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.349021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.349049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.349203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.349316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.176 [2024-11-26 23:20:28.349344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.176 qpair failed and we were unable to recover it. 00:28:02.176 [2024-11-26 23:20:28.349506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.349632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.349658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.349801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.349921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.349950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.350082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.350189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.350225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.350302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.350413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.350440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.350554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.350642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.350668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.350746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.350821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.350847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.351027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.351170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.351196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.351343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.351482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.351509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.351632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.351740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.351766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.351890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.352075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.352128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.352247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.352371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.352414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.352506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.352587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.352613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.352725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.352837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.352862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.352952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.353040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.353067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.353160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.353285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.353313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.353434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.353518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.353554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.353699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.353790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.353818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.353927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.354071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.354097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.354228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.354341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.354369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.354449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.354560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.354603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.177 [2024-11-26 23:20:28.354722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.354834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.177 [2024-11-26 23:20:28.354860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.177 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.354971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.355081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.355109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.355205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.355354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.355383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.355479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.355609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.355636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.355725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.355811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.355836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.355946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.356084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.356112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.356272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.356427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.356456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.356554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.356665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.356696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.356837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.357007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.357032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.357150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.357292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.357317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.357401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.357503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.357534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.357626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.357757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.357785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.357920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.358037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.358062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.358206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.358306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.358333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.358455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.358541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.358570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.358661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.358754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.358780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.358895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.359005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.359035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.359126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.359212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.359240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.359331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.359455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.359483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.359583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.359728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.359770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.359886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.360024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.360049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.360189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.360272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.360299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.360420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.360508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.360543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.360670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.360763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.360807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.360951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.361058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.361083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.361210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.361329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.361358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.361448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.361590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.178 [2024-11-26 23:20:28.361615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.178 qpair failed and we were unable to recover it. 00:28:02.178 [2024-11-26 23:20:28.361729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.361818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.361844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.361957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.362072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.362098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.362176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.362287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.362313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.362476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.362577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.362606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.362739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.362817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.362842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.362946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.363058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.363084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.363213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.363325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.363353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.363477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.363575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.363605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.363693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.363773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.363801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.363928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.364067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.364093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.364248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.364368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.364397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.364499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.364653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.364682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.364828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.364916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.364941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.365058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.365165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.365191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.365269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.365352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.365378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.365460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.365569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.365610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.365709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.365825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.365854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.365954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.366188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.366408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.366651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.366873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.366979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.367004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.367086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.367168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.367194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.179 [2024-11-26 23:20:28.367307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.367379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.179 [2024-11-26 23:20:28.367422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.179 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.367545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.367642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.367668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.367752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.367869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.367895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.368024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.368119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.368146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.368280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.368409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.368437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.368598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.368693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.368736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.368828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.368943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.368969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.369098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.369228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.369254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.369345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.369473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.369502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.369603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.369690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.369718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.369823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.369910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.369935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.370023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.370094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.370120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.370230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.370368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.370394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.370506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.370651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.370677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.370759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.370849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.370874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.371014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.371144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.371173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.371275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.371399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.371427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.371522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.371691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.371726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.371834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.371949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.371975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.372077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.372223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.372268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.372382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.372552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.372582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.372687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.372814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.372841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.372978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.373117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.373143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.373274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.373390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.373416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.373573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.373723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.373751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.373873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.373969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.374011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-26 23:20:28.374098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.374208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.180 [2024-11-26 23:20:28.374233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.374347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.374450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.374478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.374588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.374663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.374688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.374830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.374981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.375006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.375105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.375243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.375268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.375440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.375557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.375582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.375692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.375773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.375801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.375895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.376009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.376044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.376207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.376315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.376342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.376468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.376611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.376637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.376720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.376825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.376850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.376984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.377078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.377106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.377225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.377306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.377332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.377444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.377559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.377588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.377735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.377860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.377889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.377987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.378083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.378109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.378241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.378322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.378347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.378481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.378624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.378650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.378729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.378856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.378897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.379042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.379137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.379166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.379276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.379386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.379411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.379549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.379643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.379672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.379799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.379888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.379917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.380039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.380199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.380224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-26 23:20:28.380315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.380393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.181 [2024-11-26 23:20:28.380418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.380516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.380633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.380661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.380775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.380895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.380923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.381022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.381143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.381187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.381285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.381371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.381399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.381535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.381685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.381710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.381829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.381936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.381961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.382043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.382181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.382206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.382298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.382383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.382410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.382492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.382608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.382637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.382721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.382835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.382863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.382961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.383050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.383078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.383208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.383325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.383351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.383446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.383585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.383614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.383712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.383814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.383857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.383974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.384087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.384130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.384243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.384360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.384385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.384498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.384605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.384633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.384767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.384892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.384924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.385075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.385205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.182 [2024-11-26 23:20:28.385230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-26 23:20:28.385322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.385410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.385435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.385513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.385638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.385666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.385817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.385938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.385963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.386078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.386193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.386218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.386301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.386437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.386463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.386621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.386718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.386746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.386833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.386939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.386965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.387058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.387186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.387214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.387348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.387486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.387514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.387643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.387724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.387758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.387899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.388051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.388080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.388201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.388314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.388342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.388476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.388586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.388613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.388771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.388862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.388890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.389054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.389166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.389192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.389309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.389418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.389447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.389617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.389731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.389758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.389859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.389981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.390010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.390128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.390241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.390268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.390372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.390495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.390520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.390623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.390708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.390733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.390808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.390990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.391015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.391142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.391273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.391300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.183 [2024-11-26 23:20:28.391384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.391504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.183 [2024-11-26 23:20:28.391554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.183 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.391643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.391780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.391805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.391913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.392009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.392038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.392161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.392275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.392304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.392418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.392578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.392604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.392714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.392825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.392850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.392984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.393078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.393106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.393205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.393325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.393352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.393494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.393588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.393614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.393733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.393820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.393845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.393944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.394047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.394076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.394243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.394318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.394344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.394483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.394645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.394675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.394763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.394863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.394888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.394969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.395046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.395072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.395169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.395294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.395322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.395402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.395546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.395573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.395689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.395817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.395842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.395996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.396091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.396118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.396271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.396392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.396421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.396576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.396723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.396748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.396835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.396940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.396966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.397058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.397169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.397195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.397285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.397430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.397455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.397563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.397648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.397692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.397822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.397961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.184 [2024-11-26 23:20:28.397986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.184 qpair failed and we were unable to recover it. 00:28:02.184 [2024-11-26 23:20:28.398103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.398189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.398235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.398362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.398458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.398486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.398601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.398731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.398760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.398867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.398952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.398978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.399065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.399170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.399198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.399325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.399456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.399482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.399576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.399681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.399706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.399792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.399926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.399951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.400068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.400199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.400227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.400313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.400439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.400482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.400618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.400743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.400777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.400939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.401146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.401393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.401617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.401808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.401971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.402110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.402233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.402260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.402349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.402449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.402477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.402591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.402723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.402748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.402826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.402939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.402964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.403055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.403170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.403196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.403335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.403452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.403480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.403585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.403700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.403728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.185 [2024-11-26 23:20:28.403863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.403961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.185 [2024-11-26 23:20:28.403986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.185 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.404127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.404225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.404253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.404339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.404464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.404488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.404589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.404727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.404752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.404838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.404976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.405082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.405338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.405599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.405854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.405990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.406075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.406158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.406183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.406325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.406433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.406458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.406543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.406656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.406682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.406816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.406933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.406959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.407071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.407148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.407173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.407289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.407396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.407422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.407536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.407647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.407673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.407786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.407890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.407915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.408004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.408140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.408182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.408297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.408387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.408430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.408541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.408703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.408728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.408843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.408985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.409010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.409116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.409207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.409246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.409330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.409451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.409478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.409580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.409735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.409763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.186 qpair failed and we were unable to recover it. 00:28:02.186 [2024-11-26 23:20:28.409897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.186 [2024-11-26 23:20:28.410045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.410070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.410237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.410397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.410423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.410506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.410627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.410653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.410744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.410829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.410864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.410984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.411078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.411104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.411237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.411360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.411389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.411508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.411637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.411665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.411791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.411904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.411930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.412038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.412180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.412206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.412373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.412451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.412478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.412583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.412732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.412759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.412910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.413191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.413432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.413666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.413883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.413972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.414001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.414101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.414211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.414237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.414367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.414518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.414556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.414681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.414820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.414847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.414940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.415089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.415117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.415254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.415333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.415358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.415431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.415555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.415582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.415669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.415842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.415868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.415990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.416129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.187 [2024-11-26 23:20:28.416154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.187 qpair failed and we were unable to recover it. 00:28:02.187 [2024-11-26 23:20:28.416292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.416402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.416428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.416577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.416679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.416708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.416833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.416965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.416991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.417095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.417233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.417261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.417366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.417471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.417496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.417585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.417716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.417744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.417870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.417985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.418013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.418138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.418258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.418286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.418422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.418512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.418545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.418673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.418827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.418869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.418956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.419033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.419058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.419190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.419313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.419341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.419488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.419627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.419654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.419829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.419928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.419956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.420107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.420227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.420256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.420405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.420555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.420598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.420749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.420835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.420862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.421070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.421183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.421209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.421291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.421384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.421410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.421550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.421650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.421679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.421780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.421868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.421895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.188 qpair failed and we were unable to recover it. 00:28:02.188 [2024-11-26 23:20:28.422026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.188 [2024-11-26 23:20:28.422128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.422156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.422277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.422400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.422429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.422582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.422670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.422696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.422819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.422905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.422930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.423074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.423179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.423208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.423337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.423433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.423476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.423566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.423680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.423705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.423799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.423877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.423903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.424007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.424099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.424125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.424251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.424349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.424377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.424475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.424584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.424614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.424714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.424794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.424821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.424900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.425060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.425088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.425205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.425334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.425362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.425484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.425589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.425619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.425728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.425844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.425871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.426001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.426166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.426192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.426307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.426443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.426472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.426590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.426728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.426754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.426866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.426972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.426998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.427161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.427257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.427290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.427379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.427484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.427510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.427595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.427723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.427751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.427880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.427970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.427996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.428087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.428230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.428255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.428383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.428508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.428542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.428668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.428766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.189 [2024-11-26 23:20:28.428794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.189 qpair failed and we were unable to recover it. 00:28:02.189 [2024-11-26 23:20:28.428912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.429027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.429053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.429188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.429339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.429367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.429465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.429548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.429592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.429680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.429787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.429813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.429893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.430033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.430059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.430235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.430314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.430339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.430415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.430496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.430522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.430639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.430770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.430799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.430940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.431081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.431107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.431248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.431368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.431397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.431512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.431675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.431703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.431802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.431925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.431953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.432090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.432177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.432203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.432352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.432435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.432463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.432598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.432690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.432717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.432844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.432960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.433000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.433146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.433235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.433260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.433369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.433452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.433494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.433624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.433705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.433730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.433870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.433976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.434019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.434137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.434221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.434246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.434359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.434461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.434490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.434658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.434750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.434775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.434865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.435012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.435039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.435170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.435259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.435284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.435437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.435563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.435592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.190 qpair failed and we were unable to recover it. 00:28:02.190 [2024-11-26 23:20:28.435707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.435809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.190 [2024-11-26 23:20:28.435834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.435970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.436155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.436407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.436633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.436867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.436976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.437066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.437142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.437168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.437282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.437372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.437414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.437567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.437733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.437759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.437902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.438189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.438459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.438704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.438911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.438996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.439133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.439339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.439561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.439772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.439880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.439992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.440138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.440168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.440286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.440401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.440425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.440511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.440619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.440644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.440732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.440868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.440893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.441002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.441111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.441137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.441248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.441360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.441402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.441491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.441582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.441610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.441699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.441830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.441858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.441956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.442095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.442121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.442222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.442383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.442412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.191 qpair failed and we were unable to recover it. 00:28:02.191 [2024-11-26 23:20:28.442580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.442711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.191 [2024-11-26 23:20:28.442746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.442880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.443175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.443396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.443595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.443818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.443981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.444087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.444191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.444217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.444296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.444376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.444401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.444539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.444615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.444641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.444783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.444870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.444896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.445006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.445115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.445141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.445275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.445435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.445464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.445575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.445668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.445694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.445799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.445938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.445964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.446047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.446131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.446156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.446310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.446475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.446501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.446625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.446735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.446760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.446890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.447014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.447042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.447171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.447278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.447303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.447376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.447517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.447568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.447681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.447760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.447801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.447928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.448051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.448094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.448203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.448291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.448317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.448430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.448556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.448584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.448713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.448801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.448828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.448953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.449059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.449084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.449224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.449306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.449332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.449472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.449584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.192 [2024-11-26 23:20:28.449610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.192 qpair failed and we were unable to recover it. 00:28:02.192 [2024-11-26 23:20:28.449726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.449807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.449833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.449949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.450039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.450082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.450186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.450272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.450298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.450381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.450533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.450578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.450692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.450768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.450809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.450901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.451033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.451058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.451140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.451220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.451245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.451319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.451429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.451455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.451573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.451704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.451733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.451866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.452012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.452038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.452153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.452259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.452285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.452392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.452503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.452556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.452645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.452774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.452800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.452881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.453061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.453088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.453199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.453351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.453376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.453522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.453671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.453699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.453799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.453927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.453952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.454045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.454152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.454179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.454312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.454454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.454479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.454619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.454766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.454792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.454874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.454983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.455008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.455119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.455224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.455266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.455415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.455538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.455580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.193 qpair failed and we were unable to recover it. 00:28:02.193 [2024-11-26 23:20:28.455700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.193 [2024-11-26 23:20:28.455842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.455872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.455995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.456114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.456142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.456272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.456363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.456391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.456507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.456630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.456658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.456739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.456873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.456916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.457005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.457113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.457140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.457259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.457381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.457410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.457581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.457671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.457697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.457802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.457917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.457945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.458087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.458221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.458247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.458372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.458498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.458534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.458684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.458798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.458824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.458971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.459054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.459096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.459240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.459317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.459341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.459426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.459543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.459568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.459724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.459832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.459857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.459965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.460063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.460092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.460212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.460341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.460370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.460495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.460604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.460630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.460768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.460906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.460932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.461079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.461203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.461232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.461384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.461501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.461539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.461703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.461827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.461857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.461981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.462087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.462113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.462211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.462337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.462365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.462462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.462561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.462590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.462717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.462799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.462827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.462995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.463111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.463137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.194 [2024-11-26 23:20:28.463248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.463367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.194 [2024-11-26 23:20:28.463395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.194 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.463510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.463664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.463706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.463786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.463890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.463916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.464014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.464192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.464395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.464619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.464835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.464932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.465069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.465152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.465194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.465318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.465435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.465463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.465568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.465699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.465725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.465812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.465953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.465979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.466111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.466198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.466227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.466327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.466456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.466485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.466648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.466769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.466798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.466909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.466988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.467101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.467294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.467568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.467820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.467927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.468005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.468116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.468141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.468248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.468393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.468422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.468540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.468667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.468696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.468832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.468921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.468950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.469067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.469157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.469198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.469319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.469456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.469482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.469629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.469711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.469754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.469889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.469980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.470005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.470115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.470197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.470239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.470387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.470502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.195 [2024-11-26 23:20:28.470560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.195 qpair failed and we were unable to recover it. 00:28:02.195 [2024-11-26 23:20:28.470654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.470768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.470811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.470912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.471020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.471045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.471152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.471242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.471267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.471401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.471493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.471521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.471667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.471758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.471783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.471908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.472016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.472041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.472177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.472275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.472317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.472406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.472496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.472522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.472701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.472791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.472818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.472924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.473062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.473087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.473220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.473344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.473373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.473470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.473565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.473594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.473725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.473820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.473847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.473956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.474071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.474097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.474271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.474396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.474424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.474555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.474685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.474711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.474822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.474937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.474962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.475049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.475164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.475189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.475275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.475418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.475444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.475541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.475647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.475671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.475790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.475894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.475922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.476059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.476169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.476195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.476315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.476408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.476436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.476536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.476653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.476682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.476843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.476923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.476949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.477062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.477167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.477192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.477275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.477362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.477387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.477496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.477609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.477635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.196 qpair failed and we were unable to recover it. 00:28:02.196 [2024-11-26 23:20:28.477722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.477802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.196 [2024-11-26 23:20:28.477844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.478007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.478126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.478151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.478261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.478375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.478400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.478576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.478688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.478713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.478806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.478926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.478953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.479088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.479165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.479190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.479274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.479409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.479437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.479538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.479656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.479684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.479772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.479897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.479925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.480024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.480140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.480164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.480273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.480393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.480418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.480512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.480659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.480687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.480805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.480966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.480991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.481075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.481162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.481189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.481285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.481372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.481397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.481486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.481585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.481614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.481750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.481838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.481868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.481978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.482087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.482114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.482230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.482339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.482380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.482509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.482615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.482644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.482740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.482855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.482882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.483019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.483158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.483184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.483289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.483416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.483444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.483541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.483649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.483676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.483763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.483855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.483882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.197 [2024-11-26 23:20:28.484010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.484116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.197 [2024-11-26 23:20:28.484141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.197 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.484294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.484418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.484460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.484570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.484706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.484734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.484850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.484986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.485012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.485127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.485244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.485269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.485372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.485518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.485555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.485686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.485845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.485870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.485988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.486122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.486150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.486258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.486363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.486388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.486503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.486657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.486684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.486802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.486899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.486940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.487055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.487140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.487165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.487251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.487387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.487412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.487502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.487665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.487693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.487831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.487966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.487991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.488105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.488224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.488249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.488365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.488444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.488469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.488579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.488689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.488715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.488852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.488936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.488982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.489106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.489200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.489228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.489326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.489428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.489456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.198 qpair failed and we were unable to recover it. 00:28:02.198 [2024-11-26 23:20:28.489595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.489683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.198 [2024-11-26 23:20:28.489709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.489848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.489971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.489998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.490092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.490185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.490213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.490312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.490387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.490413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.490519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.490667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.490692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.490838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.490959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.490987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.491125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.491203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.491228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.491336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.491449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.491475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.491586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.491699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.491724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.491811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.491916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.491940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.492088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.492209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.492234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.492348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.492468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.492494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.492633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.492764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.492789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.492870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.492983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.493118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.493347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.493542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.493757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.493927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.494085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.494206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.494235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.494340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.494425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.494451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.494543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.494716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.494741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.494822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.494966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.495000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.495153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.495302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.495334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.495449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.495551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.495578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.495715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.495876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.495918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.496058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.496184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.496213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.496380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.496488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.496517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.496641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.496751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.496776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.496897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.496988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.199 [2024-11-26 23:20:28.497016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.199 qpair failed and we were unable to recover it. 00:28:02.199 [2024-11-26 23:20:28.497145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.497239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.497264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.497373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.497508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.497560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.497676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.497794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.497824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.497917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.497999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.498043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.498148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.498236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.498264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.498368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.498515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.498566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.498711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.498871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.498900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.499028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.499142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.499169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.499260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.499384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.499412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.499563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.499690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.499717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.499857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.499979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.500005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.500116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.500209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.500236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.500333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.500437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.500471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.500632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.500738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.500765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.500877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.501020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.501045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.501153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.501245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.501272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.501388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.501538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.501582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.501667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.501778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.501804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.501917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.502028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.502053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.502167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.502313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.502340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.502462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.502587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.502616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.502721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.502836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.502878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.502964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.503101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.503126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.503254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.503338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.503366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.503491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.503603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.503629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.503712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.503798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.503824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.503938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.504076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.504101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.504207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.504292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.504334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.200 [2024-11-26 23:20:28.504491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.504663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.200 [2024-11-26 23:20:28.504700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.200 qpair failed and we were unable to recover it. 00:28:02.505 [2024-11-26 23:20:28.504843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.505 [2024-11-26 23:20:28.505007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.505 [2024-11-26 23:20:28.505054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.505 qpair failed and we were unable to recover it. 00:28:02.505 [2024-11-26 23:20:28.505245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.505 [2024-11-26 23:20:28.505355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.505 [2024-11-26 23:20:28.505404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.505 qpair failed and we were unable to recover it. 00:28:02.505 [2024-11-26 23:20:28.505556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.505 [2024-11-26 23:20:28.505739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.505 [2024-11-26 23:20:28.505791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.505 qpair failed and we were unable to recover it. 00:28:02.505 [2024-11-26 23:20:28.505917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.505 [2024-11-26 23:20:28.506056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.505 [2024-11-26 23:20:28.506085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.505 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.506180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.506293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.506345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.506506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.506645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.506675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.506765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.506926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.506972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.507100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.507194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.507220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.507327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.507446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.507473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.507575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.507676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.507720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.507872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.507976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.508086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.508289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.508494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.508717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.508837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.508954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.509168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.509383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.509590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.509821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.509954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.510065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.510178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.510205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.510319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.510437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.510464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.510550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.510632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.510658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.510747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.510832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.510858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.510966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.511092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.511119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.511233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.511318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.511344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.511435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.511519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.511552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.511693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.511786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.511812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.511921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.512038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.512066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.512182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.512299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.512326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.512441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.512554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.512582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.506 qpair failed and we were unable to recover it. 00:28:02.506 [2024-11-26 23:20:28.512664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.506 [2024-11-26 23:20:28.512744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.512771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.512882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.512997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.513162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.513379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.513600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.513797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.513930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.514046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.514165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.514192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.514334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.514416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.514444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.514565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.514682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.514709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.514796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.514940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.514967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.515088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.515206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.515234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.515350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.515469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.515496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.515593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.515675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.515702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.515820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.515906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.515938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.516051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.516160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.516187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.516299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.516414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.516441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.516562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.516704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.516730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.516880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.516963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.516989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.517132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.517277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.517305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.517388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.517505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.517538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.517630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.517717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.517745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.517856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.517930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.517956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.518098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.518207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.518233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.518318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.518456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.518488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.518638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.518747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.518775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.518885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.518995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.519021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.519141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.519247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.519274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.519428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.519520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.519558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.507 [2024-11-26 23:20:28.519699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.519784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.507 [2024-11-26 23:20:28.519811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.507 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.519928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.520064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.520091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.520174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.520282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.520309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.520459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.520590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.520640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.520776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.520885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.520914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.521039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.521154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.521185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.521305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.521412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.521438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.521535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.521651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.521677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.521795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.521944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.521970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.522095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.522235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.522262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.522374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.522459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.522486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.522573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.522679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.522705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.522818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.522941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.522969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.523081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.523173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.523200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.523341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.523435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.523461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.523582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.523694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.523725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.523810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.523916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.523943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.524058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.524175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.524202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.524344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.524456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.524483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.524585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.524691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.524718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.524833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.524946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.524974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.525091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.525182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.525209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.525322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.525461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.525488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.525581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.525679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.525706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.525791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.525928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.525954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.526095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.526237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.526263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.526350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.526456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.526483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.526582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.526714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.526758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.526849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.526963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.508 [2024-11-26 23:20:28.526990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.508 qpair failed and we were unable to recover it. 00:28:02.508 [2024-11-26 23:20:28.527081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.527224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.527251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.527361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.527477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.527504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.527615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.527694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.527721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.527835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.527948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.527976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.528095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.528193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.528220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.528336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.528455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.528481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.528598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.528693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.528720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.528831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.528945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.528973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.529114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.529255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.529281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.529363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.529449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.529475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.529559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.529677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.529703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.529796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.529889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.529916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.530028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.530163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.530190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.530277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.530391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.530419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.530537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.530671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.530698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.530786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.530872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.530899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.531038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.531158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.531184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.531297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.531406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.531433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.531514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.531635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.531662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.531742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.531889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.531915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.532029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.532110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.532138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.532253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.532391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.532418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.532538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.532650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.532676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.532760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.532872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.532900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.533044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.533160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.533188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.533301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.533406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.533433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.533543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.533681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.533708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.533798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.533916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.533942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.509 qpair failed and we were unable to recover it. 00:28:02.509 [2024-11-26 23:20:28.534058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.534166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.509 [2024-11-26 23:20:28.534193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.534311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.534427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.534454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.534596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.534695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.534721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.534857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.534967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.534994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.535108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.535189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.535217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.535334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.535446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.535473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.535590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.535738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.535765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.535846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.535934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.535960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.536097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.536206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.536233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.536344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.536452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.536478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.536564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.536648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.536675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.536817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.536928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.536956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.537077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.537188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.537214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.537301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.537408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.537434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.537545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.537625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.537653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.537773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.537890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.537917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.538010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.538119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.538146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.538255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.538374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.538401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.538511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.538657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.538684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.538803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.538915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.538942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.539049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.539140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.539167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.539308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.539423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.539451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.539600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.539693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.539721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.539840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.539926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.510 [2024-11-26 23:20:28.539953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.510 qpair failed and we were unable to recover it. 00:28:02.510 [2024-11-26 23:20:28.540064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.540202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.540229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.540349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.540459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.540495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.540628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.540759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.540805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.540947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.541031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.541057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.541168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.541275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.541302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.541422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.541528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.541557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.541667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.541783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.541811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.541929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.542047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.542074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.542193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.542332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.542359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.542509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.542627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.542654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.542779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.542906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.542933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.543021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.543162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.543189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.543267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.543408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.543435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.543555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.543662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.543693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.543827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.543953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.543979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.544121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.544256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.544287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.544407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.544552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.544598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.544689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.544828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.544857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.544978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.545104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.545133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.545235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.545387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.545415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.545543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.545641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.545668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.545788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.545926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.545968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.546106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.546258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.546288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.546396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.546515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.546550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.546691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.546835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.546864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.546982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.547085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.547116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.547247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.547402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.547432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.547573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.547652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.547679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.511 qpair failed and we were unable to recover it. 00:28:02.511 [2024-11-26 23:20:28.547794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.547921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.511 [2024-11-26 23:20:28.547950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.548033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.548123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.548154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.548285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.548385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.548414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.548542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.548641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.548667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.548755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.548889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.548919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.549058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.549155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.549186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.549285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.549417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.549446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.549549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.549665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.549692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.549774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.549861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.549887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.549998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.550164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.550193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.550323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.550443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.550473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.550593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.550674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.550701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.550836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.550935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.550965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.551087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.551207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.551237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.551393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.551532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.551559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.551668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.551809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.551835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.551967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.552081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.552109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.552234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.552364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.552395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.552491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.552611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.552638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.552781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.552918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.552962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.553114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.553252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.553281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.553401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.553498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.553534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.553647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.553764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.553790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.553920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.554041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.554070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.554172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.554278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.554307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.554425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.554606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.554633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.554749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.554849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.554878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.554985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.555090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.555121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.555246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.555366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.512 [2024-11-26 23:20:28.555395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.512 qpair failed and we were unable to recover it. 00:28:02.512 [2024-11-26 23:20:28.555507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.555634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.555662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.555822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.555973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.556002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.556213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.556303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.556332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.556456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.556625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.556652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.556766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.556873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.556917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.557055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.557211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.557240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.557348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.557487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.557516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.557657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.557772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.557799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.557902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.558056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.558090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.558213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.558332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.558362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.558497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.558624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.558651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.558767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.558871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.558900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.558999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.559097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.559126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.559246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.559366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.559411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.559534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.559647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.559673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.559762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.559922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.559952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.560101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.560255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.560285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.560385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.560474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.560503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.560663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.560742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.560773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.560871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.561016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.561042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.561147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.561268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.561298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.561436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.561587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.561615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.561722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.561841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.561867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.561976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.562104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.562134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.562258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.562386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.562416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.562507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.562636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.562667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.562778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.562886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.562913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.513 qpair failed and we were unable to recover it. 00:28:02.513 [2024-11-26 23:20:28.563094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.513 [2024-11-26 23:20:28.563183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.563210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.563346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.563507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.563549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.563676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.563767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.563796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.563924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.564063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.564089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.564179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.564310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.564341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.564490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.564629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.564660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.564801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.564918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.564947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.565088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.565182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.565209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.565330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.565489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.565518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.565656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.565781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.565822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.565949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.566087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.566113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.566225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.566361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.566387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.566545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.566674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.566704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.566820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.566952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.566978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.567120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.567253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.567282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.567390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.567477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.567504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.567598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.567700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.567729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.567852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.567985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.568013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.568162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.568295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.568324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.568466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.568583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.568610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.568696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.568831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.568857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.568984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.569100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.569129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.569229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.569316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.569345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.569425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.569534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.569561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.569641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.569733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.569762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.569855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.570019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.570045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.570127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.570277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.570320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.570460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.570573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.570600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.514 qpair failed and we were unable to recover it. 00:28:02.514 [2024-11-26 23:20:28.570747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.514 [2024-11-26 23:20:28.570835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.570864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.570961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.571080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.571109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.571203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.571327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.571356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.571483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.571597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.571624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.571794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.571914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.571940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.572045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.572155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.572180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.572303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.572444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.572470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.572615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.572752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.572778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.572916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.573060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.573086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.573233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.573348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.573377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.573552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.573702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.573728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.573810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.573899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.573925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.574032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.574148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.574175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.574301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.574418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.574444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.574639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.574757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.574783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.574899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.574981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.575008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.575167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.575331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.575357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.575467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.575575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.575601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.575724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.575842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.575872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.575977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.576117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.576143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.576242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.576372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.576401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.576496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.576624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.576653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.576740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.576873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.576902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.577004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.577127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.577154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.515 [2024-11-26 23:20:28.577250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.577386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.515 [2024-11-26 23:20:28.577413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.515 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.577521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.577644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.577671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.577751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.577899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.577928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.578034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.578152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.578178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.578262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.578380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.578424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.578564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.578677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.578704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.578789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.578938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.578964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.579109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.579302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.579331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.579455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.579554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.579581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.579719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.579855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.579899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.579992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.580100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.580126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.580243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.580356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.580382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.580485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.580609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.580638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.580808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.580886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.580912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.580992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.581097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.581123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.581240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.581385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.581411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.581547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.581675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.581704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.581833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.581954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.581998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.582107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.582196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.582239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.582341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.582417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.582443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.582575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.582766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.582792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.582983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.583133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.583162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.583289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.583419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.583445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.583592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.583705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.583731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.583843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.583955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.583999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.584080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.584204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.584233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.584355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.584510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.584547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.584654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.584777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.584804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.584892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.585032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.585076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.516 qpair failed and we were unable to recover it. 00:28:02.516 [2024-11-26 23:20:28.585220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.516 [2024-11-26 23:20:28.585355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.585384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.585519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.585656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.585685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.585817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.585898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.585924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.586046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.586133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.586162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.586320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.586436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.586479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.586603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.586746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.586772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.586889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.587003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.587030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.587195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.587324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.587353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.587477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.587600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.587629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.587717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.587853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.587880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.588022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.588136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.588163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.588242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.588359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.588385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.588546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.588640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.588669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.588818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.588917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.588943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.589023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.589133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.589159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.589245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.589388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.589417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.589551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.589672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.589701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.589865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.589982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.590008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.590120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.590269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.590295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.590431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.590536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.590566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.590669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.590812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.590838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.590912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.590995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.591022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.591130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.591209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.591235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.591321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.591437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.591463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.591613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.591733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.591762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.591918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.592037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.592066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.592193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.592279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.592307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.592417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.592518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.592555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.517 [2024-11-26 23:20:28.592697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.592836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.517 [2024-11-26 23:20:28.592861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.517 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.592996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.593087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.593116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.593224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.593308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.593335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.593475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.593572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.593620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.593748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.593865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.593894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.593995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.594144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.594173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.594312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.594431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.594456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.594585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.594702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.594731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.594855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.594975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.595092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.595352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.595619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.595832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.595946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.596040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.596153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.596179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.596268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.596385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.596410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.596530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.596622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.596667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.596799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.596898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.596928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.597045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.597161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.597191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.597354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.597446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.597472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.597585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.597680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.597709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.597881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.597977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.598004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.598090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.598198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.598227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.598360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.598554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.598598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.598722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.598863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.598894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.598987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.599093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.599119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.599238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.599316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.599342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.599462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.599576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.599604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.599747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.599844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.599873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.599961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.600073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.600101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.518 qpair failed and we were unable to recover it. 00:28:02.518 [2024-11-26 23:20:28.600228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.518 [2024-11-26 23:20:28.600424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.600453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.600568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.600656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.600683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.600811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.600901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.600930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.601028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.601118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.601147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.601243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.601438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.601471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.601586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.601729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.601755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.601890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.601972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.602001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.602122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.602276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.602305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.602400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.602536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.602567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.602704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.602818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.602844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.602961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.603048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.603074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.603151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.603341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.603370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.603462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.603558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.603588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.603726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.603819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.603844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.603953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.604059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.604089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.604175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.604286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.604312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.604425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.604541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.604571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.604712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.604826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.604852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.604936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.605072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.605098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.605211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.605405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.605434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.605536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.605666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.605695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.605802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.605920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.605947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.606029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.606141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.606167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.606246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.606355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.606385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.606511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.606641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.606675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.519 qpair failed and we were unable to recover it. 00:28:02.519 [2024-11-26 23:20:28.606786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.606863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.519 [2024-11-26 23:20:28.606888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.606984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.607090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.607133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.607279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.607374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.607402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.607534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.607647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.607675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.607780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.607896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.607922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.608001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.608089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.608116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.608257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.608399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.608425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.608617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.608769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.608796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.608935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.609051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.609077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.609180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.609299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.609328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.609553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.609640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.609669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.609768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.609870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.609899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.610000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.610089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.610116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.610204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.610320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.610346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.610471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.610597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.610624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.610722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.610878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.610907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.611102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.611208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.611234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.611378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.611469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.611497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.611601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.611705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.611730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.611896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.611987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.612016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.612160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.612277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.612303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.612388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.612514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.612554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.612724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.612838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.612864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.612983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.613114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.613143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.613280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.613389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.613415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.613494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.613597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.613625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.613742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.613898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.613928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.614045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.614205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.614231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.614316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.614420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.520 [2024-11-26 23:20:28.614446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.520 qpair failed and we were unable to recover it. 00:28:02.520 [2024-11-26 23:20:28.614562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.614744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.614770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.614911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.615070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.615114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.615228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.615320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.615346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.615456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.615595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.615621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.615703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.615822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.615848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.615958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.616086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.616115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.616240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.616377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.616403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.616546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.616633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.616659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.616740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.616846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.616872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.616947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.617038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.617065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.617235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.617373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.617399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.617494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.617589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.617616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.617705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.617821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.617850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.618003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.618212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.618237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.618366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.618491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.618517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.618642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.618759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.618785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.618912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.619031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.619061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.619151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.619268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.619298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.619383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.619506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.619548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.619688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.619823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.619849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.619963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.620113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.620139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.620251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.620376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.620420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.620546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.620698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.620740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.620857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.620983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.621009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.621102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.621234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.621277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.621384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.621498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.621546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.621725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.621842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.621869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.621958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.622099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.622126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.521 qpair failed and we were unable to recover it. 00:28:02.521 [2024-11-26 23:20:28.622209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.521 [2024-11-26 23:20:28.622383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.622409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.622531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.622695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.622723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.622880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.622961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.622988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.623077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.623213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.623240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.623406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.623521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.623557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.623691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.623789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.623818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.623940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.624071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.624097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.624208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.624298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.624326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.624467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.624619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.624648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.624772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.624907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.624933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.625044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.625136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.625162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.625272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.625349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.625375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.625488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.625589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.625633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.625740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.625909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.625941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.626076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.626170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.626198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.626299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.626392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.626417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.626553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.626681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.626711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.626885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.626992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.627136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.627394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.627617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.627835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.627969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.628113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.628212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.628241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.628379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.628499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.628533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.628650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.628763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.628789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.628874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.628981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.629006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.629138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.629265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.629294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.629405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.629485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.629510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.629655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.629766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.522 [2024-11-26 23:20:28.629792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.522 qpair failed and we were unable to recover it. 00:28:02.522 [2024-11-26 23:20:28.629910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.630181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.630461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.630646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.630824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.630964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.631081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.631189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.631214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.631304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.631444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.631469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.631579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.631654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.631680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.631792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.631898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.631924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.632000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.632236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.632435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.632685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.632894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.632995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.633097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.633324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.633511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.633767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.633879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.633955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.634063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.634089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.634201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.634314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.634339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.634448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.634533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.634568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.634687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.634769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.634794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.634943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.635064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.635090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.635215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.635326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.635354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.635441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.635560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.635603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.635726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.635856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.635884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.636045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.636132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.636157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.636270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.636378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.636403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.523 [2024-11-26 23:20:28.636477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.636590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.523 [2024-11-26 23:20:28.636617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.523 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.636699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.636813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.636856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.636997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.637122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.637148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.637309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.637410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.637439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.637571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.637693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.637723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.637878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.637997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.638027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.638154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.638291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.638317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.638430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.638548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.638577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.638692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.638859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.638885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.638966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.639114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.639139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.639280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.639359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.639384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.639522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.639664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.639690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.639777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.639918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.639944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.640101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.640253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.640281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.640391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.640501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.640544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.640690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.640771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.640796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.640932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.641051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.641092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.641233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.641358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.641386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.641519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.641614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.641640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.641724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.641828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.641853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.641960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.642111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.642139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.642226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.642392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.642418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.642555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.642669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.642694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.642848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.642960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.642985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.643139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.643257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.643285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.524 [2024-11-26 23:20:28.643388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.643531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.524 [2024-11-26 23:20:28.643558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.524 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.643642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.643725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.643750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.643911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.643999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.644027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.644154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.644275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.644303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.644391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.644494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.644522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.644689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.644776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.644802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.644909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.644984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.645010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.645091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.645228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.645271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.645419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.645537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.645567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.645695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.645778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.645803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.645876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.646010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.646040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.646172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.646292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.646337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.646448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.646591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.646623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.646710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.646822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.646848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.646932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.647009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.647033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.647189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.647281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.647308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.647396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.647544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.647573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.647680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.647824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.647849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.648005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.648128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.648157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.648273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.648395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.648425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.648556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.648701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.648727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.648875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.649013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.649039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.649181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.649309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.649352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.649496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.649631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.649675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.649790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.649899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.649925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.650031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.650144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.650170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.650286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.650437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.650465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.650604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.650744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.650770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.650893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.650980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.651010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.525 qpair failed and we were unable to recover it. 00:28:02.525 [2024-11-26 23:20:28.651146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.651291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.525 [2024-11-26 23:20:28.651316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.651416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.651531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.651561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.651718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.651819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.651848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.651936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.652031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.652059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.652198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.652302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.652328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.652444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.652585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.652630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.652773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.652869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.652898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.653062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.653138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.653163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.653271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.653385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.653411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.653549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.653705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.653731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.653873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.654005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.654033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.654157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.654306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.654334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.654455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.654604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.654630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.654735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.654851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.654879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.654976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.655071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.655099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.655235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.655348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.655373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.655482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.655584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.655610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.655707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.655830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.655858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.655981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.656098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.656139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.656237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.656333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.656361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.656492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.656577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.656604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.656762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.656848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.656876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.656997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.657137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.657163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.657282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.657403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.657431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.657547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.657652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.657677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.657763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.657850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.657876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.657959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.658117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.658146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.658277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.658399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.658441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.658593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.658700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.526 [2024-11-26 23:20:28.658726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.526 qpair failed and we were unable to recover it. 00:28:02.526 [2024-11-26 23:20:28.658840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.658958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.658984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.659097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.659248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.659290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.659395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.659479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.659505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.659663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.659752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.659779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.659911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.660065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.660093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.660256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.660375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.660408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.660507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.660614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.660659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.660741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.660827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.660853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.660988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.661113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.661141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.661308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.661424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.661450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.661538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.661652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.661678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.661792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.661933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.661958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.662063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.662180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.662208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.662384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.662493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.662519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.662624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.662741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.662767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.662839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.662975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.663001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.663112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.663272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.663301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.663435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.663535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.663562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.663697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.663796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.663824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.663964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.664070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.664105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.664214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.664327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.664353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.664432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.664550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.664578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.664669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.664799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.664828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.664935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.665063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.665088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.665200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.665360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.665389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.665514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.665642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.665671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.665802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.665929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.665954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.666081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.666191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.666217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.666342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.666499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.527 [2024-11-26 23:20:28.666534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.527 qpair failed and we were unable to recover it. 00:28:02.527 [2024-11-26 23:20:28.666689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.666790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.666818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.666940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.667105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.667130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.667268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.667347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.667373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.667510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.667675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.667704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.667824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.667963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.667992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.668115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.668252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.668277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.668370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.668508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.668563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.668684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.668765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.668794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.668943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.669071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.669099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.669225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.669352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.669380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.669506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.669626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.669652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.669762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.669870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.669913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.670034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.670189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.670218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.670343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.670446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.670474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.670621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.670729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.670755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.670854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.670978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.671004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.671082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.674541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.674591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.674737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.674910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.674942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.675082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.675204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.675231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.675386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.675476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.675504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.675620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.675728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.675757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.675892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.676033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.676062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.676193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.676306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.676335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.676459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.676614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.676642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.676794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.676919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.676944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.528 qpair failed and we were unable to recover it. 00:28:02.528 [2024-11-26 23:20:28.677070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.528 [2024-11-26 23:20:28.677158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.677184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.677300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.677387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.677413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.677557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.677647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.677678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.677808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.677914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.677940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.678021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.678100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.678126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.678218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.678327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.678354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.678445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.678541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.678567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.678703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.678825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.678851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.678969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.679076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.679101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.679216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.679332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.679357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.679474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.679574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.679600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.679680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.679794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.679821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.679938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.680168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.680374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.680604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.680872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.680989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.681123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.681349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.681663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.681854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.681959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.682065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.682179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.682205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.682352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.682436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.682461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.682579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.682666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.682692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.682782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.682941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.682968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.683103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.683207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.683233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.683341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.683470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.683495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.683577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.683687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.683712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.529 qpair failed and we were unable to recover it. 00:28:02.529 [2024-11-26 23:20:28.683807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.529 [2024-11-26 23:20:28.683918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.683942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.684027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.684107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.684133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.684231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.684378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.684403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.684530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.684618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.684644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.684726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.684809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.684840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.684960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.685042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.685067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.685196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.685301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.685331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.685432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.685566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.685596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.685715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.685787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.685813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.685950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.686061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.686087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.686242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.686364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.686395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.686517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.686643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.686668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.686747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.686888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.686915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.687011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.687208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.687403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.687652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.687866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.687979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.688114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.688305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.688544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.688762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.688898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.689006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.689212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.689441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.689646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.689878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.689994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.690105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.690240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.690265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.690377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.690469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.530 [2024-11-26 23:20:28.690495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.530 qpair failed and we were unable to recover it. 00:28:02.530 [2024-11-26 23:20:28.690602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.690686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.690711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.690797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.690918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.690943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.691032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.691166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.691192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.691302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.691424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.691448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.691595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.691707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.691732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.691813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.691955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.691981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.692063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.692169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.692198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.692284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.692424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.692449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.692535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.692635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.692661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.692753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.692892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.692918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.692996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.693241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.693455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.693644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.693888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.693979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.694098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.694306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.694562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.694776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.694912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.695059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.695276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.695480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.695686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.695922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.695996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.696131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.696347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.696602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.696839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.696981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.531 qpair failed and we were unable to recover it. 00:28:02.531 [2024-11-26 23:20:28.697097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.697205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.531 [2024-11-26 23:20:28.697231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.697346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.697484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.697509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.697619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.697710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.697737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.697863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.698005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.698031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.698143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.698224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.698250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.698360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.698508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.698565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.698669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.698759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.698784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.698910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.699181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.699387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.699650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.699852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.699990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.700092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.700332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.700609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.700796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.700970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.701087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.701193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.701219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.701360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.701472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.701498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.701597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.701708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.701733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.701818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.701937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.701962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.702095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.702188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.702213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.702298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.702388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.702413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.702500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.702612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.702637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.702753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.702846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.702871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.702954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.703095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.703121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.703240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.703332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.703357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.703474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.703561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.703598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.703694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.703778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.703802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.532 qpair failed and we were unable to recover it. 00:28:02.532 [2024-11-26 23:20:28.703916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.704024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.532 [2024-11-26 23:20:28.704050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.704162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.704239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.704267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.704387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.704475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.704500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.704595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.704681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.704706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.704784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.704876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.704907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.705025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.705276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.705490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.705690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.705886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.705993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.706130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.706350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.706621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.706827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.706994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.707140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.707223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.707248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.707364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.707471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.707496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.707613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.707697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.707723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.707845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.707967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.707993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.708083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.708169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.708195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.708336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.708472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.708498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.708603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.708709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.708735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.708839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.708953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.708980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.709070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.709186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.709215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.709309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.709414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.709439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.709579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.709664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.709690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.533 qpair failed and we were unable to recover it. 00:28:02.533 [2024-11-26 23:20:28.709775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.533 [2024-11-26 23:20:28.709928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.709954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.710066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.710178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.710204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.710290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.710424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.710450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.710551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.710644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.710669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.710757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.710883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.710907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.710998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.711113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.711139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.711222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.711301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.711326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.711420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.711507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.711539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.711635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.711751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.711781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.711910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.712141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.712462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.712698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.712920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.712999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.713134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.713380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.713618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.713856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.713997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.714085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.714193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.714218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.714325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.714418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.714443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.714523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.714642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.714667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.714789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.714877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.714903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.715021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.715104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.715130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.715245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.715387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.715412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.715523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.715625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.715650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.715737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.715817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.715850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.715946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.716054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.716080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.716166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.716256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.716286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.716430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.716546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.534 [2024-11-26 23:20:28.716583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.534 qpair failed and we were unable to recover it. 00:28:02.534 [2024-11-26 23:20:28.716695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.716808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.716843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.716941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.717200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.717414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.717624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.717848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.717948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.718053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.718161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.718187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.718304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.718388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.718413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.718492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.718607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.718634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.718728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.718819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.718849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.718939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.719024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.719049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.719165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.719243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.719268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.719405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.719520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.719556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.719706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.719796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.719831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.719938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.720125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.720314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.720548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.720778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.720890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.720975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.721199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.721436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.721655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.721883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.721987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.722123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.722348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.722611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.722841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.722942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.535 qpair failed and we were unable to recover it. 00:28:02.535 [2024-11-26 23:20:28.723031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.723120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.535 [2024-11-26 23:20:28.723146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.723257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.723369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.723393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.723479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.723572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.723599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.723736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.723818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.723843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.723964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.724106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.724133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.724250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.724362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.724387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.724500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.724624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.724650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.724739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.724879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.724905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.725018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.725132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.725157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.725237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.725327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.725352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.725494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.725590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.725615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.725751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.725855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.725881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.725987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.726102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.726127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.726267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.726382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.726407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.726491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.726596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.726621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.726738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.726847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.726872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.726992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.727111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.727137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.727249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.727358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.727384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.727472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.727579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.727606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.727725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.727841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.727866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.727971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.728058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.728084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.728220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.728305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.728335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.728425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.728535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.728561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.728679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.728788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.728813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.728902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.729140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.729336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.729566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.536 [2024-11-26 23:20:28.729848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.536 [2024-11-26 23:20:28.729983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.536 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.730071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.730159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.730183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.730268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.730378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.730404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.730511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.730613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.730643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.730751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.730832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.730857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.730936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.731150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.731352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.731620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.731879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.731985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.732065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.732199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.732224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.732349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.732442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.732467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.732580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.732656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.732681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.732767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.732848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.732873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.732959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.733184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.733396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.733649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.733856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.733987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.734094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.734182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.734207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.734296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.734386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.734412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.734505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.734622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.734649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.734736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.734846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.734871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.734954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.735176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.735393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.735638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.735886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.735999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.736109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.736217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.736242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.537 qpair failed and we were unable to recover it. 00:28:02.537 [2024-11-26 23:20:28.736381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.537 [2024-11-26 23:20:28.736463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.736488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.736587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.736677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.736703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.736794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.736868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.736893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.737000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.737085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.737111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.737192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.737312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.737338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.737441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.737557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.737584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.737675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.737811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.737837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.737952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.738203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.738413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.738664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.738881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.738994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.739078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.739223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.739249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.739337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.739444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.739470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.739589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.739699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.739724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.739816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.739909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.739934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.740041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.740228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.740448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.740644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.740864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.740993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.741080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.741196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.741222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.741330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.741450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.741476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.741597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.741684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.741709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.741794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.741917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.741942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.538 qpair failed and we were unable to recover it. 00:28:02.538 [2024-11-26 23:20:28.742025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.742115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.538 [2024-11-26 23:20:28.742145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.742256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.742348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.742373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.742458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.742536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.742562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.742672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.742745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.742770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.742877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.742956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.742981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.743061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.743143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.743168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.743285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.743373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.743399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.743485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.743579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.743605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.743726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.743808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.743833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.743920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.744001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.744026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.744151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.744288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.744313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.744463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.744602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.744628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.744744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.744867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.744892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.745006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.745131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.745156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.745243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.745355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.745386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.745469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.745574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.745601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.745711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.745805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.745830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.745975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.746082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.746107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.746244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.746325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.746350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.746497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.746595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.746622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.746738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.746856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.746882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.746974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.747061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.747086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.747164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.747245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.747270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.747377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.747490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.747516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.747667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.747809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.747835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.747937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.748047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.748074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.748184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.748290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.748316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.748406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.748519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.748575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.748688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.748771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.748796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.539 qpair failed and we were unable to recover it. 00:28:02.539 [2024-11-26 23:20:28.748886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.539 [2024-11-26 23:20:28.749023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.749161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.749382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.749672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.749895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.749992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.750101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.750190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.750215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.750330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.750440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.750467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.750587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.750705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.750731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.750820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.750939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.750964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.751045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.751157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.751182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.751299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.751408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.751433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.751571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.751655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.751680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.751768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.751879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.751905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.751992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.752207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.752431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.752628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.752818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.752958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.753069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.753153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.753179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.753259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.753341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.753366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.753446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.753577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.753603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.753724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.753859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.753884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.753960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.754211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.754429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.754642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.754861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.754976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.755050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.755129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.755153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.755264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.755379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.540 [2024-11-26 23:20:28.755404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.540 qpair failed and we were unable to recover it. 00:28:02.540 [2024-11-26 23:20:28.755512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.755630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.755656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.755747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.755859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.755885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.755969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.756052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.756077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.756191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.756302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.756327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.756447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.756532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.756559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.756698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.756807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.756833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.756947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.757191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.757413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.757634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.757864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.757974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.758116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.758228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.758254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.758337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.758452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.758478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.758621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.758739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.758765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.758857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.758967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.758992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.759082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.759167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.759192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.759272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.759380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.759406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.759523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.759641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.759667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.759777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.759891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.759917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.760037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.760154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.760180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.760268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.760353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.760378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.760515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.760651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.760677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.760756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.760837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.760862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.760974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.761062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.761087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.761203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.761319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.761344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.761489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.761608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.761634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.761723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.761810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.761836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.761947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.762030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.762055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.541 [2024-11-26 23:20:28.762167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.762256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.541 [2024-11-26 23:20:28.762282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.541 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.762368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.762477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.762503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.762604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.762695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.762720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.762830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.762913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.762938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.763022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.763099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.763124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.763265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.763344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.763370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.763466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.763557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.763583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.763686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.763824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.763849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.763936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.764025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.764051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.764138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.764253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.764278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.764396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.764536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.764563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.764674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.764789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.764815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.764927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.765159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.765377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.765664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.765897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.765987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.766100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.766317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.766573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.766825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.766957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.767098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.767180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.767206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.767287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.767438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.767463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.767550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.767660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.767686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.767801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.767887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.767912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.542 [2024-11-26 23:20:28.768024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.768170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.542 [2024-11-26 23:20:28.768196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.542 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.768272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.768353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.768384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.768495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.768598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.768626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.768740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.768854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.768880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.768965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.769101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.769127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.769205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.769307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.769332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.769418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.769534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.769560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.769670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.769777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.769802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.769916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.770139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.770383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.770615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.770846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.770988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.771097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.771351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.771601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.771855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.771997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.772137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.772227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.772252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.772399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.772513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.772561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.772683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.772797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.772823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.772939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.773187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.773408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.773599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.773789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.773889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.773999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.774108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.774134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.774245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.774359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.774384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.774531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.774611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.774636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.774749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.774835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.774861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.543 qpair failed and we were unable to recover it. 00:28:02.543 [2024-11-26 23:20:28.775002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.543 [2024-11-26 23:20:28.775112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.775137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.775225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.775340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.775366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.775446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.775585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.775610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.775749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.775867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.775892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.776004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.776119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.776144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.776234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.776343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.776369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.776479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.776565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.776591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.776728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.776814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.776839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.776923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.777035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.777060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.777165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.777271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.777297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.777405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.777520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.777572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.777665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.777773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.777798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.777913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.778139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.778394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.778651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.778853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.778969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.779058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.779171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.779197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.779303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.779414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.779440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.779561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.779649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.779675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.779793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.779933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.779958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.780102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.780216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.780242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.780357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.780442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.780466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.780561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.780668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.780697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.780781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.780859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.780884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.780996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.781072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.781097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.781215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.781325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.781350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.781462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.781577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.781603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.781712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.781824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.781850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.544 qpair failed and we were unable to recover it. 00:28:02.544 [2024-11-26 23:20:28.781963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.544 [2024-11-26 23:20:28.782098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.782124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.782236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.782311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.782336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.782448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.782585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.782611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.782707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.782795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.782820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.782904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.782988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.783138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.783355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.783586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.783836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.783975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.784089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.784173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.784198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.784281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.784400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.784426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.784512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.784625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.784651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.784735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.784821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.784846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.784936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.785050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.785075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.785156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.785265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.785291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.785403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.785518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.785552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.785658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.785734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.785759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.785902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.786142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.786353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.786565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.786775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.786891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.786976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.787180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.787433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.787660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.787893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.787998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.788110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.788214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.788239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.545 [2024-11-26 23:20:28.788361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.788478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.545 [2024-11-26 23:20:28.788503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.545 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.788586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.788672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.788697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.788783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.788858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.788883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.789023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.789110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.789135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.789217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.789350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.789376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.789463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.789567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.789593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.789733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.789823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.789848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.789930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.790040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.790065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.790178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.790291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.790315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.790450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.790564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.790590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.790702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.790817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.790842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.790951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.791205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.791430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.791654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.791848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.791994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.792137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.792279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.792305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.792444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.792533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.792564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.792679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.792819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.792844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.792925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.793035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.793061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.793206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.793316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.793340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.793449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.793532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.793558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.793677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.793794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.793819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.793963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.794214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.794419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.794642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.794887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.794988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.795112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.795195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.795220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.546 qpair failed and we were unable to recover it. 00:28:02.546 [2024-11-26 23:20:28.795360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.795470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.546 [2024-11-26 23:20:28.795495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.795587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.795698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.795723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.795808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.795912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.795937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.796089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.796201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.796227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.796339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.796455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.796480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.796584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.796676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.796700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.796788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.796906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.796932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.797037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.797151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.797176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.797283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.797421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.797447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.797576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.797689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.797715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.797803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.797918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.797944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.798024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.798256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.798489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.798689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.798886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.798990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.799131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.799320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.799517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.799746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.799882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.799999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.800081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.800107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.800193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.800280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.800305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.800401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.800514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.800548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.800669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.800772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.800798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.800918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.801063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.801089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.547 qpair failed and we were unable to recover it. 00:28:02.547 [2024-11-26 23:20:28.801173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.547 [2024-11-26 23:20:28.801259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.801284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.801372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.801488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.801513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.801619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.801695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.801720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.801833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.801944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.801971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.802093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.802189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.802214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.802302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.802416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.802440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.802538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.802626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.802651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.802766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.802877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.802903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.803015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.803132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.803157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.803242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.803351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.803376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.803459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.803575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.803601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.803710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.803810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.803836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.803985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.804124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.804150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.804256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.804369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.804395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.804479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.804596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.804627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.804720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.804827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.804852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.804961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.805157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.805351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.805595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.805777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.805888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.806003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.806113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.806139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.806228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.806314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.806340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.806480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.806603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.806629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.806722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.806823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.806848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.806964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.807116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.807141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.807218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.807299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.807324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.807411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.807503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.807536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.807678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.807795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.807820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.548 qpair failed and we were unable to recover it. 00:28:02.548 [2024-11-26 23:20:28.807905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.548 [2024-11-26 23:20:28.808018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.808183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.808455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.808694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.808885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.808993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.809074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.809207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.809232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.809310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.809394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.809418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.809540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.809636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.809661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.809749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.809857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.809881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.809969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.810169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.810402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.810637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.810835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.810962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.811050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.811165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.811190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.811309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.811421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.811446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.811544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.811684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.811709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.811799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.811939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.811964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.812113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.812231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.812256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.812371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.812458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.812484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.812576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.812712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.812737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.812822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.812947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.812972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.813113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.813221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.813246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.813327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.813437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.813461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.813553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.813666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.813691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.813772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.813858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.813883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.813971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.814097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.814122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.814247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.814334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.814359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.549 qpair failed and we were unable to recover it. 00:28:02.549 [2024-11-26 23:20:28.814438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.814549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.549 [2024-11-26 23:20:28.814575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.814654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.814756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.814781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.814864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.814972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.814998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.815078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.815169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.815194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.815287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.815420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.815446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.815537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.815626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.815651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.815788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.815899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.815924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.816039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.816176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.816201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.816341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.816449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.816479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.816572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.816656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.816681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.816783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.816897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.816923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.816999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.817102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.817127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.817246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.817332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.817358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.817441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.817552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.817579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.817685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.817796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.817821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.817933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.818134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.818353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.818616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.818878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.818984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.819069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.819158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.819184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.819296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.819407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.819432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.819547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.819655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.819681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.819766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.819882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.819908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.820001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.820112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.820138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.820275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.820355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.820380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.820477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.820595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.820621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.820707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.820794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.820820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.820902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.821010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.821035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.821125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.821235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.821261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.821350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.821437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.821462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.550 [2024-11-26 23:20:28.821569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.821646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.550 [2024-11-26 23:20:28.821672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.550 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.821788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.821903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.821928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.822001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.822138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.822164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.822248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.822325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.822350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.822473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.822558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.822585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.822693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.822769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.822794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.822937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.823157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.823392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.823642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.823886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.823991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.824069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.824150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.824175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.824265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.824374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.824400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.824552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.824635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.824661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.824750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.824871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.824897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.825066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.825151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.825176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.825288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.825379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.825403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.825497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.825616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.825644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.825769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.825863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.825889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.826008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.826090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.826116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.826261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.826335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.826360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.826443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.826553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.826578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.826658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.826737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.826762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.826899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.827116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.827308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.827536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.827728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.827830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.551 qpair failed and we were unable to recover it. 00:28:02.551 [2024-11-26 23:20:28.827939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.551 [2024-11-26 23:20:28.828030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.828056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.828165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.828273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.828299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.828414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.828520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.828553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.828667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.828778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.828804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.828920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.829109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.829317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.829565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.829779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.829951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.830042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.830120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.830147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.830297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.830380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.830411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.830539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.830625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.830651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.830731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.830819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.830845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.830957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.831065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.831090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.831206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.831318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.831344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.831457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.831569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.831596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.831671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.831779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.831804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.831922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.832143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.832337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.832516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.552 qpair failed and we were unable to recover it. 00:28:02.552 [2024-11-26 23:20:28.832716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.552 [2024-11-26 23:20:28.832825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.832963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.833180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.833439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.833632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.833825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.833933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.834025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.834140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.834165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.834281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.834364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.834389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.834504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.834607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.834632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.834745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.834852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.834877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.834970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.835181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.835419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.835620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.835868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.835978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.836066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.836179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.836205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.836318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.836435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.836460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.836548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.836636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.836660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.836750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.836868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.836895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.836983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.837122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.837147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.837259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.837338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.837363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.837502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.837610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.837637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.837724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.837810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.837836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.837956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.838174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.838403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.838647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.838897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.838990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.839016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.839098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.839218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.839244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.839391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.839476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.839502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.839655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.839750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.839776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.839918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.840128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.840345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.840584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.840800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.840910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.841029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.841138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.841163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.841269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.841379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.841404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.553 qpair failed and we were unable to recover it. 00:28:02.553 [2024-11-26 23:20:28.841491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.553 [2024-11-26 23:20:28.841587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.841612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.841701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.841842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.841867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.841980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.842067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.842097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.842183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.842293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.842318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.842426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.842516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.842579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.842723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.842805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.842830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.842946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.843175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.843354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.843582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.843802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.843910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.843998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.844081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.844106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.844247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.844362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.844388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.844538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.844650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.844676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.844800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.844914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.844940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.845081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.845166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.845191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.845305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.845417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.845442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.845558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.845672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.845698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.845784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.845926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.845952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.846039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.846264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.846469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.846703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.846906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.846992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.847094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.847287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.847479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.847711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.847825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.847910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.848154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.848402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.848611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.848851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.848992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.849115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.849200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.849226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.849341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.849493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.849518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.849640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.849727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.849752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.849832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.849918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.849944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.850057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.850128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.850154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.554 qpair failed and we were unable to recover it. 00:28:02.554 [2024-11-26 23:20:28.850239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.554 [2024-11-26 23:20:28.850328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.850355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.850443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.850554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.850581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.850697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.850808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.850834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.850923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.851146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.851344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.851579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.851812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.851954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.852041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.852154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.852180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.852271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.852352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.852376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.852495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.852638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.852668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.852759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.852847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.852873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.852954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.853162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.853376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.853601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.853822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.853957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.854033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.854239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.854503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.854704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.854901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.854982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.855094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.855301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.855551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.855778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.855886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.855974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.856058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.856083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.856171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.856272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.856297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.856389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.856468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.856493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.555 qpair failed and we were unable to recover it. 00:28:02.555 [2024-11-26 23:20:28.856589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.856666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.555 [2024-11-26 23:20:28.856690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.856803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.856927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.856952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.857035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.857126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.857151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.857264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.857374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.857400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.857515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.857604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.857631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.857715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.857829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.857853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.857963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.858197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.858417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.858639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.858828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.858942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.859060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.859139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.859165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.859246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.859387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.859413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.859544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.859661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.859686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.859765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.859850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.859875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.859982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.860075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.860100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.860208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.860284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.860309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.860425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.860504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.860542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.860638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.860748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.860775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.860891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.861171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.861400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.861607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.556 qpair failed and we were unable to recover it. 00:28:02.556 [2024-11-26 23:20:28.861824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.556 [2024-11-26 23:20:28.861959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.861984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.862069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.862208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.862233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.862349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.862426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.862450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.862538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.862625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.862651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.862737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.862860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.862886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.863002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.863091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.863116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.863228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.863341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.863366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.863454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.863572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.863599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.863690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.863787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.557 [2024-11-26 23:20:28.863813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.557 qpair failed and we were unable to recover it. 00:28:02.557 [2024-11-26 23:20:28.863907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.864018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.864061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.851 qpair failed and we were unable to recover it. 00:28:02.851 [2024-11-26 23:20:28.864226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.864339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.864380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.851 qpair failed and we were unable to recover it. 00:28:02.851 [2024-11-26 23:20:28.864517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.864652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.864684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.851 qpair failed and we were unable to recover it. 00:28:02.851 [2024-11-26 23:20:28.864771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.864898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.864949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.851 qpair failed and we were unable to recover it. 00:28:02.851 [2024-11-26 23:20:28.865088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.865259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.865298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.851 qpair failed and we were unable to recover it. 00:28:02.851 [2024-11-26 23:20:28.865402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.865501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.865538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.851 qpair failed and we were unable to recover it. 00:28:02.851 [2024-11-26 23:20:28.865629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.865753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.851 [2024-11-26 23:20:28.865780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.851 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.865864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.865950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.865981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.866110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.866208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.866234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.866339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.866462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.866491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.866629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.866766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.866804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.866931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.867041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.867067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.867151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.867241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.867285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.867395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.867519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.867566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.867697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.867822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.867847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.867966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.868245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.868456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.868686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.868888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.868995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.869099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.869191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.869216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.869312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.869387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.869412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.869502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.869593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.869619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.869701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.869789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.869816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.869901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.870154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.870366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.870560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.870760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.870865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.870948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.871124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.871328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.871573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.871780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.871888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.871976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.872064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.872089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.852 qpair failed and we were unable to recover it. 00:28:02.852 [2024-11-26 23:20:28.872168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.852 [2024-11-26 23:20:28.872274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.872298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.872412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.872491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.872515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.872608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.872684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.872710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.872823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.872903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.872928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.873045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.873258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.873467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.873699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.873903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.873982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.874086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.874297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.874562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.874764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.874879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.874986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.875099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.875124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.875263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.875370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.875395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.875479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.875565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.875591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.875676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.875755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.875781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.875895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.876140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.876367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.876567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.876809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.876918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.877011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.877237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.877435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.877672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.877891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.877989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.878098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.878180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.878205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.878286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.878395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.878420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.853 qpair failed and we were unable to recover it. 00:28:02.853 [2024-11-26 23:20:28.878505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.853 [2024-11-26 23:20:28.878648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.878674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.878757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.878897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.878923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.879029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.879106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.879137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.879227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.879333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.879357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.879475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.879553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.879579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.879663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.879770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.879796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.879906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.880187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.880386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.880625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.880823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.880989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.881067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.881149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.881174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.881288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.881371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.881396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.881482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.881580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.881606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.881689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.881778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.881802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.881952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.882203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.882425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.882651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.882889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.882996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.883106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.883184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.883210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.883293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.883374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.883401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.883510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.883599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.883625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.883721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.883810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.883835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.883917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.884025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.884051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.884162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.884300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.884325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.884418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.884535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.884561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.884646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.884758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.854 [2024-11-26 23:20:28.884784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.854 qpair failed and we were unable to recover it. 00:28:02.854 [2024-11-26 23:20:28.884903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.884981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.885095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.885399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.885601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.885808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.885947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.886065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.886177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.886203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.886316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.886429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.886454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.886577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.886689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.886714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.886829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.886939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.886964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.887078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.887195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.887220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.887305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.887393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.887418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.887551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.887674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.887700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.887780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.887871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.887896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.888011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.888117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.888143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.888230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.888368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.888394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.888480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.888626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.888653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.888735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.888815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.888840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.888955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.889185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.889401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.889632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.889845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.889952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.890057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.890169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.890194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.890312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.890398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.890424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.890538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.890649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.890676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.890811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.890921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.890951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.891063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.891151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.891177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.891264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.891349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.891375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.855 qpair failed and we were unable to recover it. 00:28:02.855 [2024-11-26 23:20:28.891488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.891583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.855 [2024-11-26 23:20:28.891609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.891724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.891830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.891855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.891963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.892043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.892069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.892178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.892282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.892308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.892420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.892535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.892561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.892643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.892746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.892771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.892884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.893117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.893398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.893625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.893827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.893942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.894051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.894138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.894164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.894270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.894345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.894371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.894488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.894586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.894612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.894698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.894814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.894840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.894922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.895115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.895365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.895576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.895832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.895967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.896047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.896136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.896162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.896276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.896388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.896414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.896558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.896672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.896698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.896813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.896900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.856 [2024-11-26 23:20:28.896925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.856 qpair failed and we were unable to recover it. 00:28:02.856 [2024-11-26 23:20:28.897011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.897129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.897155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.897241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.897346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.897371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.897486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.897635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.897661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.897799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.897885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.897910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.898025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.898139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.898164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.898250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.898362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.898388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.898474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.898556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.898584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.898705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.898798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.898823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.898930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.899042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.899067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.899185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.899267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.899291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.899382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.899491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.899516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.899643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.899749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.899775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.899896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.900010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.900035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.900148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.900234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.900259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.900380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.900489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.900514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.900651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.900764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.900789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.900874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.901124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.901353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.901555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.901816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.901957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.902074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.902187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.902211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.902350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.902438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.902463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.902547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.902659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.902684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.902807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.902921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.902951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.903065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.903180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.903206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.903290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.903375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.903401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.903518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.903612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.903637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.857 [2024-11-26 23:20:28.903724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.903816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.857 [2024-11-26 23:20:28.903841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.857 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.903977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.904199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.904397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.904648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.904874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.904985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.905094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.905168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.905198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.905305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.905447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.905472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.905553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.905667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.905693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.905799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.905914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.905939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.906080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.906160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.906185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.906295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.906375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.906400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.906484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.906579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.906606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.906717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.906822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.906848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.906934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.907123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.907342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.907544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.907821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.907956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.908067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.908181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.908207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.908288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.908405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.908430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.908517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.908608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.908634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.908719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.908808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.908833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.908917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.909024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.909049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.909158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.909266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.909292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.909374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.909532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.909559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.909677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.909760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.909786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.909905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.910008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.910033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.910146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.910259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.910285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.858 qpair failed and we were unable to recover it. 00:28:02.858 [2024-11-26 23:20:28.910368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.858 [2024-11-26 23:20:28.910448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.910473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.910592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.910679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.910706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.910825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.910904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.910929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.911004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.911190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.911412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.911678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.911877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.911999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.912104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.912327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.912544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.912770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.912878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.913016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.913132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.913157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.913268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.913352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.913377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.913495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.913622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.913648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.913724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.913810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.913835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.913940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.914148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.914374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.914599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.914788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.914922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.915005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.915113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.915139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.915231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.915348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.915373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.915487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.915611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.915637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.915721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.915866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.915891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.916003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.916085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.916110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.916200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.916313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.916338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.916487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.916575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.916602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.916713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.916796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.859 [2024-11-26 23:20:28.916826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.859 qpair failed and we were unable to recover it. 00:28:02.859 [2024-11-26 23:20:28.916942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.917172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.917398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.917636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.917848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.917985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.918119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.918338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.918547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.918767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.918876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.919018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.919098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.919124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.919212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.919339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.919365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.919480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.919618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.919645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.919761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.919869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.919894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.920006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.920224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.920453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.920658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.920879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.920990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.921098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.921183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.921208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.921318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.921432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.921458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.921580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.921698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.921723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.921839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.921914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.921940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.922047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.922131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.922157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.922247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.922354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.922379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.922490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.922582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.922609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.922698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.922803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.922828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.922909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.923019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.860 [2024-11-26 23:20:28.923044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.860 qpair failed and we were unable to recover it. 00:28:02.860 [2024-11-26 23:20:28.923127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.923240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.923265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.923385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.923522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.923563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.923651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.923756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.923782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.923872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.923950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.923975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.924054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.924129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.924155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.924270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.924344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.924369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.924456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.924572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.924599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.924717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.924824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.924850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.924963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.925042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.925068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.925183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.925260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.925285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.925400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.925546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.925572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.925678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.925792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.925818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.925963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.926209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.926439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.926647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.926857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.926992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.927106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.927198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.927223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.927304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.927389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.927414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.927501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.927592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.927618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.927727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.927867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.927892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.928007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.928142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.928167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.928285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.928393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.928418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.928533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.928624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.928653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.928763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.928871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.928896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.928971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.929113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.929138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.929226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.929340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.861 [2024-11-26 23:20:28.929366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.861 qpair failed and we were unable to recover it. 00:28:02.861 [2024-11-26 23:20:28.929484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.929575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.929601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.929692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.929802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.929828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.929918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.930122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.930371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.930568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.930770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.930889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.931008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.931148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.931174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.931313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.931395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.931420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.931539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.931655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.931681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.931773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.931852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.931878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.931971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.932056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.932082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.932168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.932303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.932328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.932466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.932608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.932633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.932751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.932867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.932892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.932995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.933077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.933103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.933191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.933305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.933331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.933450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.933535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.933561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.933673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.933787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.933812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.933893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.934132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.934359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.934579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.934803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.934923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.935009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.935115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.935141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.935256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.935375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.935400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.935509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.935599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.935625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.935715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.935804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.935830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.862 [2024-11-26 23:20:28.935940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.936044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.862 [2024-11-26 23:20:28.936069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.862 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.936185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.936290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.936315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.936403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.936487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.936513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.936623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.936731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.936757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.936832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.936937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.936962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.937081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.937162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.937188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.937303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.937380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.937406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.937496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.937612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.937638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.937746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.937823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.937848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.937931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.938176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.938369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.938602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.938845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.938953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.939091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.939183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.939209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.939297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.939411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.939436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.939534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.939642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.939667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.939780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.939869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.939894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.939990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.940169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.940404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.940633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.940841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.940978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.941061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.941176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.941201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.941288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.941400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.941425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.941537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.941650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.941675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.941756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.941866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.941892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.942004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.942114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.942141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.942248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.942339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.942365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.863 qpair failed and we were unable to recover it. 00:28:02.863 [2024-11-26 23:20:28.942451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.863 [2024-11-26 23:20:28.942537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.942567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.942680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.942794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.942820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.942948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.943200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.943400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.943655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.943851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.943990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.944096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.944315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.944533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.944772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.944885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.945011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.945090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.945115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.945225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.945335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.945360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.945476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.945590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.945616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.945730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.945817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.945843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.945932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.946151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.946364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.946572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.946833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.946966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.947109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.947215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.947241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.947319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.947430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.947456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.947544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.947630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.947656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.947737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.947873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.947898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.948012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.948121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.948146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.948263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.948346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.948372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.948510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.948607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.948633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.948723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.948814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.948839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.948973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.949053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.949078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.864 qpair failed and we were unable to recover it. 00:28:02.864 [2024-11-26 23:20:28.949188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.864 [2024-11-26 23:20:28.949266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.949291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.949382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.949464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.949490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.949613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.949706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.949731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.949814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.949923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.949948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.950027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.950244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.950464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.950664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.950884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.950974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.951111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.951388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.951622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.951858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.951968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.952053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.952193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.952218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.952325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.952409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.952435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.952583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.952680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.952705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.952808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.952904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.952942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.953082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.953226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.953252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.953337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.953423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.953448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.953565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.953652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.953678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.953764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.953880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.953907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.953989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.954234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.954464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.954711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.865 qpair failed and we were unable to recover it. 00:28:02.865 [2024-11-26 23:20:28.954922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.865 [2024-11-26 23:20:28.954997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.955112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.955297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.955512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.955739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.955848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.955962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.956204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.956459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.956680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.956905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.956991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.957103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.957321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.957505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.957737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.957843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.957949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.958145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.958425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.958630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.958825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.958938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.959060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.959260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.959476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.959695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.959907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.959986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.960103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.960292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.960510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.960729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.960828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.960907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.961020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.866 [2024-11-26 23:20:28.961045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.866 qpair failed and we were unable to recover it. 00:28:02.866 [2024-11-26 23:20:28.961129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.961209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.961234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.961344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.961454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.961479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.961575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.961659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.961684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.961777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.961914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.961939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.962050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.962165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.962190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.962275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.962359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.962384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.962474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.962552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.962578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.962689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.962783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.962808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.962920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.963168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.963421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.963631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.963864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.963975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.964091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.964313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.964538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.964733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.964846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.964931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.965017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.965042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.965157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.965266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.965292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.965405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.965517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.965577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.965697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.965806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.965831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.965970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.966106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.966131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.966274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.966390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.966415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.966533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.966618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.966645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.966758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.966841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.966866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.967005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.967146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.967171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.967253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.967337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.967362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.967436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.967517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.967551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.867 [2024-11-26 23:20:28.967643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.967779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.867 [2024-11-26 23:20:28.967805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.867 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.967941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.968229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.968424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.968652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.968841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.968976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.969113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.969340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.969565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.969757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.969898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.970041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.970259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.970478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.970705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.970917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.970996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.971110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.971327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.971547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.971768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.971872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.971978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.972173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.972373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.972642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.972887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.972997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.973128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.973347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.973597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.973808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.973922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.974018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.974125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.974151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.868 qpair failed and we were unable to recover it. 00:28:02.868 [2024-11-26 23:20:28.974265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.868 [2024-11-26 23:20:28.974370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.974395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.974552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.974666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.974691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.974809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.974893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.974919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.975005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.975229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.975474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.975673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.975891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.975976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.976115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.976314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.976540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.976774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.976934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.977019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.977139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.977165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.977272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.977412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.977441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.977534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.977645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.977671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.977785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.977905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.977931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.978049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.978241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.978421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.978655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.978888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.978994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.979090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.979200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.979226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.979305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.979410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.979436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.979537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.979631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.979656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.979746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.979834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.979860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.979951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.980061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.980087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.980172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.980258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.980284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.980372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.980447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.980472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.980579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.980664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.869 [2024-11-26 23:20:28.980688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.869 qpair failed and we were unable to recover it. 00:28:02.869 [2024-11-26 23:20:28.980780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.980871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.980897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.980980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.981102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.981128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.981217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.981320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.981344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.981431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.981539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.981565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.981662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.981771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.981796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.981914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.982144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.982331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.982554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.982815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.982962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.983073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.983157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.983183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.983271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.983357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.983382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.983498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.983641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.983668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.983754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.983866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.983891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.984002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.984086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.984113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.984231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.984347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.984372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.984493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.984616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.984642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.984756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.984903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.984929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.985042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.985123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.985148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.985233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.985313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.985338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.985452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.985571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.985597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.985714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.985792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.985817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.985928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.986015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.986040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.870 [2024-11-26 23:20:28.986179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.986319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.870 [2024-11-26 23:20:28.986345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.870 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.986453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.986564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.986590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.986707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.986821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.986849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.986967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.987213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.987416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.987621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.987842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.987976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.988060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.988133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.988158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.988235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.988348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.988375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.988459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.988570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.988596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.988689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.988802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.988827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.988944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.989020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.989050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.989163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.989246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.989271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.989364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.989492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.989517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.989615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.989727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.989752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.989896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.990124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.990329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.990579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.990799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.990904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.991012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.991101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.991128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.991269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.991379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.991421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.991517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.991606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.991632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.991715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.991828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.991854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.991963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.992048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.992073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.992164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.992275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.992301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.992388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.992470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.871 [2024-11-26 23:20:28.992495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.871 qpair failed and we were unable to recover it. 00:28:02.871 [2024-11-26 23:20:28.992602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.992720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.992745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.992878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.992997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.993104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.993325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.993548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.993810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.993972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.994059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.994143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.994168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.994272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.994357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.994382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.994656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.994777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.994804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.994889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.994996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.995161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.995382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.995616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.995818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.995950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.996038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.996147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.996173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.996291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.996374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.996400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.996476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.996594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.996621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.996733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.996819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.996845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.996922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.997036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.997061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.997178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.997258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.997283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.997394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.997508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.997540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.997699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.997809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.997835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.997941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.998019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.998043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.998157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.998242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.998268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.998375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.998487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.998513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.998614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.998758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.998795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.998939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.999080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.999104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.999213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.999294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.999318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.872 [2024-11-26 23:20:28.999434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.999545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.872 [2024-11-26 23:20:28.999580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.872 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:28.999695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:28.999792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:28.999818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:28.999926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.000134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.000381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.000648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.000856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.000967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.001073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.001166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.001191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.001303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.001411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.001437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.001563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.001701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.001726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.001839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.001915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.001940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.002077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.002155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.002180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.002255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.002395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.002420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.002531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.002619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.002644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.002730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.002840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.002865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.002945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.003057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.003084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.003198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.003313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.003339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.003481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.003578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.003610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.003697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.003806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.003832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.003920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.004172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.004431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.004635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.004855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.004962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.005073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.005154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.005179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.005270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.005354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.005379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.005468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.005563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.005590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.005702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.005812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.005838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.005931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.006021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.006046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.873 qpair failed and we were unable to recover it. 00:28:02.873 [2024-11-26 23:20:29.006156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.873 [2024-11-26 23:20:29.006267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.006292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.006402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.006490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.006515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.006614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.006696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.006721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.006831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.006966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.006991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.007063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.007177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.007203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.007284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.007396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.007422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.007536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.007643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.007669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.007745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.007837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.007862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.007951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.008141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.008350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.008610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.008810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.008949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.009089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.009177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.009202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.009352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.009432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.009457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.009575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.009686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.009711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.009829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.009969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.009995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.010080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.010201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.010226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.010319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.010396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.010420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.010543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.010642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.010668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.010746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.010835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.010861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.010940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.011054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.011080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.011217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.011329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.011354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.011465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.011575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.011602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.011690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.011803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.874 [2024-11-26 23:20:29.011829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.874 qpair failed and we were unable to recover it. 00:28:02.874 [2024-11-26 23:20:29.011919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.012133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.012335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.012550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.012787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.012898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.012978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.013186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.013428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.013657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.013856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.013990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.014101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.014207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.014233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.014323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.014436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.014462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.014553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.014630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.014656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.014737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.014816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.014840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.014955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.015066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.015095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.015174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.015294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.015319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.015399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.015505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.015562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.015680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.015793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.015818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.015961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.016205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.016411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.016604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.016830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.016939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.017063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.017144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.017169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.017250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.017358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.017383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.017501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.017617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.017642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.017721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.017855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.017880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.018001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.018088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.018113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.875 [2024-11-26 23:20:29.018231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.018351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.875 [2024-11-26 23:20:29.018376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.875 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.018460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.018571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.018598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.018688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.018803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.018829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.018935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.019050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.019075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.019202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.019315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.019340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.019427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.019566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.019592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.019712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.019861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.019886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.020038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.020175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.020201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.020311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.020434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.020459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.020647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.020786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.020813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.020903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.020989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.021153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.021348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.021593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.021817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.021918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.022008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.022091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.022116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.022234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.022311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.022337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.022438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.022523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.022557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.022669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.022786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.022812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.022905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.023030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.023055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.023174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.023301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.023327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.023437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.023543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.023569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.023679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.023764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.023790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.023902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.024146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.024355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.024590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.024815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.024948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.025032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.025145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.025171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.876 qpair failed and we were unable to recover it. 00:28:02.876 [2024-11-26 23:20:29.025253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.876 [2024-11-26 23:20:29.025366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.025392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.025476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.025580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.025606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.025698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.025790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.025815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.025895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.025967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.025992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.026104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.026194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.026219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.026361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.026465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.026489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.026587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.026673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.026699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.026788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.026899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.026924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.027043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.027155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.027184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.027272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.027353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.027378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.027465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.027547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.027573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.027694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.027806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.027831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.027969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.028198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.028422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.028619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.028899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.028993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.029100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.029321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.029597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.029787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.029952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.030036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.030147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.030172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.030254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.030335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.030360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.030475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.030621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.030646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.030784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.030873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.030898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.030991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.031068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.031093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.031202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.031279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.031304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.031418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.031532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.031559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.031651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.031730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.877 [2024-11-26 23:20:29.031754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.877 qpair failed and we were unable to recover it. 00:28:02.877 [2024-11-26 23:20:29.031868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.031983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.032121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.032303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.032547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.032783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.032898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.032995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.033191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.033393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.033628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.033874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.033978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.034105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.034188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.034212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.034301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.034415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.034440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.034536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.034647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.034672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.034765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.034845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.034876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.034960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.035208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.035397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.035610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.035795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.035934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.036029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.036110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.036135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.036248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.036389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.036415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.036495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.036603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.036630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.036738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.036845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.036869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.036987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.037180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.037406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.037647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.037876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.037992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.038017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 23:20:29.038101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.038185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.878 [2024-11-26 23:20:29.038210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.038312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.038420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.038445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.038533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.038663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.038689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.038814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.038898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.038923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.039060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.039173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.039198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.039306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.039429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.039455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.039570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.039659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.039684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.039806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.039895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.039920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.040009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.040203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.040422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.040646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.040856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.040964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.041077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.041221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.041246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.041334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.041415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.041440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.041520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.041615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.041639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.041749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.041828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.041853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.041967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.042047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.042073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.042153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.042242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.042269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.042386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.042497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.042522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.042691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.042810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.042835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.042918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.043164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.043417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.043655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.043869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.879 [2024-11-26 23:20:29.043982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 23:20:29.044095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.044188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.044214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.044324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.044413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.044439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.044518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.044614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.044639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.044773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.044861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.044886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.044997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.045134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.045159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.045244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.045384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.045409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.045500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.045629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.045656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.045752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.045856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.045881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.045990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.046076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.046101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.046245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.046356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.046382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.046522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.046623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.046649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.046733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.046825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.046852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.046969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.047045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.047070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.047156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.047242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.047268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.047408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.047497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.047522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.047649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.047755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.047788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.047899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.048156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.048377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.048607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.048871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.048979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.049083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.049333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.049577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.049776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.049885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.049969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.050080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.050104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.050217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.050302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.050332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.050446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.050550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.050601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 23:20:29.050714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.050799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.880 [2024-11-26 23:20:29.050823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.050934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.051180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.051365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.051608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.051818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.051982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.052070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.052184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.052208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.052291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.052406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.052429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.052548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.052668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.052692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.052806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.052950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.052979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.053124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.053207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.053230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.053308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.053438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.053465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.053571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.053680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.053706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.053825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.053934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.053960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.054039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.054150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.054175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.054314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.054421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.054447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.054537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.054621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.054658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.054786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.054901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.054927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.055040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.055239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.055436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.055683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.055874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.055984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.056091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.056199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.056224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.056333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.056438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.056464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.056561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.056649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.056674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.056769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.056852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.056877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.056988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.057126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.057151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.057300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.057387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.057412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.881 qpair failed and we were unable to recover it. 00:28:02.881 [2024-11-26 23:20:29.057533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.881 [2024-11-26 23:20:29.057647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.057672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.057774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.057913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.057938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.058051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.058145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.058170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.058283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.058373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.058398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.058507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.058598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.058623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.058736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.058814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.058840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.058948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.059188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.059418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.059644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.059893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.059997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.060099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.060189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.060216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.060332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.060415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.060441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.060521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.060642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.060667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.060785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.060891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.060916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.061025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.061134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.061160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.061300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.061384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.061409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.061545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.061664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.061690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.061800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.061915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.061940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.062022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.062112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.062138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.062259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.062394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.062420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.062510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.062637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.062664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.062749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.062864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.062889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.062978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.063235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.063439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.063647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.063831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.063961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.064053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.064167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.882 [2024-11-26 23:20:29.064192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.882 qpair failed and we were unable to recover it. 00:28:02.882 [2024-11-26 23:20:29.064271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.064355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.064379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.064464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.064578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.064605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.064687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.064799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.064831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.064938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.065184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.065378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.065613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.065811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.065950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.066028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.066176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.066201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.066314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.066457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.066482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.066617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.066756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.066781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.066867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.067115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.067317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.067539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.067799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.067908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.068001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.068094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.068121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.068231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.068338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.068363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.068500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.068596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.068623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.068710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.068801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.068826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.068904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.069153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.069411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.069635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.069874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.069985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.070076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.070160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.070188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.070329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.070441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.070467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.070584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.070691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.070716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.883 [2024-11-26 23:20:29.070828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.070970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.883 [2024-11-26 23:20:29.070996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.883 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.071084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.071193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.071218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.071308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.071392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.071417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.071502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.071591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.071617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.071733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.071817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.071843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.071943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.072076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.072101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.072241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.072358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.072382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.072465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.072580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.072606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.072689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.072793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.072819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.072902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.073120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.073312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.073539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.073770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.073870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.073979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.074210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.074446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.074675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.074867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.074978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.075091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.075185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.075210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.075302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.075418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.075443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.075585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.075669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.075698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.075789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.075925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.075951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.076091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.076206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.076231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.076343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.076451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.076476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.884 [2024-11-26 23:20:29.076599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.076686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.884 [2024-11-26 23:20:29.076716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.884 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.076809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.076898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.076924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.077044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.077149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.077175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.077269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.077355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.077380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.077519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.077661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.077688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.077795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.077875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.077900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.078018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.078103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.078130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.078242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.078352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.078377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.078470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.078606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.078631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.078743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.078826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.078851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.078958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.079169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.079395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.079632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.079819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.079925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.080034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.080128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.080153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.080233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.080312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.080337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.080453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.080543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.080569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.080653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.080765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.080790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.080873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.081131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.081356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.081603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.081826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.081942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.082083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.082224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.082249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.082330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.082433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.082458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.082572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.082687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.082713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.082800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.082878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.082903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.083018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.083111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.083137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.885 qpair failed and we were unable to recover it. 00:28:02.885 [2024-11-26 23:20:29.083221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.083307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.885 [2024-11-26 23:20:29.083333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.083472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.083586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.083612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.083705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.083820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.083846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.083937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.084159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.084439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.084697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.084911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.084992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.085111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.085329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.085567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.085758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.085894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.085986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.086143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.086168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.086265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.086370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.086395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.086476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.086580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.086606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.086686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.086799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.086825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.086935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.087018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.087044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.087151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.087969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.088000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.088125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.088215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.088240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.088333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.088444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.088469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.088563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.088674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.088699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.088846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.088988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.089014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.089124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.089233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.089259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.089398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.089509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.089543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.089662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.089776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.089809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.089918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.090042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.090068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.090184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.090267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.090293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.090403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.090517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.090552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.090669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.090790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.090816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.886 qpair failed and we were unable to recover it. 00:28:02.886 [2024-11-26 23:20:29.090935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.886 [2024-11-26 23:20:29.091046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.091071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.091214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.091291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.091316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.091402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.091473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.091498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.091629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.091741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.091771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.091918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.092119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.092336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.092570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.092800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.092912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.093017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.093125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.093150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.093233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.093348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.093375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.093490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.093619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.093647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.093723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.093837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.093863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.093984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.094088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.094113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.094208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.094329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.094356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.094472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.094586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.094613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.094694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.094811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.094837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.094983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.095122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.095148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.095233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.095336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.095361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.095475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.095554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.095582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.095693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.095814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.095840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.095927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.096036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.096062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.096173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.096281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.096306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.096445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.096535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.096573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.096665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.096773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.096800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.096954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.097036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.097061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.097144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.097222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.097248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.097328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.097430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.097455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.097568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.097708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.887 [2024-11-26 23:20:29.097734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.887 qpair failed and we were unable to recover it. 00:28:02.887 [2024-11-26 23:20:29.097861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.097976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.098145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.098344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.098599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.098858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.098970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.099064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.099151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.099176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.099324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.099430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.099456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.099581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.099661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.099688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.099772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.099861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.099887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.100002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.100246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.100462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.100684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.100914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.100998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.101022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.101142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.101280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.101306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.101416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.101506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.101538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.101665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.101787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.101812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.101931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.102184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.102376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.102627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.102817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.102915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.103027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.103120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.103146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.103231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.103348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.103373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.103463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.103579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.103605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.888 qpair failed and we were unable to recover it. 00:28:02.888 [2024-11-26 23:20:29.103691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.888 [2024-11-26 23:20:29.103808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.103838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.104055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.104155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.104184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.104286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.104379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.104415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.104549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.104659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.104686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.104823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.104943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.104971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.105088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.105174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.105202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.105312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.105405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.105431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.105570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.105690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.105717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.105844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.105972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.105999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.106091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.106207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.106232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.106353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.106447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.106478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.106586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.106714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.106741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.106868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.106990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.107112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.107315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.107514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.107750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.107881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.108006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.108152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.108178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.108273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.108360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.108387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.108508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.108617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.108646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.108732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.110536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.110580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.110681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.110785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.110811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.110928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.111152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.111407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.111620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.111852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.111977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.112004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.112165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.112285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.112312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.889 qpair failed and we were unable to recover it. 00:28:02.889 [2024-11-26 23:20:29.112406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.112491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.889 [2024-11-26 23:20:29.112517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.112623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.112739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.112766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.112909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.113054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.113080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.113175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.113298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.113325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.115537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.115674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.115701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.115794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.115913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.115940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.116018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.116111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.116138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.116252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.116347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.116373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.116468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.116562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.116590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.116721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.116845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.116872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.116957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.117051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.117079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.117170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.117262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.117289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.117407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.117493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.117520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.117656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.117747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.117773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.117890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.118126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.118352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.118617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.118912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.118999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.119025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.121534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.121706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.121734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.121864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.121998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.122025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.122136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.122256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.122282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.122366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.122478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.122505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.122660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.122787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.122814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.122933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.123050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.123076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.123163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.123254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.123280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.123475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.123560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.123587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.890 [2024-11-26 23:20:29.123719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.123821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.890 [2024-11-26 23:20:29.123857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.890 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.124005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.124161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.124197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.124361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.124519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.124575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.124687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.124795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.124831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.124950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.125085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.125115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.125264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.125378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.125404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.125502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.125595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.125623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.125715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.125835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.125861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.125951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.126154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.126369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.126644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.126865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.126981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.127078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.127164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.127191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.127299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.127390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.127416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.127501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.127618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.127645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.127768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.127881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.127907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.127994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.128101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.128127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.128203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.128314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.128340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.128460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.128572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.128599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.128713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.128828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.128855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.128971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.129083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.129111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.129199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.129311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.129338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.129450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.129542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.129570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.129683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.129819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.129846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.129972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.130088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.130114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.130202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.130317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.130344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.130434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.130550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.130579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.891 qpair failed and we were unable to recover it. 00:28:02.891 [2024-11-26 23:20:29.130695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.130817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.891 [2024-11-26 23:20:29.130843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.130939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.131027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.131054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.131141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.131267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.131294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.131409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.131521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.131553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.131670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.131755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.131781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.131923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.132010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.132036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.132124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.132233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.132259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.132374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.132467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.132493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.132611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.132753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.132790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.132925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.133027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.133065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.133216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.133329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.133367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.133507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.133631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.133668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.133768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.133858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.133887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.133970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.134085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.134111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.134224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.134328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.134354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.134435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.134528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.134556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.134646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.134723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.134749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.134865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.135137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.135435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.135673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.135870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.135980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.136083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.136305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.136556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.136785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.892 [2024-11-26 23:20:29.136923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.892 qpair failed and we were unable to recover it. 00:28:02.892 [2024-11-26 23:20:29.137012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.137127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.137152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.137244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.137378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.137405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.137513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.137606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.137633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.137742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.137950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.137976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.138058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.138195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.138221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.138328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.138444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.138469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.138650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.138740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.138766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.138854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.138939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.138964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.139074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.139213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.139238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.139327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.139413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.139439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.139585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.139698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.139724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.139842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.140129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.140378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.140584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.140802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.140918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.141029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.141110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.141136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.141257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.141337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.141363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.141449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.141556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.141582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.141666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.141774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.141799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.141891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.142071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.142097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.142181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.142314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.142339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.142454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.142540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.142566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.893 qpair failed and we were unable to recover it. 00:28:02.893 [2024-11-26 23:20:29.142666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.893 [2024-11-26 23:20:29.142754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.142779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.142920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.143028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.143053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.143150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.143273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.143298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.143482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.143608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.143633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.143716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.143808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.143832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.143941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.144163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.144407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.144617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.144834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.144970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.145090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.145231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.145256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.145363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.145435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.145460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.145543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.145627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.145653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.145774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.145882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.145907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.145993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.146206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.146405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.146622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.146874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.146987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.147097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.147356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.147563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.147817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.147950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.148088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.148175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.148200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.148281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.148417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.148444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.148535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.148619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.148644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.148752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.148894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.148920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.148999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.149108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.149135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.894 qpair failed and we were unable to recover it. 00:28:02.894 [2024-11-26 23:20:29.149243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.149349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.894 [2024-11-26 23:20:29.149375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.149458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.149595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.149622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.149734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.149820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.149846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.149921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.149995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.150128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.150413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.150619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.150807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.150940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.151055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.151139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.151165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.151254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.151334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.151359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.151471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.151592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.151618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.151710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.151843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.151869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.151983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.152085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.152115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.152225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.152329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.152355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.152495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.152616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.152643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.152754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.152865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.152892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.153007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.153118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.153144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.153235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.153346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.153371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.153486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.153568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.153594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.153705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.153793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.153820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.153910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.154047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.154072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.154214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.154295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.154320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.154409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.154481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.154510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.154649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.154772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.154797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.154908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.155011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.155036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.155126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.155229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.155255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.895 qpair failed and we were unable to recover it. 00:28:02.895 [2024-11-26 23:20:29.155335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.895 [2024-11-26 23:20:29.155449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.155474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.155582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.155657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.155684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.155795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.155880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.155906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.156049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.156174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.156200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.156313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.156434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.156460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.156576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.156654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.156680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.156819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.156961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.156987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.157079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.157170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.157196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.157337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.157454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.157480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.157606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.157729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.157755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.157880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.157992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.158113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.158346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.158617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.158854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.158992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.159103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.159194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.159219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.159333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.159414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.159442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.159559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.159673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.159700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.159780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.159860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.159886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.159999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.160110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.160136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.160244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.160390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.160416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.160532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.160649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.160675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.160800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.160913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.160938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.161030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.161138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.161164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.161287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.161394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.161420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.161554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.161637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.161663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.161779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.161887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.161912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.161988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.162103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.162129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.162219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.162332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.162359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.896 [2024-11-26 23:20:29.162472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.162583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.896 [2024-11-26 23:20:29.162610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.896 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.162726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.162810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.162836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.162951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.163035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.163060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.163137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.163244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.163270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.163386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.163467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.163492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.163610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.163723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.163748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.163883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.164166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.164377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.164610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.164860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.164998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.165078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.165188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.165213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.165326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.165434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.165460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.165563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.165674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.165700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.165808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.165887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.165913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.165994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.166078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.166103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.166221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.166301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.166326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.166405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.166531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.166558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.166669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.166791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.166821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.166904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.167042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.167068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.167158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.167278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.167304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.167420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.167559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.167587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.167704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.167810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.167836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.167909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.168164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.168423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.168685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.168876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.168987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.169098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.169238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.169263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.169409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.169522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.169558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.169693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.169781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.169806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.897 qpair failed and we were unable to recover it. 00:28:02.897 [2024-11-26 23:20:29.169917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.897 [2024-11-26 23:20:29.169995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.170131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.170378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.170616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.170849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.170952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.171062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.171157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.171182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.171296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.171402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.171428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.171507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.171616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.171641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.171728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.171834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.171860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.171948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.172066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.172092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.172205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.172322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.172348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.172435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.172580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.172606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.172689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.172809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.172834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.172953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.173174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.173395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.173657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.173862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.173959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.174074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.174191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.174217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.174333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.174471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.174496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.174631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.174718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.174744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.174827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.174905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.174930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.898 [2024-11-26 23:20:29.175011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.175084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.898 [2024-11-26 23:20:29.175110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.898 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.175222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.175302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.175327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.175439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.175529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.175556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.175671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.175758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.175795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.175879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.175984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.176092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.176341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.176565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.176792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.176935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.177049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.177154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.177180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.177293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.177433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.177459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.177586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.177700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.177726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.177814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.177927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.177953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.178070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.178155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.178180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.178291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.178431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.178457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.178541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.178636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.178660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.899 qpair failed and we were unable to recover it. 00:28:02.899 [2024-11-26 23:20:29.178799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.899 [2024-11-26 23:20:29.178888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.178920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.179032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.179144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.179170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.179249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.179366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.179392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.179535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.179629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.179654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.179792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.179903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.179929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.180021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.180102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.180128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.180233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.180359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.180385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.180495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.180612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.180639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.180724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.180845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.180870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.180979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.181087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.181113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.181253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.181360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.181385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.181472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.181593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.181620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.181760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.181851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.181876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.181969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.182082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.182108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.182250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.182339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.182366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.182452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.182570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.182596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.182739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.182814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.182838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.182923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.183060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.183086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.183204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.183355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.183381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.183497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.183620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.900 [2024-11-26 23:20:29.183646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.900 qpair failed and we were unable to recover it. 00:28:02.900 [2024-11-26 23:20:29.183760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.183916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.183941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.184060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.184134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.184159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.184245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.184353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.184378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.184493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.184600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.184625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.184706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.184827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.184853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.184942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.185199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.185420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.185639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.185855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.185965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.186083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.186224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.186250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.186372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.186457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.186483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.186618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.186710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.186736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.186858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.186942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.186968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.187052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.187179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.187205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.187288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.187398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.187423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.187507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.187664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.187691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.187796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.187882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.187908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.188023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.188133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.188159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.901 [2024-11-26 23:20:29.188248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.188331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.901 [2024-11-26 23:20:29.188356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.901 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.188464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.188549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.188587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.188711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.188856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.188883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.188994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.189079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.189105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.189247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.189332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.189358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.189437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.189520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.189552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.189665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.189776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.189801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.189912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.190048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.190075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.190152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.190265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.190291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.190433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.190519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.190554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.190636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.190750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.190788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.190901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.191043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.191069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.191189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.191279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.191310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.191383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.191490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.191516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.191668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.191765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.191800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.191886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.192110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.192357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.192605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.192818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.192938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.902 qpair failed and we were unable to recover it. 00:28:02.902 [2024-11-26 23:20:29.193027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.902 [2024-11-26 23:20:29.193109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.193134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.193212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.193318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.193344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.193450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.193531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.193559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.193676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.193789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.193814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.193902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.194142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.194335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.194533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.194805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.194944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.195057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.195160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.195185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.195297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.195402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.195428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.195506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.195632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.195658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.195743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.195838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.195863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.195962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.196070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.196094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.196207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.196296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.196322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.196447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.196567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.196595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.196673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.196783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.196808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.196893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.197028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.197054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.197141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.197281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.197307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.197424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.197567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.197594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.903 qpair failed and we were unable to recover it. 00:28:02.903 [2024-11-26 23:20:29.197706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.903 [2024-11-26 23:20:29.197844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.197870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.198011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.198124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.198162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.198244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.198381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.198407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.198492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.198590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.198617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.198734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.198843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.198879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.198987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.199063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.199087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.199194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.199321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.199347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.199439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.199542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.199578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.199667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.199748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.199774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.199884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.200113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.200290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.200513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.200750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.200898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.200988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.201128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.201153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.904 [2024-11-26 23:20:29.201271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.201375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.904 [2024-11-26 23:20:29.201400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.904 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.201511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.201638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.201664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.201751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.201849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.201875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.201985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.202075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.202101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.202219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.202335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.202359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.202448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.202537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.202575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.202674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.202764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.202800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.202895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.203007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.203032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.203110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.203188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.203217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.203417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.203534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.203561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.203659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.203768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.203792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.203910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.204025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.204049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.204190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.204274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.204298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.204415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.204535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.204574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.204683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.204770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.204797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.204889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.205000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.205025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.205140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.205259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.205285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.205372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.205456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.205481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.205661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.205806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.205850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.206013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.206151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.206178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.905 qpair failed and we were unable to recover it. 00:28:02.905 [2024-11-26 23:20:29.206267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.905 [2024-11-26 23:20:29.206363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.206389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.206475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.206572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.206598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.206688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.206798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.206826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.206943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.207035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.207060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.207175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.207289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.207325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.207401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.207545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.207578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.207672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.207773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.207804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.207896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.208168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.208430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.208671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.208889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.208979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.209112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.209318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.209592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.209822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.209939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.210061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.210171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.210197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.210282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.210403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.210431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.210519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.210658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.210684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.210803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.210889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.906 [2024-11-26 23:20:29.210914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.906 qpair failed and we were unable to recover it. 00:28:02.906 [2024-11-26 23:20:29.211003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.211197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.211452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.211672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.211889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.211988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.212128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.212368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.212601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.212854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.907 [2024-11-26 23:20:29.212964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:02.907 qpair failed and we were unable to recover it. 00:28:02.907 [2024-11-26 23:20:29.213079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.213218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.213257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.226 qpair failed and we were unable to recover it. 00:28:03.226 [2024-11-26 23:20:29.213405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.213556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.213599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.226 qpair failed and we were unable to recover it. 00:28:03.226 [2024-11-26 23:20:29.213732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.213870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.213929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.226 qpair failed and we were unable to recover it. 00:28:03.226 [2024-11-26 23:20:29.214097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.214216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.214267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.226 qpair failed and we were unable to recover it. 00:28:03.226 [2024-11-26 23:20:29.214436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.214566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.214594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.226 qpair failed and we were unable to recover it. 00:28:03.226 [2024-11-26 23:20:29.214698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.214822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.214849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.226 qpair failed and we were unable to recover it. 00:28:03.226 [2024-11-26 23:20:29.214952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.226 [2024-11-26 23:20:29.215056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.215083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.215196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.215321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.215349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.215496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.215660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.215698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.215827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.215915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.215949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.216083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.216215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.216248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.216356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.216503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.216549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.216654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.216790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.216819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.216961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.217212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.217470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.217720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.217905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.217989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.218134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.218352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.218585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.218815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.218953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.219040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.219115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.219140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.219255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.219342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.219366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.219478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.219567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.219593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.219712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.219826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.219851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.219974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.220051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.220076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.220185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.220291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.220316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.220427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.220540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.220577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.220661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.220775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.220807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.220910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.221032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.221057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.221146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.221226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.221253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.221396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.221544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.221570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.221711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.221800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.221826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.227 [2024-11-26 23:20:29.221941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.222055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.227 [2024-11-26 23:20:29.222081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.227 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.222221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.222310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.222335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.222418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.222561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.222588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.222669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.222784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.222810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.222934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.223154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.223362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.223641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.223829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.223961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.224039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.224177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.224203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.224344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.224482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.224507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.224637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.224719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.224746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.224862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.224952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.224979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.225086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.225232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.225257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.225377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.225497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.225522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.225623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.225707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.225733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.225812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.225928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.225953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.226042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.226155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.226188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.226278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.226414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.226440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.226532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.226643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.226668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.226781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.226867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.226893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.227005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.227231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.227413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.227637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.227881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.227983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.228090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.228229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.228255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.228332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.228420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.228447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.228538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.228650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.228676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.228 [2024-11-26 23:20:29.228768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.228880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.228 [2024-11-26 23:20:29.228906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.228 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.229004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.229093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.229120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.229261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.229348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.229373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.229488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.229593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.229619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.229714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.229824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.229850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.229940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.230125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.230372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.230625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.230886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.230991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.231135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.231345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.231583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.231778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.231913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.231998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.232113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.232139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.232254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.232335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.232361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.232470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.232554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.232592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.232682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.232767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.232796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.232917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.233023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.233048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.233178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.233319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.233344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.233458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.233540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.233578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.233672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.233763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.233789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.233897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.234147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.234365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.234548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.234803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.234916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.235024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.235133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.235169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.235256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.235377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.235403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.229 qpair failed and we were unable to recover it. 00:28:03.229 [2024-11-26 23:20:29.235549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.235634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.229 [2024-11-26 23:20:29.235659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.235744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.235853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.235879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.235963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.236046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.236071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.236179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.236323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.236348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.236464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.236550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.236577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.236687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.236829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.236854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.236932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.237164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.237443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.237672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.237863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.237982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.238119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.238374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.238611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.238811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.238951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.239060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.239132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.239158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.239246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.239359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.239385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.239491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.239610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.239636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.239727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.239833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.239859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.239967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.240083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.240109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.240207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.240350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.240376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.240502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.240599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.240625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.240739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.240850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.240875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.240963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.241156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.241351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.241567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.241805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.241969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.230 [2024-11-26 23:20:29.242082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.242222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.230 [2024-11-26 23:20:29.242247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.230 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.242331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.242411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.242437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.242546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.242640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.242671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.242780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.242887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.242913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.243052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.243165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.243190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.243308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.243391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.243416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.243522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.243643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.243668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.243758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.243836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.243862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.243974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.244204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.244431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.244671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.244861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.244973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.245123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.245346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.245607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.245825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.245937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.246044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.246132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.246157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.246242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.246326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.246352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.246432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.246559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.246586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.246705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.246819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.246844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.246961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.247039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.247064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.247204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.247309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.247344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.247430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.247575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.247602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.247712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.247820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.247846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.231 qpair failed and we were unable to recover it. 00:28:03.231 [2024-11-26 23:20:29.247928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.231 [2024-11-26 23:20:29.248037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.248063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.248146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.248225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.248251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.248375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.248494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.248519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.248642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.248753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.248779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.248896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.249035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.249061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.249169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.249286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.249311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.249450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.249539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.249565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.249677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.249791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.249817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.249898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.250144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.250393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.250640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.250861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.250995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.251077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.251222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.251248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.251332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.251446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.251472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.251585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.251697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.251724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.251815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.251901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.251926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.252046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.252160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.252186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.252323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.252414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.252446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.252564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.252671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.252697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.252782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.252896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.252922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.253030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.253117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.253144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.253229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.253342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.253368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.253478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.253588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.253613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.253726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.253808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.253834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.253916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.254057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.254083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.254223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.254329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.254355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.254477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.254591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.254618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.254702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.254789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.254815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.232 qpair failed and we were unable to recover it. 00:28:03.232 [2024-11-26 23:20:29.254929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.232 [2024-11-26 23:20:29.255034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.255167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.255375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.255590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.255878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.255993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.256115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.256202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.256228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.256311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.256397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.256423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.256537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.256646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.256671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.256793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.256935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.256961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.257073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.257187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.257217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.257325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.257443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.257470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.257559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.257695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.257721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.257804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.257916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.257941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.258079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.258224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.258249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.258364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.258445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.258481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.258620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.258737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.258762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.258879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.259125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.259340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.259590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.259842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.259976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.260099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.260211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.260236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.260324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.260401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.260426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.260506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.260595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.260621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.260704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.260812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.260837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.260977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.261088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.261113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.261253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.261353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.261379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.261457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.261581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.261608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.261699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.261777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.233 [2024-11-26 23:20:29.261802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.233 qpair failed and we were unable to recover it. 00:28:03.233 [2024-11-26 23:20:29.261913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.262130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.262360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.262628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.262815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.262979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.263068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.263157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.263183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.263290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.263368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.263394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.263491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.263591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.263617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.263734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.263852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.263877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.263991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.264064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.264089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.264234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.264354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.264379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.264497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.264596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.264623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.264709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.264824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.264851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.264929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.265143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.265420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.265637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.265868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.265977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.266093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.266177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.266202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.266326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.266407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.266432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.266567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.266681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.266707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.266792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.266937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.266963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.267080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.267196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.267221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.267334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.267471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.267497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.267590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.267731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.267756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.267893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.267974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.268000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.268107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.268183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.268209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.268319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.268427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.268453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.234 qpair failed and we were unable to recover it. 00:28:03.234 [2024-11-26 23:20:29.268572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.268715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.234 [2024-11-26 23:20:29.268741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.268881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.268971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.268996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.269086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.269228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.269254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.269335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.269423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.269452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.269562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.269673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.269699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.269834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.269978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.270111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.270358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.270640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.270844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.270948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.271062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.271171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.271196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.271321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.271430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.271455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.271571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.271660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.271685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.271810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.271930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.271956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.272045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.272155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.272181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.272275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.272383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.272410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.272522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.272670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.272696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.272807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.272923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.272948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.273064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.273188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.273214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.273320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.273446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.273472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.273559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.273649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.273675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.273765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.273859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.273884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.274024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.274144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.274169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.274256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.274342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.274369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.274487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.274627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.274654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.274791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.274869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.274894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.235 qpair failed and we were unable to recover it. 00:28:03.235 [2024-11-26 23:20:29.275000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.235 [2024-11-26 23:20:29.275077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.275103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.275215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.275297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.275322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.275410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.275496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.275521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.275647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.275783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.275808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.275931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.276166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.276349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.276606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.276884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.276988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.277082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.277166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.277191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.277305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.277385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.277410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.277523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.277612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.277638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.277740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.277847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.277872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.278030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.278136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.278161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.278256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.278394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.278419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.278496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.278617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.278644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.278757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.278894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.278919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.279042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.279129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.279154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.279228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.279317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.279342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.279482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.279574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.279600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.279689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.279801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.279827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.279962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.280187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.280419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.280650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.280904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.280992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.281018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.281141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.281257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.281283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.281396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.281520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.281553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.236 [2024-11-26 23:20:29.281638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.281731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.236 [2024-11-26 23:20:29.281761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.236 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.281881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.282008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.282034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.282151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.282238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.282264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.282381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.282463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.282488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.282631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.282757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.282783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.282922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.283133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.283356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.283553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.283798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.283905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.284014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.284095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.284123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.284273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.284360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.284387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.284473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.284560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.284586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.284692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.284830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.284856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.284997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.285137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.285163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.285255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.285364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.285390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.285538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.285646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.285672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.285762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.285850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.285875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.285968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.286207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.286412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.286644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.286880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.286990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.287105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.287359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.287550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.287786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.287902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.287981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.288098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.288123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.288212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.288300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.288325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.237 qpair failed and we were unable to recover it. 00:28:03.237 [2024-11-26 23:20:29.288437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.288554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.237 [2024-11-26 23:20:29.288581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.288692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.288799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.288825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.288941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 327531 Killed "${NVMF_APP[@]}" "$@" 00:28:03.238 [2024-11-26 23:20:29.289060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.289086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.289199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.289303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.289328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 23:20:29 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:28:03.238 [2024-11-26 23:20:29.289443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.289581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.289607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 23:20:29 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:28:03.238 [2024-11-26 23:20:29.289719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 23:20:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:03.238 [2024-11-26 23:20:29.289857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.289884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.289970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 23:20:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:03.238 23:20:29 -- common/autotest_common.sh@10 -- # set +x 00:28:03.238 [2024-11-26 23:20:29.290926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.290958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.291078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.291161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.291188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.291890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.292038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.292065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.292156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.292268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.292295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.292387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.292532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.292559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.292682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.292802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.292828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.292922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.293000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.293026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.293115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.293227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.293253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 23:20:29 -- nvmf/common.sh@469 -- # nvmfpid=328199 00:28:03.238 23:20:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:28:03.238 23:20:29 -- nvmf/common.sh@470 -- # waitforlisten 328199 00:28:03.238 [2024-11-26 23:20:29.294196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 23:20:29 -- common/autotest_common.sh@829 -- # '[' -z 328199 ']' 00:28:03.238 [2024-11-26 23:20:29.294325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.294352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 23:20:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:03.238 [2024-11-26 23:20:29.294446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.294561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.294589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 23:20:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.294706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 23:20:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:03.238 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:03.238 [2024-11-26 23:20:29.294820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.294847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 23:20:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:03.238 [2024-11-26 23:20:29.294967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 23:20:29 -- common/autotest_common.sh@10 -- # set +x 00:28:03.238 [2024-11-26 23:20:29.295053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.295168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.295430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.295651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.295873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.295973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.296057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.296167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.296193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.296313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.296394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.296420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.296511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.296614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.296640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.238 [2024-11-26 23:20:29.296732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.296851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.238 [2024-11-26 23:20:29.296876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.238 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.296986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.297208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.297426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.297632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.297847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.297959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.298096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.298188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.298214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.298331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.298441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.298466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.298632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.298716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.298742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.298832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.298913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.298939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.299029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.299109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.299135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.299214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.299327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.299352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.299436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.299516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.299549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.299659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.299766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.299797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.299907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.300126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.300334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.300538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.300733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.300846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.300925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.301159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.301357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.301581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.301840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.301980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.302127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.302217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.302242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.302339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.302420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.302445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.302536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.302619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.302645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.302736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.302821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.302846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.302990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.303104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.303142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.239 qpair failed and we were unable to recover it. 00:28:03.239 [2024-11-26 23:20:29.303229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.303315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.239 [2024-11-26 23:20:29.303340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.303455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.303546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.303585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.303683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.303769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.303802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.303897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.303981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.304087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.304283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.304472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.304670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.304870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.304979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.305096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.305314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.305577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.305758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.305876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.305965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.306214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.306459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.306697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.306882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.306992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.307084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.307191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.307216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.307330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.307410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.307436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.307534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.307623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.307649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.307728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.307822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.307848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.307934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.308171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.308391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.308633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.240 qpair failed and we were unable to recover it. 00:28:03.240 [2024-11-26 23:20:29.308882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.240 [2024-11-26 23:20:29.308966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.308992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.309080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.309160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.309186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.309297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.309382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.309409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.309522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.309620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.309647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.309730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.309822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.309848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.309938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.310192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.310389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.310636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.310851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.310963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.311046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.311151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.311181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.311259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.311342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.311368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.311485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.311593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.311619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.311713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.311797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.311823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.311912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.312025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.312051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.312170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.312280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.312306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.312397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.312477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.312503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.312642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.312752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.312782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.312901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.313039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.313075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.313222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.313331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.313368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.313486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.313606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.313642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.313749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.313863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.313890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.313968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.314144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.314359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.314576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.314764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.314864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.314978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.315055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.315080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.315172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.315254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.241 [2024-11-26 23:20:29.315280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.241 qpair failed and we were unable to recover it. 00:28:03.241 [2024-11-26 23:20:29.315388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.315503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.315536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.315628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.315703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.315729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.315855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.315993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.316096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.316367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.316563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.316763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.316871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.316984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.317231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.317424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.317655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.317858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.317998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.318089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.318171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.318197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.318283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.318368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.318394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.318473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.318586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.318612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.318696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.318774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.318799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.318943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.319176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.319362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.319589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.319817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.319926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.320016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.320244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.320444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.320670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.320872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.320984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.321010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.321122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.321231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.321257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.321348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.321424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.321451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.242 qpair failed and we were unable to recover it. 00:28:03.242 [2024-11-26 23:20:29.321547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.242 [2024-11-26 23:20:29.321632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.321657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.321751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.321850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.321876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.321956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.322180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.322411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.322631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.322828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.322979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.323070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.323217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.323242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.323359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.323454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.323479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.323611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.323695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.323720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.323816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.323903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.323930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.324024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.324230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.324427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.324646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.324849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.324985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.325117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.325326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.325562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.325787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.325902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.325982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.326174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.326392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.326639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.326843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.326986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.327077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.327166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.327193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.327276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.327360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.327386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.327499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.327604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.327630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.327718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.327831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.243 [2024-11-26 23:20:29.327858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.243 qpair failed and we were unable to recover it. 00:28:03.243 [2024-11-26 23:20:29.327985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.328232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.328459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.328669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.328871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.328978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.329064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.329138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.329163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.329247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.329352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.329385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.329496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.329603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.329629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.329711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.329792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.329818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.329937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.330140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.330403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.330658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.330870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.330971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.331059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.331135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.331167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.331255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.331372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.331397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.331513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.331615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.331641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.331726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.331806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.331832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.331972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.332190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.332407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.332643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.332838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.332975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.333083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.333199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.333226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.333314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.333425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.333450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.333548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.333651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.333678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.333770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.333876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.333903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.333993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.334117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.334142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.244 [2024-11-26 23:20:29.334237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.334343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.244 [2024-11-26 23:20:29.334368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.244 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.334450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.334561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.334597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.334700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.334791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.334823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.334963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.335237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.335492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.335695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.335884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.335977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.336078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.336310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.336508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.336709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.336815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.336899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.337132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.337387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.337674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.337858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.337991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.338095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.338202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.338228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.338231] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:03.245 [2024-11-26 23:20:29.338304] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:03.245 [2024-11-26 23:20:29.338339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.338419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.338444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.338539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.338652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.338677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.338759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.338873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.338897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.339017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.339251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.339478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.339676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.245 qpair failed and we were unable to recover it. 00:28:03.245 [2024-11-26 23:20:29.339896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.245 [2024-11-26 23:20:29.339984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.340110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.340302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.340558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.340736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.340873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.340964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.341189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.341416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.341624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.341860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.341995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.342092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.342305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.342495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.342700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.342918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.342993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.343125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.343358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.343590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.343792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.343935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.344052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.344274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.344464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.344670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.344869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.344972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.345087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.345311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.345543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.345764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.345873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.345993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.346068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.246 [2024-11-26 23:20:29.346093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.246 qpair failed and we were unable to recover it. 00:28:03.246 [2024-11-26 23:20:29.346203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.346277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.346303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.346385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.346472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.346497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.346608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.346694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.346720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.346801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.346894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.346932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.347023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.347129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.347160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.347280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.347355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.347381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.347468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.347561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.347588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.347703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.347789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.347815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.347920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.348071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.348097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.348179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.348486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.348533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.348648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.348728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.348754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.348881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.348973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.348998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.349117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.349231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.349256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.349342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.349449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.349475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.349564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.349659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.349685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.349776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.349865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.349898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.350021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.350112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.350138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.350241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.350326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.350351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.350464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.350561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.350587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.350664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.350749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.350775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.350889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.351156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.351405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.351681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.351872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.351984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.352092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.352308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.352514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.352705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.247 [2024-11-26 23:20:29.352825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.247 qpair failed and we were unable to recover it. 00:28:03.247 [2024-11-26 23:20:29.352913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.353137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.353339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.353537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.353770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.353883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.353973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.354083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.354109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.354261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.354406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.354431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.354562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.354665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.354691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.354782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.354896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.354922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.355030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.355123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.355156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.355271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.355386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.355411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.355501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.355636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.355663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.355746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.355870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.355896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.356002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.356087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.356112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.356252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.356368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.356394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.356492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.356592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.356619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.356706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.356835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.356861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.356946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.357053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.357078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.357192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.357304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.357329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.357416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.357500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.357557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.357671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.357788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.357825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.357922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.358206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.358424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.358628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.358881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.358987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.359013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.359126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.359217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.359247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.359363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.359447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.359472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.248 [2024-11-26 23:20:29.359571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.359686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.248 [2024-11-26 23:20:29.359712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.248 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.359829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.359942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.359968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.360075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.360186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.360212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.360352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.360467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.360493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.360593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.360666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.360692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.360803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.360926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.360951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.361060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.361152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.361178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.361252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.361393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.361419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.361540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.361651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.361677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.361795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.361901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.361927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.362011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.362125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.362150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.362241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.362357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.362383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.362495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.362592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.362618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.362735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.362844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.362869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.362976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.363193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.363425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.363649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.363875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.363986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.364133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.364242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.364280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.364390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.364466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.364492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.364614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.364727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.364753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.364831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.364917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.364943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.365027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.365136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.365174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.365255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.365329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.365355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.365440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.365594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.365620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.249 qpair failed and we were unable to recover it. 00:28:03.249 [2024-11-26 23:20:29.365703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.249 [2024-11-26 23:20:29.365782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.365808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.365923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.366164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.366386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.366596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.366851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.366989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.367102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.367214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.367239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.367378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.367516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.367549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.367662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.367774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.367799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.367886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.368176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.368374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.368622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.368859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.368977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.369110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.369324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.369553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.369824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.369962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.370073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.370196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.370222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.370337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.370412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.370437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.370559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.370674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.370700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.370776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.370889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.370914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.370995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.371111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.371137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.371217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.371355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.371385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.371504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.371627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.371653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.371740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.371813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.371839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.371954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.372036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.372061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.372179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.372320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.372345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.372494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.372610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.372637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.250 qpair failed and we were unable to recover it. 00:28:03.250 [2024-11-26 23:20:29.372715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.250 [2024-11-26 23:20:29.372802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.372832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.372944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.373057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.373082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.373191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.373262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.373287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.373394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.373522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.373556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.373695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.373787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.373812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.373924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.374062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.374087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.374167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.374283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.374309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.374412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.374549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.374576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.374684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.374793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.374818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.251 [2024-11-26 23:20:29.374957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.375069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.375094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.375204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.375320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.375346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.375497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.375619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.375645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.375757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.375839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.375864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.375943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.376193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.376418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.376639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.376834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.376997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.377079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.377171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.377196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.377279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.377398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.377423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.377568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.377667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.377693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.377808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.377886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.377912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.377998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.378277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.378478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.378680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.378889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.378979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.379005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.379080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.379220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.379246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.251 [2024-11-26 23:20:29.379323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.379431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.251 [2024-11-26 23:20:29.379457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.251 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.379546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.379656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.379682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.379773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.379899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.379925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.380006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.380094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.380119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.380207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.380316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.380341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.380432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.380522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.380555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.380697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.380775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.380801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.380931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.381012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.381038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.381159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.381241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.381266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.381375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.381514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.381546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.381658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.381771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.381796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.381908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.382186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.382414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.382654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.382869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.382976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.383066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.383173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.383200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.383293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.383372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.383406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.383492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.383599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.383625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.383707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.383789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.383825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.383941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.384023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.384049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.384183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.384299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.384324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.384398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.384533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.384559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.384696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.384780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.384805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.384916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.385224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.385416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.385662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.385917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.385993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.252 [2024-11-26 23:20:29.386018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.252 qpair failed and we were unable to recover it. 00:28:03.252 [2024-11-26 23:20:29.386096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.386210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.386238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.386383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.386495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.386540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.386633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.386718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.386743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.386833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.386915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.386941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.387014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.387092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.387118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.387244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.387331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.387356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.387474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.387584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.387610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.387721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.387835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.387860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.387971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.388160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.388412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.388652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.388892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.388994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.389076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.389190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.389215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.389337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.389427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.389454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.389582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.389666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.389693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.389777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.389888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.389913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.390025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.390105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.390130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.390250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.390335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.390360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.390442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.390523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.390555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.390698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.390780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.390805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.390901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.391039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.391065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.391144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.391260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.391285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.391396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.391476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.391502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.391597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.391708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.391743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.391898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.392010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.392035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.392124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.392201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.392227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.392308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.392423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.392449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.253 [2024-11-26 23:20:29.392540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.392624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.253 [2024-11-26 23:20:29.392650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.253 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.392771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.392853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.392878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.392958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.393080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.393106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.393190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.393316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.393342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.393457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.393556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.393583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.393668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.393760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.393786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.393902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.394154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.394374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.394608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.394844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.394990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.395141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.395253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.395279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.395390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.395497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.395536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.395622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.395730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.395755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.395854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.395938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.395964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.396052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.396229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.396457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.396675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.396881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.396991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.397108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.397190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.397227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.397339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.397446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.397475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.397589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.397705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.397731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.397851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.397931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.397956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.398065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.398174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.398200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.398289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.398372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.398398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.254 qpair failed and we were unable to recover it. 00:28:03.254 [2024-11-26 23:20:29.398536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.254 [2024-11-26 23:20:29.398623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.398660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.398779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.398893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.398918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.399063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.399144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.399169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.399278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.399386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.399411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.399486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.399601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.399627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.399711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.399824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.399854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.399937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.400155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.400402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.400667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.400890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.400991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.401098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.401181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.401207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.401315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.401437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.401462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.401571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.401711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.401736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.401826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.401941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.401967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.402057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.402136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.402161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.402276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.402356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.402382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.402487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.402610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.402636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.402753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.402834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.402860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.402978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.403084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.403122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.403217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.403328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.403356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.403474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.403607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.403634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.403742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.403854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.403880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.403967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.404080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.404106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.404198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.404283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.404310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.404432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.404544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.404572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.404710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.404814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.404840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.404960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.405047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.405073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.405157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.405249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.405275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.255 qpair failed and we were unable to recover it. 00:28:03.255 [2024-11-26 23:20:29.405396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.255 [2024-11-26 23:20:29.405506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.405540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.405632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.405706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.405731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.405846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.405955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.405980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.406093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.406323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.406511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.406709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.406917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.406995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.407107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.407295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.407512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.407711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.407851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.407966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.408193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.408409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.408603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.408804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.408911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.409027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.409136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.409162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.409280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.409401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.409427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.409546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.409655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.409680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.409767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.409847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.409872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.409962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.410208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.410408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.410688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.410889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.410989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.411080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.411170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.411195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.411283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.411387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.411417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.256 [2024-11-26 23:20:29.411534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.411650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.256 [2024-11-26 23:20:29.411676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.256 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.411759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.411864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.411890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.411995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.412106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.412131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.412220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.412324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.412349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.412394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:03.257 [2024-11-26 23:20:29.412432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.412532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.412558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.412645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.412782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.412808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.412893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.413005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.413030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.413163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.413258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.413283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.413405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.413493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.413538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.413652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.413730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.413760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.413897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.414160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.414349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.414561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.414756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.414872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.414983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.415194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.415391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.415592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.415771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.415921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.416000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.416221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.416410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.416651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.416887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.416977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.417098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.417347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.417568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.417804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.417952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.257 qpair failed and we were unable to recover it. 00:28:03.257 [2024-11-26 23:20:29.418076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.257 [2024-11-26 23:20:29.418188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.418214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.418305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.418423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.418448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.418536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.418644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.418670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.418785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.418925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.418951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.419031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.419107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.419133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.419253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.419326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.419351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.419497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.419590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.419616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.419732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.419848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.419874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.419953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.420142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.420333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.420570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.420790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.420897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.420982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.421180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.421377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.421609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.421845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.421946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.422083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.422189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.422214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.422356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.422469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.422494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.422586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.422695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.422721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.422809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.422918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.422943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.423027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.423138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.423164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.423277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.423399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.423424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.423512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.423664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.423701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.423783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.423896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.258 [2024-11-26 23:20:29.423921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.258 qpair failed and we were unable to recover it. 00:28:03.258 [2024-11-26 23:20:29.424042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.424153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.424178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.424291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.424373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.424398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.424540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.424657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.424683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.424758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.424847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.424872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.424983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.425179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.425407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.425666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.425851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.425975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.426106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.426358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.426582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.426858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.426959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.427051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.427168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.427193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.427300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.427437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.427462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.427585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.427673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.427703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.427787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.427880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.427905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.428017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.428105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.428130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.428219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.428305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.428330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.428444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.428557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.428584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.428675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.428780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.428805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.428951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.429166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.429408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.429640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.429816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.429924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.430017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.430101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.430127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.430209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.430284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.430309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.259 [2024-11-26 23:20:29.430425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.430578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.259 [2024-11-26 23:20:29.430604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.259 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.430719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.430839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.430864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.430972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.431194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.431406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.431662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.431882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.431991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.432106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.432194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.432218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.432308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.432386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.432411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.432554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.432651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.432677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.432768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.432852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.432878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.432956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.433174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.433390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.433653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.433847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.433960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.434100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.434182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.434210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.434320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.434425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.434451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.434546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.434666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.434691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.434803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.434932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.434958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.435047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.435155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.435180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.435288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.435376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.435401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.435487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.435645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.435672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.435786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.435885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.435910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.436024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.436159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.436184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.436301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.436413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.436438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.436518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.436627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.436653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.436769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.436907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.436934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.437020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.437107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.437134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.260 qpair failed and we were unable to recover it. 00:28:03.260 [2024-11-26 23:20:29.437221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.260 [2024-11-26 23:20:29.437327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.437353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.437434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.437557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.437584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.437674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.437759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.437784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.437902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.438125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.438377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.438671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.438882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.438990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.439102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.439206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.439232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.439314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.439397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.439429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.439521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.439665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.439691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.439784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.439909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.439934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.440020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.440165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.440189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.440303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.440383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.440408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.440495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.440624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.440650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.440730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.440865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.440890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.441009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.441092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.441118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.441252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.441392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.441418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.441551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.441664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.441689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.441805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.441931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.441956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.442048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.442232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.442455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.442656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.442889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.442997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.443076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.443162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.443188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.443304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.443413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.443439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.443516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.443643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.443669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.443758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.443869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.443895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.261 qpair failed and we were unable to recover it. 00:28:03.261 [2024-11-26 23:20:29.443980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.261 [2024-11-26 23:20:29.444117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.444142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.444237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.444319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.444344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.444456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.444567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.444594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.444688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.444807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.444833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.444918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.445022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.445047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.445187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.445302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.445328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.445440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.445557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.445584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.445694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.445777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.445803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.445891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.446165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.446380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.446583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.446851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.446955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.447039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.447126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.447153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.447266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.447356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.447382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.447476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.447588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.447615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.447699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.447780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.447806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.447905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.448029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.448055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.448166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.448276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.448302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.448416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.448553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.448580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.448689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.448769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.448796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.448914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.449002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.449029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.449137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.449228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.449254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.449347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.449457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.449483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.449632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.449753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.449779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.449895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.450034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.450059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.450168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.450279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.450304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.450411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.450486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.450511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.450605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.450691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.262 [2024-11-26 23:20:29.450716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.262 qpair failed and we were unable to recover it. 00:28:03.262 [2024-11-26 23:20:29.450831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.450916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.450940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.451027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.451117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.451143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.451224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.451334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.451363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.451446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.451550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.451576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.451689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.451772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.451797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.451909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.452164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.452384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.452600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.452814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.452929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.453040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.453128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.453154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.453263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.453341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.453366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.453480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.453590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.453616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.453729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.453818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.453844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.453925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.454165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.454407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.454664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.454851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.454989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.455107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.455185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.455210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.455295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.455372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.455398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.455507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.455596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.455622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.455714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.455800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.455825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.455947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.456027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.456054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.456165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.456257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.456282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.263 qpair failed and we were unable to recover it. 00:28:03.263 [2024-11-26 23:20:29.456399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.263 [2024-11-26 23:20:29.456508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.456542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.456655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.456802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.456827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.456906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.457133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.457381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.457637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.457858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.457968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.458082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.458170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.458195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.458282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.458368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.458394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.458476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.458615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.458641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.458753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.458843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.458877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.458962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.459153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.459352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.459567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.459748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.459884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.459966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.460207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.460452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.460686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.460871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.460988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.461158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.461380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.461635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.461816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.461954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.462043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.462160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.462186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.462266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.462342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.462368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.462451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.462538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.462564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.462677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.462752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.264 [2024-11-26 23:20:29.462783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.264 qpair failed and we were unable to recover it. 00:28:03.264 [2024-11-26 23:20:29.462894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.462971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.462996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.463080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.463190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.463216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.463329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.463445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.463470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.463578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.463689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.463715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.463809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.463917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.463943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.464095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.464206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.464232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.464323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.464435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.464460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.464577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.464659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.464684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.464801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.464888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.464914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.465023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.465131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.465161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.465239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.465346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.465371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.465482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.465570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.465596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.465714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.465791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.465817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.465932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.466068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.466094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.466220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.466338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.466363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.466504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.466617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.466651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.466744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.466827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.466852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.466931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.467161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.467408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.467640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.467887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.467998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.468117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.468202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.468228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.468315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.468424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.468449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.468578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.468656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.468681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.468796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.468877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.468902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.469008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.469091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.469117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.469198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.469308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.469335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.265 [2024-11-26 23:20:29.469440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.469545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.265 [2024-11-26 23:20:29.469570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.265 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.469661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.469770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.469795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.469913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.469999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.470133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.470359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.470589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.470780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.470908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.471001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.471206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.471430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.471696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.471890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.471995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.472113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.472204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.472228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.472336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.472422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.472447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.472578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.472688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.472714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.472827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.472967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.472992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.473075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.473149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.473174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.473286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.473365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.473392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.473472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.473562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.473587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.473681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.473770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.473794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.473908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.474116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.474344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.474581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.474839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.474971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.475060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.475170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.475195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.475314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.475394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.475419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.475502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.475625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.475651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.475796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.475879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.266 [2024-11-26 23:20:29.475904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.266 qpair failed and we were unable to recover it. 00:28:03.266 [2024-11-26 23:20:29.476005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.476118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.476143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.476278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.476418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.476442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.476555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.476670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.476694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.476813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.476899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.476931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.477048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.477186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.477211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.477293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.477394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.477419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.477503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.477652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.477678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.477785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.477898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.477924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.478011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.478083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.478108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.478227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.478338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.478364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.478475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.478592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.478617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.478737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.478815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.478840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.478923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.479139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.479358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.479557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.479775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.479919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.480033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.480139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.480164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.480250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.480362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.480388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.480473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.480563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.480589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.480665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.480778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.480802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.480919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.481116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.481354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.481598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.481838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.481951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.482038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.482179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.482205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.482316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.482397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.267 [2024-11-26 23:20:29.482422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.267 qpair failed and we were unable to recover it. 00:28:03.267 [2024-11-26 23:20:29.482507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.482595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.482620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.482710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.482793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.482818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.482930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.483046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.483071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.483206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.483315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.483340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.483445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.483522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.483588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.483675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.483763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.483789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.483905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.484157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.484375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.484661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.484862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.484994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.485107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.485186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.485212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.485326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.485437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.485463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.485556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.485635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.485660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.485747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.485862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.485887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.485999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.486106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.486131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.486225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.486345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.486371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.486459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.486546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.486574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.486663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.486777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.486803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.486941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.487139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.487366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.487594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.487834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.487975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.488057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.488134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.488160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.488304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.488423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.488448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.488563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.488652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.488682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.488769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.488874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.488900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.268 [2024-11-26 23:20:29.489017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.489105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.268 [2024-11-26 23:20:29.489130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.268 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.489224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.489335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.489361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.489476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.489569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.489595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.489704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.489821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.489847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.489934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.490184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.490433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.490660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.490878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.490983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.491111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.491223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.491248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.491331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.491446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.491471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.491581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.491672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.491699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.491809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.491897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.491922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.492018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.492095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.492120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.492236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.492321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.492346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.492456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.492537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.492563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.492676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.492818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.492844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.492926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.493034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.493059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.493178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.493293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.493319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.493435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.493516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.493551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.493635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.493780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.493806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.493912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.494157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.494383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.494634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.494877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.494980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.495125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.495238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.495263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.495340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.495456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.495483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.495611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.495694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.495720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.495839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.495961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.495986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.496095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.496184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.496209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.496292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.496375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.269 [2024-11-26 23:20:29.496401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.269 qpair failed and we were unable to recover it. 00:28:03.269 [2024-11-26 23:20:29.496487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.496581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.496607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.496690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.496794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.496819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.496897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.497195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.497434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.497657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.497904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.497980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.498116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.498390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.498623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.498812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.498921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.499025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.499165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.499190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.499300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.499409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.499435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.499519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.499632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.499658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.499769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.499848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.499874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.499988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.500210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.500398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.500642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.500872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.500983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.501148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.501345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.501580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.501802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.501941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.502050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.502163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.502189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.502265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.502348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.502374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.502461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.502576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.502604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.502685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.502799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.502830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.502941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.503078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.503104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.503189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.503305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.503330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.503437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.503519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.503551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.270 qpair failed and we were unable to recover it. 00:28:03.270 [2024-11-26 23:20:29.503670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.270 [2024-11-26 23:20:29.503778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.503803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.503913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.504158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.504380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.504603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.504826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.504933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.505024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.505226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.505446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.505645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.505843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.505948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.506057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.506173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.506199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.506304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.506416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.506442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.506535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.506645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.506670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.506763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.506877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.506913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.507056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.507141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.507167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.507252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.507362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.507387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.507480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.507605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.507633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.507725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.507830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.507854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.507993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.508111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.508137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.508242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.508327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.508352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.508464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.508602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.508629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.508712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.508826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.508851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.508931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.509138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.509326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.509570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.509802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.509907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.510021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.510134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.510159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.510240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.510348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.510374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.510458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.510582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.510609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.271 qpair failed and we were unable to recover it. 00:28:03.271 [2024-11-26 23:20:29.510699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.271 [2024-11-26 23:20:29.510813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.510840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.510949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.511063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.511089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.511200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.511314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.511340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.511453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.511558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.511585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.511665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.511776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.511802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.511922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.512030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.512056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.512170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.512301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.512327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.512435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.512517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.512551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.512632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.512771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.512797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.512937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.513126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.513370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.513611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.513835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.513973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.514052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.514191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.514217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.514294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.514400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.514426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.514540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.514626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.514657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.514749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.514857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.514883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.514993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.515195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.515387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.515634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.515831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.515944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.516062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.516171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.516195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.516306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.516422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.516448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.516536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.516612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.516638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.272 qpair failed and we were unable to recover it. 00:28:03.272 [2024-11-26 23:20:29.516777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.272 [2024-11-26 23:20:29.516886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.516911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.517032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.517170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.517196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.517335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.517442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.517467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.517582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.517717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.517744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.517849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.517963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.517989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.518079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.518160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.518185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.518270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.518380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.518405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.518488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.518593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.518619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.518709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.518817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.518843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.518960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.519043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.519070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.519185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.519296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.519322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.519441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.519548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.519576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.519703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.519823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.519849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.519959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.520210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.520411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.520640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.520822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.520970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.521064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.521178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.521203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.521323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.521400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.521426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.521506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.521619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.521645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.521758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.521862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.521892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.521986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.522067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.273 [2024-11-26 23:20:29.522093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.273 qpair failed and we were unable to recover it. 00:28:03.273 [2024-11-26 23:20:29.522212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.522348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.522375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.522460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.522551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.522579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.522692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.522780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.522807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.522891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.523147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.523368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.523606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.523816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.523935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.524025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.524114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.524141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.524253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.524362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.524388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.524508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.524597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.524622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.524741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.524877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.524904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.524985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.525187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.525381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.525620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.525815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.525952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.526045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.526157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.526182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.526259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.526378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.526403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.526541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.526626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.526651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.526743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.526823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.526849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.526962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.527180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.527395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.527616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.527880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.527992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.528082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.528129] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:03.274 [2024-11-26 23:20:29.528169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 [2024-11-26 23:20:29.528193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.274 qpair failed and we were unable to recover it. 00:28:03.274 [2024-11-26 23:20:29.528255] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:03.274 [2024-11-26 23:20:29.528282] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events[2024-11-26 23:20:29.528281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.274 at runtime. 00:28:03.274 [2024-11-26 23:20:29.528303] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:03.275 [2024-11-26 23:20:29.528362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.528387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.528361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:28:03.275 [2024-11-26 23:20:29.528393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:28:03.275 [2024-11-26 23:20:29.528472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.528418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:28:03.275 [2024-11-26 23:20:29.528421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:28:03.275 [2024-11-26 23:20:29.528583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.528609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.528717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.528830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.528853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.528974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.529178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.529396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.529624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.529839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.529946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.530026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.530219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.530442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.530675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.530887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.530987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.531107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.531213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.531237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.531319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.531426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.531449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.531536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.531623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.531648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.531733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.531824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.531850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.531934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.532149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.532358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.532556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.532789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.532903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.532984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.533206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.533399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.533646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.533871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.533972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.275 qpair failed and we were unable to recover it. 00:28:03.275 [2024-11-26 23:20:29.534051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.534127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.275 [2024-11-26 23:20:29.534152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.534272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.534378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.534404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.534514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.534595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.534625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.534738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.534850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.534875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.534986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.535184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.535392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.535585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.535780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.535888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.536053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.536239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.536471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.536664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.536849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.536988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.537102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.537309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.537531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.537761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.537866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.537982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.538170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.538381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.538588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.538786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.538894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.538986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.539183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.539376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.539580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.539801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.539902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.276 qpair failed and we were unable to recover it. 00:28:03.276 [2024-11-26 23:20:29.540017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.276 [2024-11-26 23:20:29.540126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.540152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.540285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.540372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.540397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.540489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.540577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.540603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.540713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.540803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.540828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.540937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.541154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.541344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.541561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.541826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.541958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.542049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.542130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.542155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.542236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.542346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.542378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.542454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.542548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.542575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.542657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.542735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.542761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.542916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.543131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.543338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.543572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.543763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.543875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.543962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.544181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.544395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.544607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.544800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.544915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.545025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.545133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.545159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.277 qpair failed and we were unable to recover it. 00:28:03.277 [2024-11-26 23:20:29.545244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.545324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.277 [2024-11-26 23:20:29.545350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.545465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.545553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.545579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.545668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.545779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.545804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.545923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.545996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.546022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.546139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.546256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.546282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.546374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.546456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.546482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.546663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.546772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.546798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.546881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.547026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.547052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.547161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.547252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.547277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.547390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.547503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.547586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.547705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.547813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.547847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.547960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.548182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.548405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.548608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.548809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.548922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.549009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.549223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.549449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.549654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.549887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.549999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.550116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.550228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.550255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.550343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.550446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.550472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.550558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.550662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.550688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.550799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.550925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.550950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.551032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.551112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.551138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.551247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.551330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.551356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.551433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.551599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.551626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.551743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.551867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.278 [2024-11-26 23:20:29.551896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.278 qpair failed and we were unable to recover it. 00:28:03.278 [2024-11-26 23:20:29.551994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.552215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.552405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.552640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.552888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.552999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.553104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.553362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.553559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.553761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.553876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.553965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.554221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.554405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.554666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.554873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.554988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.555135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.555336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.555584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.555798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.555918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.556010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.556089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.556114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.556195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.556312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.556340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.556455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.556570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.556597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.556678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.556762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.556788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.556906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.557126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.557325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.557537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.557752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.557876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.557961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.558034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.558060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.279 [2024-11-26 23:20:29.558156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.558264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.279 [2024-11-26 23:20:29.558290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.279 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.558409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.558482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.558507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.558636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.558715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.558740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.558872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.558963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.558989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.559106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.559201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.559226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.559336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.559423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.559449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.559567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.559652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.559678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.559763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.559852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.559878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.559955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.560169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.560390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.560605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.560825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.560955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.561042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.561232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.561433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.561645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.561860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.561965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.562048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.562267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.562449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.562653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.562870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.562987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.563099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.563181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.563209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.563286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.563378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.563403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.563487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.563584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.563609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.563702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.563788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.563813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.563899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.564005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.564030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.564126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.564211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.564236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.280 qpair failed and we were unable to recover it. 00:28:03.280 [2024-11-26 23:20:29.564320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.280 [2024-11-26 23:20:29.564433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.564459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.564562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.564648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.564682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.564796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.564893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.564918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.565000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.565111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.565136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.565224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.565331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.565357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.565434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.565512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.565569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.565709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.565796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.565830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.565943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.566144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.566348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.566550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.566765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.566874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.566965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.567184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.567397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.567639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.567857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.567972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.568061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.568248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.568440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.568671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.568885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.568994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.569104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.569187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.569212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.569319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.569410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.569436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.569522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.569648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.569674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.281 [2024-11-26 23:20:29.569759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.569878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.281 [2024-11-26 23:20:29.569908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.281 qpair failed and we were unable to recover it. 00:28:03.282 [2024-11-26 23:20:29.569996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.282 qpair failed and we were unable to recover it. 00:28:03.282 [2024-11-26 23:20:29.570197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.282 qpair failed and we were unable to recover it. 00:28:03.282 [2024-11-26 23:20:29.570449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.282 qpair failed and we were unable to recover it. 00:28:03.282 [2024-11-26 23:20:29.570689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.282 qpair failed and we were unable to recover it. 00:28:03.282 [2024-11-26 23:20:29.570899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.570982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.571008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.282 qpair failed and we were unable to recover it. 00:28:03.282 [2024-11-26 23:20:29.571085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.571221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.571247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.282 qpair failed and we were unable to recover it. 00:28:03.282 [2024-11-26 23:20:29.571335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.571459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.282 [2024-11-26 23:20:29.571496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.282 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.571672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.571758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.571784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.571882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.571993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.572110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.572318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.572507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.572716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.572865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.572948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.573144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.573370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.573628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.573834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.573939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.574021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.574209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.574420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.574623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.574827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.574966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.575043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.575141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.575167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.576 qpair failed and we were unable to recover it. 00:28:03.576 [2024-11-26 23:20:29.575294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.575408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.576 [2024-11-26 23:20:29.575433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.575514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.575634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.575660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.575745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.575837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.575862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.575942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.576132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.576342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.576578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.576758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.576870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.576947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.577175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.577362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.577637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.577849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.577963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.578088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.578162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.578188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.578287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.578402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.578428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.578521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.578618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.578644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.578727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.578879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.578904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.578988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.579075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.579102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.579221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.579365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.579390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.579504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.579609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.579635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.579722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.579800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.579825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.579917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.580123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.580313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.580509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.580714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.580829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.580926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.581038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.581065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.581152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.581226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.581251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.577 [2024-11-26 23:20:29.581363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.581446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.577 [2024-11-26 23:20:29.581471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.577 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.581562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.581638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.581664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.581744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.581827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.581853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.581936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.582137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.582364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.582564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.582751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.582851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.582954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.583189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.583386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.583602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.583792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.583939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.584019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.584211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.584428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.584649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.584880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.584990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.585082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.585168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.585194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.585272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.585385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.585411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.585539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.585651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.585677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.585772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.585850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.585875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.585957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.586155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.586376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.586579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.586775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.586883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.586982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.587071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.587097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.587190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.587280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.587305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.578 qpair failed and we were unable to recover it. 00:28:03.578 [2024-11-26 23:20:29.587384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.578 [2024-11-26 23:20:29.587505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.587534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.587616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.587708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.587733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.587853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.587951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.587978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.588068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.588265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.588456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.588682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.588864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.588992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.589071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.589261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.589489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.589685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.589869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.589980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.590061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.590151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.590176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.590260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.590347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.590373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.590461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.590564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.590591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.590679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.590768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.590794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.590924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.591139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.591332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.591575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.591768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.591884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.591972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.592160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.592378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.592593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.592804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.592916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.592990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.593076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.593102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.579 qpair failed and we were unable to recover it. 00:28:03.579 [2024-11-26 23:20:29.593189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.579 [2024-11-26 23:20:29.593301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.593326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.593407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.593501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.593549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.593635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.593757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.593784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.593869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.593954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.593979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.594059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.594295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.594487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.594686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.594907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.594992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.595097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.595323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.595512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.595713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.595859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.595948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.596159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.596343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.596577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.596809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.596922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.597043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.597180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.597205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.597289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.597398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.597424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.597544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.597626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.597651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.597726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.597843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.597872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.597952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.598028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.598053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.598137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.598263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.598288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.598388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.598470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.598495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.580 qpair failed and we were unable to recover it. 00:28:03.580 [2024-11-26 23:20:29.598589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.580 [2024-11-26 23:20:29.598685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.598710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.598800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.598915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.598941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.599021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.599232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.599423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.599636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.599832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.599941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.600029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.600113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.600138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.600246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.600368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.600395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.600517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.600649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.600674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.600758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.600852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.600878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.600959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.601145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.601425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.601648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.601840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.601986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.602079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.602190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.602220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.602305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.602389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.602414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.602488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.602607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.602633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.602719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.602806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.602834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.602923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.603159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.603428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.603627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.603847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.603958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.604050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.604162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.604187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.604275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.604362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.604392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.581 [2024-11-26 23:20:29.604482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.604593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.581 [2024-11-26 23:20:29.604620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.581 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.604704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.604781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.604807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.604895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.605114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.605372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.605583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.605779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.605884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.606010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.606201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.606435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.606643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.606834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.606944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.607023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.607227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.607449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.607676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.607871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.607991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.608072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.608186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.608212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.608294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.608386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.608411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.608492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.608626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.608652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.608770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.608847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.608872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.609021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.609269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.609464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.609687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.609892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.609971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.610005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.610081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.610154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.610180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.610263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.610353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.582 [2024-11-26 23:20:29.610378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.582 qpair failed and we were unable to recover it. 00:28:03.582 [2024-11-26 23:20:29.610466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.610592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.610620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.610698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.610776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.610801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.610925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.611116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.611318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.611558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.611767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.611871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.611956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.612193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.612384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.612605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.612804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.612940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.613019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.613201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.613425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.613649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.613839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.613950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.614028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.614142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.614167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.614278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.614422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.614447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.614534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.614610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.614635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.614716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.614795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.614831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.614940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.615131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.615398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.615647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.615857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.615989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.616075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.616152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.616177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.616284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.616369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.616394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.583 [2024-11-26 23:20:29.616478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.616574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.583 [2024-11-26 23:20:29.616601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.583 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.616678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.616766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.616791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.616878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.616958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.616983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.617074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.617180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.617206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.617286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.617387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.617417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.617505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.617595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.617620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.617730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.617809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.617835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.617920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.618111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.618322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.618570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.618753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.618892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.619021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.619214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.619413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.619640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.619824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.619973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.620057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.620237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.620473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.620706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.620909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.620988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.621101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.621322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.621512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.621712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.621897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.621976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.622003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.622109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.622220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.622246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.622330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.622411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.622436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.584 [2024-11-26 23:20:29.622545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.622682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.584 [2024-11-26 23:20:29.622708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.584 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.622822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.622903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.622929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.623019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.623270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.623447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.623674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.623863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.623976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.624110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.624328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.624544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.624727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.624912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.624989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.625098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.625320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.625522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.625720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.625901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.625982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.626169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.626382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.626614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.626803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.626903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.626991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.627217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.627426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.627629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.627808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.627920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.585 qpair failed and we were unable to recover it. 00:28:03.585 [2024-11-26 23:20:29.627998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.585 [2024-11-26 23:20:29.628109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.628139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.628220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.628321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.628347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.628437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.628553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.628580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.628691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.628779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.628804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.628884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.628990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.629131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.629309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.629531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.629745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.629852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.629925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.630170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.630399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.630589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.630773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.630907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.631011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.631220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.631431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.631613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.631797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.631937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.632042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.632119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.632144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.632279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.632362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.632386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.632482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.632588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.632613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.632693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.632806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.632834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.632908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.633151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.633426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.633623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.633800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.633907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.634014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.634119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.586 [2024-11-26 23:20:29.634145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.586 qpair failed and we were unable to recover it. 00:28:03.586 [2024-11-26 23:20:29.634271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.634360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.634385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.634473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.634611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.634638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.634726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.634822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.634847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.634931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.635146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.635341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.635532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.635752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.635860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.635937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.636145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.636348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.636542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.636742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.636855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.636934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.637150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.637356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.637582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.637790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.637900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.638008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.638195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.638388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.638611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.638795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.638935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.639021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.639198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.639414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.639613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.639801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.639913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.587 [2024-11-26 23:20:29.639998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.640081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.587 [2024-11-26 23:20:29.640106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.587 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.640196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.640301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.640326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.640403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.640509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.640548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.640628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.640707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.640732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.640813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.640917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.640947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.641025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.641233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.641424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.641638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.641828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.641989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.642101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.642308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.642494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.642692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.642887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.642985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.643062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.643172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.643197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.643315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.643393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.643418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.643499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.643603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.643629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.643744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.643831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.643856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.643936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.644119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.644355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.644548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.644736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.644835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.644917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.645146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.645377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.645563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.645750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.645864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.588 qpair failed and we were unable to recover it. 00:28:03.588 [2024-11-26 23:20:29.645970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.588 [2024-11-26 23:20:29.646092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.646220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.646427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.646652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.646838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.646996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.647074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.647154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.647181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.647271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.647381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.647405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.647513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.647599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.647624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.647703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.647808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.647836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.647945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.648119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.648343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.648552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.648760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.648879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.648988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.649227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.649444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.649656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.649861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.649964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.650073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.650148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.650172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.650284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.650358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.650384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.650501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.650631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.650658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.650740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.650850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.650887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.650976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.651195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.651408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.651625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.651854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.651991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.652016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.652094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.652177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.652204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.589 qpair failed and we were unable to recover it. 00:28:03.589 [2024-11-26 23:20:29.652279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.589 [2024-11-26 23:20:29.652384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.652408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.652537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.652614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.652639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.652719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.652803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.652832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.652972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.653177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.653387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.653623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.653809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.653915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.653994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.654203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.654387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.654597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.654806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.654909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.655012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.655223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.655464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.655685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.655877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.655975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.656101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.656184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.656209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.656295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.656372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.656397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.656513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.656602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.656627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.656715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.656791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.656823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.656934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.657036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.657061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.657170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.657275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.657299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.657383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.657485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.657510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.590 qpair failed and we were unable to recover it. 00:28:03.590 [2024-11-26 23:20:29.657656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.657743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.590 [2024-11-26 23:20:29.657769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.657851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.657934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.657960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.658076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.658183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.658207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.658285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.658378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.658403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.658485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.658596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.658623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.658703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.658780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.658805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.658896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.659136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.659343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.659522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.659708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.659845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.659949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.660164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.660343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.660529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.660753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.660892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.660972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.661187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.661414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.661626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.661911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.661994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.662145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.662325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.662559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.662757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.662871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.663011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.663226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.663403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.663595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.591 qpair failed and we were unable to recover it. 00:28:03.591 [2024-11-26 23:20:29.663822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.591 [2024-11-26 23:20:29.663939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.663964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.664082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.664257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.664468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.664673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.664880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.664986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.665152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.665333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.665549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.665767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.665874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.665953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.666175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.666391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.666583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.666770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.666875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.666971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.667181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.667417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.667618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.667804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.667907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.668011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.668258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.668441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.668663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.668854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.668953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.669068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.669141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.669167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.669248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.669380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.669405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.669490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.669581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.669607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.669687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.669772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.592 [2024-11-26 23:20:29.669798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.592 qpair failed and we were unable to recover it. 00:28:03.592 [2024-11-26 23:20:29.669904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.670121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.670299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.670517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.670741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.670855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.670936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.671143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.671322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.671539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.671725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.671839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.671921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.672133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.672310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.672506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.672771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.672870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.672989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.673186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.673378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.673586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.673813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.673915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.674006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.674191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.674434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.674656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.674857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.674957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.675033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.675112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.675137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.675215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.675300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.675329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.675404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.675488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.675513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.593 qpair failed and we were unable to recover it. 00:28:03.593 [2024-11-26 23:20:29.675604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.593 [2024-11-26 23:20:29.675687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.675713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.675798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.675885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.675911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.675996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.676227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.676424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.676678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.676862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.676961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.677070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.677155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.677180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.677288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.677369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.677394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.677478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.677563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.677589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.677675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.677759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.677794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.677920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.678154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.678368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.678562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.678760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.678892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.678975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.679187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.679385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.679608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.679859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.679977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.680090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.680286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.680510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.680726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.680917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.680996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.594 [2024-11-26 23:20:29.681021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.594 qpair failed and we were unable to recover it. 00:28:03.594 [2024-11-26 23:20:29.681106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.681315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.681502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.681716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.681920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.681999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.682119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.682328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.682537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.682738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.682842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.682953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.683130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.683381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.683609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.683797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.683918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.684002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.684195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.684407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.684683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.684880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.684982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.685063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.685254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.685433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.685654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.685854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.685991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.686077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.686156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.686181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.686289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.686365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.686390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.686464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.686568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.686594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.686671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.686754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.686779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.686886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.687025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.595 [2024-11-26 23:20:29.687051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.595 qpair failed and we were unable to recover it. 00:28:03.595 [2024-11-26 23:20:29.687125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.687325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.687519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.687713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.687903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.687990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.688102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.688316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.688570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.688781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.688881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.688993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.689210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.689428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.689649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.689835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.689948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.690032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.690107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.690132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.690247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.690364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.690390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.690511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.690604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.690629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.690740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.690884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.690910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.691017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.691244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.691472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.691670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.691878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.691975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.692049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.692126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.692151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.692226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.692338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.692365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.692458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.692558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.692590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.692704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.692793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.692821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.692964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.693072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.693098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.596 [2024-11-26 23:20:29.693180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.693289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.596 [2024-11-26 23:20:29.693314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.596 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.693422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.693505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.693537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.693620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.693700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.693725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.693802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.693942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.693968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.694075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.694290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.694506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.694707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.694895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.694993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.695071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.695150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.695175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.695308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.695405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.695431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.695512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.695640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.695667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.695755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.695844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.695871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.695987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.696094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.696119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.696236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.696349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.696374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.696455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.696539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.696571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.696658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.696738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.696765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.696874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.697127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.697311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.697573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.697761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.697879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.697962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.698142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.698363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.698572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.698789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.698901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.698984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.699098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.699123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.699204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.699285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.597 [2024-11-26 23:20:29.699310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.597 qpair failed and we were unable to recover it. 00:28:03.597 [2024-11-26 23:20:29.699391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.699472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.699497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.699592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.699684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.699710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.699786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.699900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.699925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.700031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.700239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.700450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.700663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.700886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.700996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.701080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.701189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.701215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.701358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.701434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.701459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.701584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.701666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.701692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.701772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.701865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.701890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.701967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.702182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.702401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.702628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.702852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.702988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.703104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.703180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.703206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.703319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.703391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.703421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.703539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.703627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.703652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.703764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.703876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.703911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.703989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.704142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.704168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.704244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.704356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.704383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.704489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.704591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.704618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.704755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.704843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.704870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.704984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.705067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.705092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.705199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.705275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.705300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.705390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.705499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.705533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.598 qpair failed and we were unable to recover it. 00:28:03.598 [2024-11-26 23:20:29.705610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.705699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.598 [2024-11-26 23:20:29.705729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.705809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.705894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.705920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.706031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.706244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.706454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.706654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.706867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.706997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.707111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.707190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.707215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.707289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.707368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.707393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.707475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.707574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.707599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.707675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.707754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.707783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.707930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.708114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.708332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.708542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.708755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.708907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.708989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.709210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.709397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.709598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.709791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.709943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.710029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.710135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.710161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.710248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.710326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.710351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.710463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.710577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.710603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.710742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.710881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.710907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.599 [2024-11-26 23:20:29.710989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.711066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.599 [2024-11-26 23:20:29.711091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.599 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.711183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.711293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.711320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.711396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.711472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.711498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.711617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.711756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.711782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.711865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.711940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.711965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.712055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.712129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.712155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.712232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.712370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.712395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.712496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.712604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.712630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.712736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.712846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.712871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.712984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.713170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.713383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.713614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.713823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.713923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.714007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.714225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.714483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.714678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.714914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.714987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.715095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.715307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.715543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.715763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.715873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.715958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.716038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.716064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.716169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.716249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.716274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.716355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.716473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.716499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.600 qpair failed and we were unable to recover it. 00:28:03.600 [2024-11-26 23:20:29.716606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.600 [2024-11-26 23:20:29.716693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.716718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.716803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.716886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.716912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.717028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.717101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.717127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.717239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.717345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.717370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.717486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.717598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.717624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.717738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.717817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.717842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.717945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.718156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.718341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.718550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.718789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.718904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.719011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.719229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.719422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.719617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.719872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.719974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.720054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.720137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.720162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.720301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.720408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.720433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.720515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.720634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.720659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.720739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.720836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.720862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.720990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.721109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.721134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.721241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.721325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.721350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.721434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.721556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.721590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.721705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.721783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.721809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.721892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.722150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.722362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.722550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.601 qpair failed and we were unable to recover it. 00:28:03.601 [2024-11-26 23:20:29.722752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.601 [2024-11-26 23:20:29.722840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.722866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.722974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.723202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.723421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.723649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.723867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.723978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.724087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.724305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.724517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.724713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.724834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.724911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.725128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.725343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.725547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.725774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.725915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.726000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.726210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.726389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.726584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.726802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.726918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.727001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.727085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.727110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.727185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.727288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.727314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.727439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.727558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.727586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.727671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.727782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.727809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.727926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.728138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.728407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.728619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.602 [2024-11-26 23:20:29.728816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.602 [2024-11-26 23:20:29.728954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.602 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.729032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.729146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.729171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.729282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.729358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.729383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.729481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.729592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.729618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.729729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.729842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.729868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.729951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.730159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.730406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.730648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.730856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.730991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.731154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.731340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.731534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.731740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.731879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.731985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.732197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.732446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.732672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.732854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.732961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.733051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.733187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.733213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.733325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.733400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.733425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.733538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.733653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.733678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.733754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.733838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.733863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.733971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.734188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.734371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.734641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.734864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.734966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.603 qpair failed and we were unable to recover it. 00:28:03.603 [2024-11-26 23:20:29.735045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.735127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.603 [2024-11-26 23:20:29.735153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.735229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.735306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.735331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.735418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.735528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.735554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.735631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.735711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.735737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.735850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.735927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.735952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.736057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.736270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.736464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.736662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.736860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.736970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.737043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.737116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.737141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.737250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.737356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.737381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.737490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.737636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.737663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.737747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.737885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.737910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.738018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.738205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.738385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.738626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.738833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.738975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.739089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.739170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.739196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.739281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.739358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.739383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.739491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.739602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.739628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.739715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.739820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.739846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.739928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.740002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.740027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.740108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.740248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.740274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.740413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.740522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.740555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.604 qpair failed and we were unable to recover it. 00:28:03.604 [2024-11-26 23:20:29.740664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.604 [2024-11-26 23:20:29.740744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.740774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.740854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.740990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.741096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.741287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.741492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.741739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.741846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.741926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.742161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.742339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.742551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.742781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.742901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.742987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.743231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.743444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.743635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.743877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.743984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.744098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.744368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.744624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.744838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.744967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.745075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.745302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.745521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.745721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.745904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.745990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.746136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.746375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.746599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.605 [2024-11-26 23:20:29.746790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.605 [2024-11-26 23:20:29.746905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.605 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.746989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.747100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.747126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.747240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.747344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.747371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.747471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.747582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.747608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.747744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.747822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.747848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.747923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.748112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.748331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.748601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.748793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.748894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.748980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.749186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.749408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.749605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.749799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.749959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.750066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.750174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.750200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.750313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.750396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.750421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.750499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.750604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.750631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.750770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.750848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.750873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.750962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.751186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.751435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.751630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.751819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.751984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.752062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.752142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.752167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.752277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.752380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.752405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.752480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.752572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.752598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.752708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.752814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.752839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.752956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.753060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.753085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.606 qpair failed and we were unable to recover it. 00:28:03.606 [2024-11-26 23:20:29.753167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.606 [2024-11-26 23:20:29.753282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.753308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.753392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.753501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.753533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.753614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.753726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.753752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.753831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.753909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.753934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.754021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.754237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.754420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.754692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.754907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.754985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.755152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.755340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.755535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.755746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.755857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.755975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.756211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.756393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.756601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.756795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.756912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.757019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.757235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.757473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.757656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.757856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.757963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.758044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.758237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.758459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.758685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.758896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.758980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.759005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.607 [2024-11-26 23:20:29.759081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.759162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.607 [2024-11-26 23:20:29.759188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.607 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.759279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.759388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.759414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.759521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.759633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.759658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.759761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.759836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.759861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.759973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.760153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.760374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.760574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.760762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.760867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.760973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.761151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.761353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.761540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.761755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.761852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.761938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.762149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.762410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.762662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.762878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.762981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.763054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.763165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.763192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.763307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.763414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.763441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.763549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.763630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.763656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.763740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.763857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.763883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.763989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.764096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.764121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.764201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.764283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.764308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.608 [2024-11-26 23:20:29.764391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.764479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.608 [2024-11-26 23:20:29.764504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.608 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.764586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.764700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.764727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.764813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.764920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.764946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.765058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.765233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.765437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.765650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.765890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.765989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.766096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.766175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.766200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.766282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.766357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.766383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.766503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.766622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.766649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.766742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.766859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.766885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.766999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.767115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.767142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.767221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.767355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.767381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.767492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.767604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.767631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.767744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.767851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.767876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.767986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.768171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.768350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.768534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.768746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.768884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.769000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.769190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.769396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.769594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.769816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.769949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.770024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.770128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.770153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.770265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.770379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.770405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.770490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.770617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.609 [2024-11-26 23:20:29.770645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.609 qpair failed and we were unable to recover it. 00:28:03.609 [2024-11-26 23:20:29.770757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.770867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.770893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.771014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.771134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.771160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.771237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.771314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.771340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.771435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.771545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.771572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.771682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.771768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.771794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.771908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.772126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.772335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.772530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.772771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.772880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.772957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.773145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.773333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.773586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.773835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.773980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.774059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.774143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.774169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.774254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.774331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.774357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.774468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.774550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.774578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.774662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.774815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.774842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.774927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.775138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.775335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.775548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.775799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.775899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.775976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.776215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.776406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.776598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.610 [2024-11-26 23:20:29.776840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.610 [2024-11-26 23:20:29.776972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.610 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.777050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.777161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.777187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.777270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.777383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.777408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.777493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.777614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.777640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.777753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.777830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.777860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.777972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.778218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.778465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.778679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.778868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.778980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.779079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.779319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.779537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.779718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.779827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.779937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.780145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.780330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.780554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.780734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.780837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.780945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.781151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.781373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.781634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.781831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.781941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.782049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.782160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.782187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.782299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.782407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.782433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.782521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.782610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.782637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.782745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.782819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.782845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.782922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.783042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.611 [2024-11-26 23:20:29.783068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.611 qpair failed and we were unable to recover it. 00:28:03.611 [2024-11-26 23:20:29.783163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.783243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.783270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.783352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.783423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.783448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.783537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.783650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.783676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.783762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.783879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.783905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.783979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.784053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.784079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.784189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.784301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.784327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.784414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.784550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.784577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.784693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.784804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.784830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.784909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.785147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.785337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.785523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.785801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.785900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.786007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.786226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.786441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.786676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.786909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.786986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.787091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.787319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.787540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.787741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.787848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.787931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.788117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.788357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.788546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.788736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.788880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.788953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.789058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.789084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.612 qpair failed and we were unable to recover it. 00:28:03.612 [2024-11-26 23:20:29.789164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.612 [2024-11-26 23:20:29.789249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.789275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.789360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.789443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.789469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.789561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.789646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.789671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.789778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.789886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.789911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.790000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.790227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.790418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.790602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.790833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.790972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.791082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.791294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.791517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.791715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.791900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.791975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.792087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.792272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.792518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.792746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.792850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.792933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.793128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.793339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.793521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.793717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.613 qpair failed and we were unable to recover it. 00:28:03.613 [2024-11-26 23:20:29.793912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.793987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.613 [2024-11-26 23:20:29.794013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.794146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.794254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.794279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.794391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.794542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.794569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.794650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.794789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.794815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.794932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.795160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.795352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.795595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.795847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.795959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.796065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.796176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.796201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.796279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.796355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.796380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.796494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.796584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.796610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.796716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.796830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.796857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.796934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.797118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.797363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.797598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.797817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.797980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.798088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.798218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.798256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.798373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.798453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.798479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.798563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.798644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.798670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.798753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.798864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.798890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.798969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.799154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.799372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.799580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.799833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.799942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.614 [2024-11-26 23:20:29.800034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.800127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.614 [2024-11-26 23:20:29.800154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.614 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.800233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.800345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.800371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.800451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.800531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.800558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.800668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.800782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.800807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.800915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.801186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.801379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.801573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.801794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.801910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.801991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.802232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.802416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.802663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.802846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.802954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.803047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.803284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.803463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.803653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.803848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.803997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.804098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.804286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.804530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.804739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.804877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.804987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.805180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.805392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.805586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.805775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.805881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.805998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.806103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.806133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.615 qpair failed and we were unable to recover it. 00:28:03.615 [2024-11-26 23:20:29.806214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.615 [2024-11-26 23:20:29.806292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.806317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.806396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.806500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.806532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.806614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.806725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.806752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.806838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.806912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.806937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.807016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.807119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.807144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.807221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.807304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.807331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.807446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.807559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.807587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.807668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.807784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.807810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.807895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.808118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.808354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.808579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.808806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.808910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.808991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.809198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.809419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.809695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.809881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.809987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.810100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.810206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.810232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.810341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.810418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.810447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.810555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.810659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.810685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.810767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.810844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.810869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.810949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.811133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.811325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.811517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.811740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.811881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.811987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.812060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.812085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.616 qpair failed and we were unable to recover it. 00:28:03.616 [2024-11-26 23:20:29.812194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.812279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.616 [2024-11-26 23:20:29.812304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.812454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.812535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.812566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.812650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.812727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.812752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.812864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.812943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.812970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.813077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.813191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.813217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.813332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.813435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.813460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.813541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.813619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.813644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.813726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.813831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.813857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.813941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.814061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.814087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.814201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.814337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.814362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.814444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.814542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.814573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.814681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.814762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.814789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.814907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.815159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.815350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.815564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.815754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.815863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.815940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.816180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.816400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.816598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.816856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.816962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.817081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.817157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.817183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.817257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.817343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.817369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.817451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.817535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.817561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.817647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.817729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.617 [2024-11-26 23:20:29.817757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.617 qpair failed and we were unable to recover it. 00:28:03.617 [2024-11-26 23:20:29.817864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.817946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.817971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.818061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.818269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.818488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.818712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.818900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.818977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.819118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.819333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.819565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.819761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.819872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.819953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.820195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.820417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.820641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.820887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.820992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.821093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.821336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.821576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.821765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.821874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.821958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.822199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.822392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.822646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.822865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.822972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.823048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.823118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.823144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.823253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.823332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.823359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.823466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.823608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.823635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.823747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.823859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.823886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.618 qpair failed and we were unable to recover it. 00:28:03.618 [2024-11-26 23:20:29.823999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.618 [2024-11-26 23:20:29.824087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.824223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.824440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.824636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.824852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.824962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.825067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.825182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.825209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.825294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.825401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.825427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.825503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.825611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.825637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.825732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.825844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.825870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.825975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.826194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.826406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.826616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.826807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.826916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.827002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.827113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.827140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.827220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.827328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.827354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.827438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.827549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.827576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.827689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.827768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.827794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.827915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.828123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.828366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.828572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.828797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.828899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.828983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.829192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.829377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.829634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.829864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.829968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.830058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.830143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.619 [2024-11-26 23:20:29.830170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.619 qpair failed and we were unable to recover it. 00:28:03.619 [2024-11-26 23:20:29.830254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.830363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.830389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.830495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.830578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.830604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.830683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.830763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.830790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.830898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.830981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.831118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.831322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.831538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.831732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.831835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.831916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.832135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.832330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.832568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.832763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.832894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.833001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.833180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.833366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.833555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.833748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.833880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.833960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.834182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.834366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.834567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.834750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.834860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.834974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.835149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.835328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.835552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.835736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.835833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.620 [2024-11-26 23:20:29.835941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.836051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.620 [2024-11-26 23:20:29.836077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.620 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.836196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.836276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.836302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.836388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.836468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.836495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.836581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.836708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.836733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.836820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.836896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.836922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.836995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.837230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.837448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.837667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.837876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.837980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.838122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.838318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.838512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.838710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.838888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.838993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.839070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.839256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.839456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.839680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.839869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.839983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.840082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.840290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.840507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.840715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.840848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.840965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.841151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.841366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.841563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.841756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.841888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.621 qpair failed and we were unable to recover it. 00:28:03.621 [2024-11-26 23:20:29.841969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.621 [2024-11-26 23:20:29.842043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.842176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.842401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.842638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.842828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.842930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.843039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.843116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.843142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.843234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.843309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.843335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.843417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.843497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.843523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.843646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.843766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.843792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.843873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.844142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.844360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.844540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.844754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.844860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.844943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.845142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.845350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.845566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.845783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.845894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.845972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.846154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.846363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.846581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.846772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.846886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.847003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.847076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.847102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.847212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.847291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.847317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.847401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.847511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.847544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.622 [2024-11-26 23:20:29.847629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.847740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.622 [2024-11-26 23:20:29.847766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.622 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.847857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.847937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.847964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.848049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.848278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.848493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.848703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.848914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.848989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.849103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.849323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.849536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.849728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.849835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.849923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.850104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.850316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.850541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.850743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.850877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.850958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.851148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.851384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.851594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.623 [2024-11-26 23:20:29.851837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.623 [2024-11-26 23:20:29.851936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.623 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.852016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.852144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.852170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.852284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.852395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.852422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.852504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.852597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.852623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.852705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.852781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.852807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.852898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.853111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.853306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.853541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.853769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.853872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.853949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.854147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.854392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.854607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.854848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.854953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.855031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.855144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.855171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.855250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.855336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.855362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.855441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.855555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.855587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.855706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.855811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.855837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.855921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.856136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.856358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.856571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.856765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.856898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.856976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.857157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.857369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.857582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.857773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.857942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.858027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.858103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.858129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.858210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.858289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.858315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.858455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.858535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.624 [2024-11-26 23:20:29.858562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.624 qpair failed and we were unable to recover it. 00:28:03.624 [2024-11-26 23:20:29.858641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.858747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.858773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.858878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.858959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.858986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.859068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.859272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.859487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.859715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.859907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.859986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.860119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.860312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.860562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.860779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.860882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.860960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.861141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.861356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.861609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.861835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.861934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.862020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.862236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.862452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.862677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.862852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.862982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.863059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.863274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.863467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.863653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.863844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.863941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.864030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.864241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.864449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.864636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.625 qpair failed and we were unable to recover it. 00:28:03.625 [2024-11-26 23:20:29.864861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.625 [2024-11-26 23:20:29.864966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.865053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.865290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.865474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.865662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.865858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.865958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.866033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.866218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.866400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.866584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.866769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.866872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.866954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.867134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.867316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.867552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.867763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.867871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.867960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.868161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.868337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.868544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.868773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.868872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.868951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.869163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.869351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.869542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.869768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.869865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.869972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.870194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.870409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.870610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.870830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.870940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.626 [2024-11-26 23:20:29.871016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.871104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.626 [2024-11-26 23:20:29.871130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.626 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.871213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.871300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.871326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.871410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.871490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.871516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.871610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.871690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.871716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.871823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.871904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.871930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.872007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.872197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.872414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.872662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.872854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.872956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.873037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.873256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.873441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.873697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.873904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.873984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.874118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.874333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.874529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.874744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.874883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.874970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.875189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.875407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.875602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.875792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.875894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.875972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.876049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.876075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.876159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.876247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.876273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.876356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.876433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.876459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.627 qpair failed and we were unable to recover it. 00:28:03.627 [2024-11-26 23:20:29.876536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.627 [2024-11-26 23:20:29.876615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.876640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.876733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.876840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.876866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.876943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.877125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.877315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.877551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.877774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.877881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.877969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.878167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.878354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.878565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.878773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.878909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.879049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.879231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.879455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.879663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.879857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.879987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.880070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.880154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.880179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.880284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.880359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.880385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.880461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.880566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.880593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.880672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.880800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.880826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.880944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.881168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.881358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.881597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.881819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.881984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.882059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.882241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.882422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.882642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.882842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.882977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.628 qpair failed and we were unable to recover it. 00:28:03.628 [2024-11-26 23:20:29.883056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.628 [2024-11-26 23:20:29.883161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.883187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.883294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.883375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.883401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.883482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.883601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.883628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.883737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.883816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.883842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.883947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.884161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.884396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.884647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.884864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.884967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.885043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.885272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.885473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.885660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.885884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.885986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.886093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.886282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.886494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.886693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.886878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.886995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.887105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.887300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.887488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.887688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.887820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.887905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.888129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.888317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.888564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.888782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.888898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.888983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.889065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.889091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.889172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.889244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.889274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.889389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.889463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.889489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.629 qpair failed and we were unable to recover it. 00:28:03.629 [2024-11-26 23:20:29.889570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.889709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.629 [2024-11-26 23:20:29.889734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.889851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.889933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.889958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.890035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.890173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.890198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.890312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.890391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.890417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.890533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.890624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.890650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.890726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.890839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.890865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.890970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.891162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.891344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.891564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.891759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.891862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.891942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.892118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.892321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.892539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.892785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.892887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.892960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.893170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.893384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.893611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.893794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.893899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.894010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.894199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.894382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.894574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.894796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.894946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.895030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.895219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.895427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.895668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.895861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.895958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.630 [2024-11-26 23:20:29.896066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.896143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.630 [2024-11-26 23:20:29.896169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.630 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.896247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.896360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.896386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.896467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.896553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.896579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.896665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.896747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.896774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.896854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.896930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.896956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.897038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.897142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.897169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.897244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.897350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.897376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.897471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.897549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.897576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.897678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.897800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.897826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.897933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.898129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.898323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.898535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.898725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.898901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.898997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.899107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.899186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.899213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.899288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.899400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.899427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.899506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.899619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.899646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.899722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.899801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.899831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.899940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.900116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.900359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.900584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.900787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.900886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.900964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.901189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.901411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.901633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.631 qpair failed and we were unable to recover it. 00:28:03.631 [2024-11-26 23:20:29.901857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.631 [2024-11-26 23:20:29.901964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.901990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.902102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.902295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.902516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.902716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.902910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.902987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.903154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.903347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.903550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.903742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.903850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.903934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.904135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.904371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.904597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.904782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.904883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.904967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.905188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.905430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.905638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.905854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.905991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.906080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.906273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.906478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.906707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.906892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.906991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.907068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.907259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.907445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.907637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.907816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.907945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.908058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.908134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.908160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.632 qpair failed and we were unable to recover it. 00:28:03.632 [2024-11-26 23:20:29.908245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.632 [2024-11-26 23:20:29.908329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.908355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.908432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.908512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.908544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.908631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.908739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.908765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.908878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.908963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.908988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.909100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.909206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.909232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.909307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.909383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.909409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.909487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.909637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.909664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.909755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.909838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.909863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.909942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.910135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.910352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.910548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.910799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.910932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.911043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.911228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.911418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.911639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.911861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.911962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.912041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.912251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.912436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.912632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.912814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.912949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.913027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.913218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.913408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.913640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.913864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.913993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.914128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.914317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.914493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.633 [2024-11-26 23:20:29.914749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.633 [2024-11-26 23:20:29.914854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.633 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.914932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.915146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.915410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.915639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.915823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.915924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.916002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.916248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.916465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.916653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.916848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.916952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.917067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.917154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.917180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.917289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.917367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.917393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.917481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.917606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.917632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.917713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.917817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.917843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.917923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.918110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.918292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.918537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.918720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.918823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.918940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.919148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.919364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.919580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.919795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.919899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.919975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.920084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.920110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.920187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.920264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.920290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.920376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.920492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.920517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.920611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.920707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.920744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.920874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.921002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.921028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.921111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.921222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.921247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.634 qpair failed and we were unable to recover it. 00:28:03.634 [2024-11-26 23:20:29.921347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.634 [2024-11-26 23:20:29.921466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.921492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.921585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.921667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.921693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.921790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.921873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.921898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.921974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.922204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.922414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.922613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.922800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.922966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.923045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.923258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.923466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.923672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.923853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.923951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.924035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.924272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.924483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.924686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.924880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.924977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.925101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.925327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.925537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.925725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.925912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.925992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.926092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.926351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.926536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.926784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.926883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.635 [2024-11-26 23:20:29.926976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.927086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.635 [2024-11-26 23:20:29.927112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.635 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.927187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.927272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.927297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.927416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.927554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.927582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.927664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.927745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.927771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.927862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.927941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.927967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.928083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.928167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.928192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.928280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.928361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.928388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.928472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.928552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.928580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.928696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.928801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.928828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.928938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.929151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.929366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.929583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.929823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.929946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.930031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.930105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.930130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.930236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.930323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.930349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.930544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.930625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.930652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.930739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.930821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.930848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.930928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.931142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.931332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.931573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.931808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.931920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.932034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.932240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.932419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.932641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.636 [2024-11-26 23:20:29.932884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.932990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.636 [2024-11-26 23:20:29.933024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.636 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.933130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.933272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.933312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.933479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.933594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.933637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.933772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.933885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.933935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.934074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.934216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.934255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.934366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.934489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.934517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.934624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.934709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.934752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.934847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.934971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.935010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.935109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.935216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.935261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.935359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.935495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.935559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.935656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.935746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.935782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.935885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.935974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.936103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.936390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.936627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.936835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.936961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.934 [2024-11-26 23:20:29.937040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.937177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.934 [2024-11-26 23:20:29.937203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.934 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.937303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.937384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.937410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.937496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.937582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.937609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.937723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.937817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.937843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.937949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.938081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.938118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.938233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.938346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.938372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.938485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.938593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.938620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.938697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.938778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.938804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.938928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.939142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.939324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.939514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.939718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.939900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.939985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.940095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.940317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.940558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.940769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.940876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.940985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.941179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.941408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.941608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.941821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.941969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.942053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.942243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.942485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.942676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.942853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.942969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.943065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.943147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.943173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.935 qpair failed and we were unable to recover it. 00:28:03.935 [2024-11-26 23:20:29.943286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.943362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.935 [2024-11-26 23:20:29.943388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.943475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.943558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.943584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.943708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.943789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.943815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.943967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.944194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.944414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.944614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.944821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.944928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.945003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.945242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.945473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.945659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.945895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.945971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.946097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.946318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.946542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.946737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.946846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.946922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.947140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.947328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.947569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.947819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.947925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.948009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.948263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.948481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.948672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.948898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.948975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.949000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.949079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.949156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.949182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.949291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.949397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.949424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.936 qpair failed and we were unable to recover it. 00:28:03.936 [2024-11-26 23:20:29.949508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.936 [2024-11-26 23:20:29.949591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.949618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.949733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.949810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.949836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.949954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.950215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.950479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.950683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.950904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.950987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.951089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.951306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.951500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.951723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.951919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.951993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.952099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.952301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.952547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.952732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.952836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.952943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.953128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.953380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.953565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.953781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.953916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.953996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.954268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.954487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.954685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.954881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.954977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.955058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.955162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.955188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.955270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.955348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.955374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.955453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.955546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.937 [2024-11-26 23:20:29.955574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.937 qpair failed and we were unable to recover it. 00:28:03.937 [2024-11-26 23:20:29.955684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.955772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.955798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.955886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.955999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.956103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.956364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.956558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.956733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.956915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.956989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.957089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.957345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.957549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.957777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.957915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.957992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.958184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.958373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.958568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.958786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.958923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.959007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.959224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.959431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.959685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.959863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.959962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.960048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.960123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.960149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.960234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.960345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.960371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.960483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.960613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.960640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.960724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.960801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.960828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.960956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.961060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.961086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.938 qpair failed and we were unable to recover it. 00:28:03.938 [2024-11-26 23:20:29.961185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.961308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.938 [2024-11-26 23:20:29.961335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.961411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.961490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.961516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.961609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.961690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.961716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.961797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.961907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.961933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.962043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.962118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.962144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.962235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.962358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.962384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.962479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.962567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.962594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.962711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.962799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.962826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.962934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.963121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.963372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.963627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.963880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.963994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.964100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.964307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.964503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.964749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.964892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.965017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.965203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.965388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.965610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.965825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.965925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.966037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.966147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.966174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.966251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.966330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.966356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.966471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.966552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.966590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.966672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.966781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.966807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.939 qpair failed and we were unable to recover it. 00:28:03.939 [2024-11-26 23:20:29.966950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.939 [2024-11-26 23:20:29.967055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.967170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.967396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.967610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.967797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.967903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.967978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.968194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.968407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.968686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.968911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.968994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.969157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.969377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.969632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.969884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.969988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.970070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.970187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.970217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.970299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.970404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.970430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.970504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.970590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.970618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.970726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.970811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.970838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.970953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.971139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.971321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.971514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.971737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.971886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.971967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.972146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.972374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.972570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.972782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.972899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.972998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.973075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.973101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.940 qpair failed and we were unable to recover it. 00:28:03.940 [2024-11-26 23:20:29.973176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.940 [2024-11-26 23:20:29.973256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.973283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.973388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.973490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.973517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.973604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.973690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.973716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.973823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.973902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.973928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.974009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.974199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.974422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.974607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.974803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.974946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.975021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.975208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.975424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.975658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.975879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.975989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.976094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.976342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.976532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.976717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.976908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.976982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.977087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.977282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.977559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.977809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.977915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.977994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.978172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.978399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.978599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.978791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.978923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.941 [2024-11-26 23:20:29.979049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.979132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.941 [2024-11-26 23:20:29.979159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.941 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.979235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.979315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.979341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.979465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.979560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.979586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.979672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.979751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.979778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.979857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.979941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.979968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.980046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.980285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.980474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.980700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.980922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.980997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.981106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.981353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.981549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.981780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.981912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.982021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.982241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.982420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.982629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.982810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.982975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.983131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.983208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.983234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.983316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.983420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.983446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.983522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.983614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.983640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.983726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.983807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.983834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.983974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.984215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.984433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.984623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.984830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.984969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.985049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.985163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.985189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.942 qpair failed and we were unable to recover it. 00:28:03.942 [2024-11-26 23:20:29.985281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.942 [2024-11-26 23:20:29.985384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.985409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.985496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.985631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.985658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.985741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.985830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.985857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.985933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.986123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.986370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.986570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.986808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.986914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.987024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.987279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.987469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.987648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.987842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.987949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.988060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.988184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.988211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.988284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.988398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.988425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.988510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.988597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.988624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.988709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.988785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.988812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.988920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.989132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.989351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.989595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.989787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.989888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.989970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.990078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.990105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.990184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.990292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.990318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.990407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.990537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.990564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.943 [2024-11-26 23:20:29.990643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.990751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.943 [2024-11-26 23:20:29.990777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.943 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.990900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.990981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.991084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.991329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.991581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.991775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.991917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.992004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.992200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.992423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.992619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.992835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.992988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.993072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.993181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.993207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.993289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.993395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.993421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.993506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.993594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.993621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.993729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.993847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.993873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.993957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.994178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.994356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.994549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.994801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.994903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.994984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.995170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.995382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.995590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.995885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.995996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.996088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.996193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.996220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.996312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.996417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.996444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.996545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.996622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.996649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.996737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.996876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.996903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.944 qpair failed and we were unable to recover it. 00:28:03.944 [2024-11-26 23:20:29.996985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.944 [2024-11-26 23:20:29.997063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.997213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.997437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.997655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.997856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.997995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.998110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.998217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.998242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.998350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.998435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.998461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.998574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.998652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.998679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.998762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.998841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.998867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.998976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.999190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.999370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.999605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:29.999802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:29.999952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.000054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.000163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.000189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.000314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.000403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.000432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.000519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.000601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.000637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.000723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.000820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.000847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.000927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.001138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.001336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.001564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.001767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.001882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.001963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.002160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.002407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.002594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.002838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.002943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.003057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.003138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.003164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.945 qpair failed and we were unable to recover it. 00:28:03.945 [2024-11-26 23:20:30.003253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.945 [2024-11-26 23:20:30.003328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.003354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.003430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.003544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.003571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.003662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.003774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.003800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.003882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.004122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.004320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.004503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.004716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.004825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.004905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.005138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.005362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.005559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.005782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.005928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.006010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.006123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.006149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.006241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.006379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.006405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.006482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.006570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.006598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.006676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.006761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.006794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.006904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.007011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.007055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.007182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.007289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.007321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.007435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.007521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.007568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.007684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.007787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.007831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.007957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.008085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.008142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.008261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.008361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.008388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.008478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.008597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.008633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.008741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.008864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.008903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.009021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.009124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.009157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.009294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.009385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.009413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.009501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.009595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.009633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.009750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.009859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.946 [2024-11-26 23:20:30.009895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.946 qpair failed and we were unable to recover it. 00:28:03.946 [2024-11-26 23:20:30.010009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.010141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.010178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.010296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.010430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.010467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.010597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.010708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.010745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.010892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.011000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.011035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.011176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.011316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.011352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.011463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.011571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.011609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.011726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.011833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.011870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.011984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.012089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.012125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.012261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.012356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.012392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.012537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.012637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.012674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.012807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.012913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.012943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.013064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.013151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.013177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.013269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.013349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.013375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.013468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.013578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.013607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.013690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.013799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.013825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.013916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.014175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.014399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.014611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.014861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.014979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.015078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.015162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.015189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.015276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.015362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.015389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.015476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.015618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.015646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.015759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.015836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.015863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.015947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.016147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.016349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.016545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.947 qpair failed and we were unable to recover it. 00:28:03.947 [2024-11-26 23:20:30.016792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.947 [2024-11-26 23:20:30.016921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.016948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.017032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.017120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.017146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.017227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.017320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.017348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.017490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.017606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.017633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.017721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.017811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.017838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.017927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.018124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.018345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.018534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.018733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.018847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.018934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.019122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.019398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.019630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.019826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.019997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.020091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.020202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.020229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.020323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.020403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.020429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.020507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.020601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.020627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.020710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.020823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.020849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.020963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.021197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.021416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.021649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.948 [2024-11-26 23:20:30.021840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.948 [2024-11-26 23:20:30.021953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.948 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.022063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.022252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.022437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.022679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.022865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.022999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.023091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.023173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.023200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.023282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.023414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.023443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.023532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.023618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.023644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.023726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.023815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.023849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.023970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.024191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.024432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.024661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.024872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.024971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.025046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.025264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.025454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.025645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.025831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.025939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.026023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.026248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.026470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.026660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.026876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.026987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.027078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.027267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.027489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.027726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.949 qpair failed and we were unable to recover it. 00:28:03.949 [2024-11-26 23:20:30.027919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.949 [2024-11-26 23:20:30.027998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.028111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.028334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.028563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.028795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.028907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.029021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.029216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.029439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.029653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.029843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.029950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.030033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.030231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.030425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.030655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.030844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.030949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.031063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.031204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.031232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.031309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.031434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.031462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.031548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.031630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.031658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.031739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.031823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.031851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.031943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.032148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.032380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.032597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.032809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.032947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.033034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.033218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.033444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.033663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.950 [2024-11-26 23:20:30.033893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.033982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.950 [2024-11-26 23:20:30.034010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.950 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.034101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.034209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.034236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.034319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.034434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.034460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.034578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.034676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.034704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.034793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.034884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.034911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.035020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.035207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.035398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.035623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.035831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.035937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.036018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.036133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.036159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.036273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.036359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.036386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.036495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.036607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.036635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.036722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.036811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.036839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.036946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.037163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.037377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.037614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.037831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.037946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.038056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.038251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.038475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.038689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.038886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.038997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.039137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.039355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.039549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.039771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.039900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.040045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.040121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.040148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.951 qpair failed and we were unable to recover it. 00:28:03.951 [2024-11-26 23:20:30.040231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.951 [2024-11-26 23:20:30.040306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.040332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.040418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.040546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.040576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.040663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.040766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.040794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.040907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.040985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.041094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.041313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.041536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.041737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.041842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.041922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.042140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.042363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.042558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.042802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.042907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.042992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.043213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.043470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.043690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.043908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.043988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.044096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.044369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.044580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.044818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.044930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.045039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.045155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.045183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.045274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.045353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.045379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.045473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.045551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.045588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.952 [2024-11-26 23:20:30.045675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.045761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.952 [2024-11-26 23:20:30.045788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.952 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.045884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.045995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.046108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.046313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.046564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.046829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.046966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.047080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.047159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.047185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.047297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.047377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.047403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.047485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.047567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.047595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.047729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.047861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.047892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.047987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.048177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.048430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.048669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.048922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.048999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.049107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.049325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.049513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.049729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.049836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.049924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.050189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.050407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.050620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.050838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.050980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.051120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.051227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.051273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.051415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.051547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.051591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.051718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.051838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.051877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.052005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.052100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.052128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.052215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.052298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.052324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.953 qpair failed and we were unable to recover it. 00:28:03.953 [2024-11-26 23:20:30.052409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.953 [2024-11-26 23:20:30.052535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.052565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.052660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.052751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.052777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.052864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.052942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.052968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.053051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.053134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.053161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.053248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.053363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.053390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.053472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.053574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.053601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.053723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.053831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.053856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.053938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.054167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.054399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.054632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.054850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.054984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.055097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.055208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.055235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.055347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.055431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.055460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.055558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.055675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.055702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.055788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.055878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.055905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.056027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.056132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.056158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.056299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.056375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.056401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.056487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.056589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.056616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.056697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.056848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.056874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.056987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.057069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.057096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.057180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.057303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.057330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.057411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.057531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.057559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.057673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.057750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.057777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.057864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.058113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.058366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.058598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.954 [2024-11-26 23:20:30.058795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.954 [2024-11-26 23:20:30.058903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.954 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.058991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.059099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.059126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.059202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.059308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.059341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.059430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.059545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.059572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.059688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.059774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.059801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.059889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.060105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.060315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.060517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.060706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.060816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.060931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.061119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.061314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.061571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.061797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.061905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.061989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.062184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.062465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.062656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.062845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.062975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.063054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.063134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.063162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.063271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.063358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.063385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.063497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.063587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.063617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.063733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.063815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.063842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.063926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.064033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.064060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.064144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.064282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.064308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.064458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.064564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.064591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.064675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.064785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.064811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.064931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.065010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.065037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.955 qpair failed and we were unable to recover it. 00:28:03.955 [2024-11-26 23:20:30.065113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.955 [2024-11-26 23:20:30.065195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.065222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.065308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.065418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.065444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.065518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.065608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.065634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.065743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.065815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.065840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.065932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.066185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.066381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.066600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.066840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.066953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.067034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.067125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.067150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.067270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.067372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.067398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.067485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.067590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.067618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.067704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.067816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.067842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.067928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.068152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.068379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.068609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.068798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.068927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.069002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.069107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.069134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.069248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.069362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.069389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.069467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.069555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.069581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.069668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.069781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.069807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.069917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.070160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.070353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.070564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.070757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.070868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.071011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.071095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.071120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.071204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.071285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.956 [2024-11-26 23:20:30.071311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.956 qpair failed and we were unable to recover it. 00:28:03.956 [2024-11-26 23:20:30.071430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.071513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.071546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.071640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.071716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.071742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.071819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.071900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.071927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.072039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.072259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.072459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.072645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.072865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.072974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.073053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.073269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.073459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.073654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.073869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.073984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.074076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.074278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.074496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.074683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.074871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.074991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.075098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.075183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.075210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.075288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.075421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.075447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.075558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.075638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.075665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.075752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.075858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.075884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.075962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.076074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.076100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.076209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.076299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.076326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.957 [2024-11-26 23:20:30.076437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.076535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.957 [2024-11-26 23:20:30.076562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.957 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.076653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.076745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.076772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.076863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.076944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.076971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.077056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.077278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.077472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.077666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.077859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.077999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.078080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.078169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.078195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.078315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.078395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.078421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.078504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.078591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.078618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.078700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.078809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.078834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.078944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.079141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.079359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.079547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.079778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.079916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.080028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.080108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.080135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.080211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.080320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.080346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.080457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.080539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.080566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.080678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.080793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.080819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.080963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.081157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.081348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.081592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.081809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.081950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.082062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.082135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.082161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.082242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.082321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.082348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.082425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.082504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.082537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.958 qpair failed and we were unable to recover it. 00:28:03.958 [2024-11-26 23:20:30.082659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.958 [2024-11-26 23:20:30.082733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.082759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.082840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.082946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.082972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.083052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.083141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.083170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.083289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.083404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.083430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.083513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.083607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.083634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.083715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.083818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.083844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.083926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.084136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.084444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.084656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.084839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.084974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.085056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.085164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.085190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.085271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.085362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.085388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.085472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.085549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.085576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.085694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.085803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.085829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.085938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.086134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.086320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.086573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.086789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.086891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.087030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.087283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.087463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.087694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.087905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.087982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.088113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.088364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.088555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.088737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.959 [2024-11-26 23:20:30.088870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.959 qpair failed and we were unable to recover it. 00:28:03.959 [2024-11-26 23:20:30.088960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.089144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.089329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.089554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.089796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.089901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.090018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.090136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.090162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.090247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.090329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.090354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.090439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.090551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.090593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.090710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.090846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.090873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.090959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.091177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.091452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.091641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.091850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.091981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.092155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.092380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.092577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.092765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.092882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.092995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.093191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.093399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.093650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.093864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.093999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.094097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.094181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.094212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.094294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.094407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.094433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.094541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.094623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.094648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.094735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.094844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.094870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.094949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.095057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.095083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.960 [2024-11-26 23:20:30.095166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.095248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.960 [2024-11-26 23:20:30.095273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.960 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.095352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.095466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.095492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.095628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.095737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.095762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.095853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.095964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.095989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.096068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.096151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.096177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.096264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.096376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.096402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.096490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.096579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.096606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.096732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.096812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.096838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.096943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.097130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.097352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.097568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.097755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.097889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.097967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.098197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.098412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.098645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.098836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.098968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.099084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.099191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.099217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.099297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.099382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.099408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.099550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.099635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.099661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.099747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.099856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.099882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.099993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.100077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.100103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.100183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.100321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.100346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.100460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.100543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.100569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.100647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.100753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.100779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.100900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.101009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.101034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.101120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.101199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.961 [2024-11-26 23:20:30.101225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.961 qpair failed and we were unable to recover it. 00:28:03.961 [2024-11-26 23:20:30.101304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.101383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.101409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.101490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.101576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.101603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.101691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.101776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.101801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.101882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.101967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.101994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.102073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.102260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.102462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.102671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.102850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.102958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.103095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.103200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.103226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.103319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.103401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.103426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.103520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.103608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.103634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.103714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.103797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.103823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.103935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.104161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.104343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.104542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.104741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.104874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.104994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.105104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.105136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.105255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.105379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.105405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.105522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.105602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.105628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.105742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.105826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.105851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.105932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.106109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.106288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.106506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.962 qpair failed and we were unable to recover it. 00:28:03.962 [2024-11-26 23:20:30.106707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.962 [2024-11-26 23:20:30.106831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.106856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.106934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.107177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.107393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.107584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.107813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.107960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.108083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.108216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.108242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.108324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.108401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.108427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.108550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.108633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.108659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.108777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.108860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.108886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.108966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.109174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.109395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.109593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.109820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.109950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.110092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.110172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.110198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.110277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.110354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.110379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.110483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.110570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.110596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.110673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.110796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.110822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.110947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.111052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.111078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.111157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.111266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.111292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.111369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.111471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.111497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.111588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.111696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.111721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.111915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.112021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.112047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.112159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.112267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.112293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.112483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.112573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.112600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.112677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.112785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.112811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.112925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.113001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.113027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.113114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.113196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.113222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.963 qpair failed and we were unable to recover it. 00:28:03.963 [2024-11-26 23:20:30.113302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.963 [2024-11-26 23:20:30.113411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.113436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.113522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.113633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.113659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.113849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.113922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.113948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.114055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.114138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.114164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.114278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.114360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.114387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.114502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.114619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.114646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.114728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.114815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.114841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.115029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.115139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.115164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.115276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.115418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.115444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.115532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.115621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.115646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.115722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.115824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.115850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.115936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.116010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.116035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.116148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.116266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.116292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.116371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.116498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.116532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.116725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.116841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.116870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.116979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.117063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.117089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.117173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.117259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.117285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.117403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.117512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.117546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.117630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.117705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.117730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.117840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.118131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.118321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.118558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.118782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.118883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.118995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.119196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.119412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.119636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.119832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.964 [2024-11-26 23:20:30.119929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.964 qpair failed and we were unable to recover it. 00:28:03.964 [2024-11-26 23:20:30.120038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.120218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.120449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.120645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.120874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.120977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.121067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.121141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.121166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.121285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.121390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.121416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.121514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.121596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.121622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.121703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.121815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.121841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.121932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.122124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.122334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.122552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.122794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.122929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.123013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.123221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.123438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.123636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.123864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.123996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.124070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.124173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.124198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.124284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.124392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.124417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.124554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.124637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.124663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.124741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.124856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.124881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.124955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.125149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.125336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.125558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.125791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.125926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.126007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.126196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.965 [2024-11-26 23:20:30.126221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.965 qpair failed and we were unable to recover it. 00:28:03.965 [2024-11-26 23:20:30.126297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.126388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.126413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.126530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.126604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.126630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.126737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.126821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.126847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.126934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.127152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.127335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.127604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.127788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.127894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.127972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.128186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.128371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.128562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.128758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.128856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.128933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.129043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.129068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.129176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.129287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.129312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.129398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.129472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.129497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.129692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.129801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.129827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.129937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.130140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.130354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.130554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.130770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.130873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.130956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.131066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.131091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.131178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.131284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.131309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.131394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.131508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.131538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.966 qpair failed and we were unable to recover it. 00:28:03.966 [2024-11-26 23:20:30.131623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.966 [2024-11-26 23:20:30.131704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.131730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.131842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.131947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.131973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.132059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.132197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.132223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.132351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.132432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.132457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.132547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.132633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.132658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.132739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.132815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.132841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.132961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.133068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.133093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.133168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.133246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.133273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.133361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.133469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.133494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.133577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.133765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.133790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.133931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.134190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.134380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.134612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.134797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.134904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.135094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.135201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.135226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.135310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.135391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.135416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.135500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.135596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.135623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.135703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.135781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.135806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.135912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.136118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.136357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.136569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.136793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.136913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.136997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.137070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.137095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.137174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.137263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.137289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.137396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.137585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.137612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.137802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.137892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.137919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.138031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.138146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.967 [2024-11-26 23:20:30.138171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.967 qpair failed and we were unable to recover it. 00:28:03.967 [2024-11-26 23:20:30.138251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.138361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.138387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.138468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.138549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.138575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.138661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.138744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.138770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.138848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.138956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.138981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.139070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.139152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.139178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.139252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.139367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.139392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.139470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.139557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.139584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.139680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.139764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.139790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.139916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.140146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.140428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.140615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.140800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.140961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.141044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.141124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.141150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.141258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.141362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.141392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.141510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.141590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.141616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.141717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.141797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.141823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.141905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.142163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.142379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.142571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.142754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.142857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.142935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.143129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.143310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.143516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.143707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.143835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.143979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.144065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.144090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.968 [2024-11-26 23:20:30.144171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.144263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.968 [2024-11-26 23:20:30.144288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.968 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.144367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.144448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.144475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.144564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.144643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.144669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.144748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.144828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.144853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.144968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.145047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.145072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.145149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.145223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.145249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.145440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.145557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.145583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.145697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.145808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.145833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.145942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.146148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.146328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.146578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.146793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.146930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.147009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.147117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.147142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.147230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.147340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.147367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.147482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.147580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.147608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.147695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.147805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.147831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.147943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.148154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.148334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.148509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.148720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.148857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.148938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.149150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.149328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.149508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.149701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.149812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.150002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.150115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.150141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.150245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.150349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.150375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.969 qpair failed and we were unable to recover it. 00:28:03.969 [2024-11-26 23:20:30.150452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.969 [2024-11-26 23:20:30.150602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.150629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.150734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.150818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.150844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.150929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.151160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.151371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.151597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.151789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.151951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.152029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.152237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.152473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.152658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.152869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.152981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.153087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.153333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.153560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.153762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.153873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.153980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.154191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.154412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.154631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.154841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.154947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.155065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.155142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.155168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.155252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.155330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.155355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.155451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.155536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.155563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.155673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.155752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.155778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.155893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.156003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.156029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.156106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.156219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.156244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.156356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.156433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.156459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.156576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.156654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.970 [2024-11-26 23:20:30.156680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.970 qpair failed and we were unable to recover it. 00:28:03.970 [2024-11-26 23:20:30.156795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.156901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.156927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.157051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.157165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.157190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.157304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.157418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.157444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.157563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.157647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.157672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.157758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.157866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.157891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.157988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.158179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.158403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.158606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.158802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.158934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.159045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.159126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.159151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.159238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.159311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.159336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.159445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.159535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.159561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.159675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.159755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.159782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.159899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.160107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.160400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.160602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.160822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.160932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.161017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.161122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.161148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.161220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.161533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.161559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.161757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.161901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.161927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.162011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.162092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.162117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.162234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.162311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.162337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.162412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.162551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.162578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.971 qpair failed and we were unable to recover it. 00:28:03.971 [2024-11-26 23:20:30.162665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.971 [2024-11-26 23:20:30.162744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.162769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.162860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.162964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.162990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.163073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.163182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.163207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.163325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.163400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.163426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.163535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.163723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.163748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.163889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.163981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.164082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.164303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.164492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.164710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.164815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.164924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.165003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.165029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.165106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.165219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.165245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.165338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.165478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.165504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.165700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.165887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.165912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.166019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.166231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.166432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.166630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.166865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.166967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.167156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.167342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.167368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.167483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.167571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.167597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.167786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.167862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.167888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.167994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.168079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.168105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.168180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.168269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.168294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.168402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.168476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.168501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.168667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20c2600 is same with the state(5) to be set 00:28:03.972 [2024-11-26 23:20:30.168792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.168920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.168949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.169032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.169112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.169137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.169254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.169335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.169361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.972 qpair failed and we were unable to recover it. 00:28:03.972 [2024-11-26 23:20:30.169450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.169538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.972 [2024-11-26 23:20:30.169564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.169673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.169762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.169789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.169905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.169990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.170103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.170323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.170515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.170715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.170817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.170895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.171128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.171328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.171529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.171868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.171975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.172052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.172161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.172186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.172261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.172339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.172364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.172464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.172575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.172601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.172690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.172799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.172824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.172908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.173164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.173418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.173613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.173830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.173930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.174012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.174217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.174456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.174705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.174925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.174994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.175019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.175099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.175174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.175198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.175311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.175383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.175408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.175499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.175616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.175641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.973 qpair failed and we were unable to recover it. 00:28:03.973 [2024-11-26 23:20:30.175720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.973 [2024-11-26 23:20:30.175800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.175824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.175912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.176154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.176368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.176558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.176744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.176891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.176964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.177233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.177468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.177668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.177888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.177996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.178097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.178272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.178462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.178695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.178795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.178914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.179129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.179356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.179544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.179766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.179900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.180008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.180192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.180382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.180619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.180846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.180978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.181059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.181239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.181435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.181628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.974 qpair failed and we were unable to recover it. 00:28:03.974 [2024-11-26 23:20:30.181843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.974 [2024-11-26 23:20:30.181970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.181996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.182099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.182286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.182458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.182666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.182867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.182974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.183056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.183133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.183158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.185587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.185666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.185691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.185779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.185858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.185883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.185968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.186191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.186383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.186588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.186781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.186918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.187026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.187235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.187470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.187680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.187864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.187981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.188083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.188301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.188503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.188735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.188840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.188928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.189049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.189074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.189187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.189309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.189334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.975 qpair failed and we were unable to recover it. 00:28:03.975 [2024-11-26 23:20:30.189409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.975 [2024-11-26 23:20:30.189484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.189509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.189636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.189714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.189739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.189847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.189962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.189987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.190062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.190278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.190485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.190684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.190870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.190967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.191077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.191304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.191487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.191690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.191890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.191986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.192105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.192308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.192541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.192780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.192928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.193030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.193225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.193460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.193677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.193861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.193961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.194043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.194117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.194142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.194256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.194365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.194390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.194476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.194575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.194600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.194688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.194795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.194830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.194955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.195038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.195065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.195178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.195292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.195318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.976 [2024-11-26 23:20:30.195400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.195544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.976 [2024-11-26 23:20:30.195571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.976 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.195685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.195763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.195788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.195880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.195966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.195991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.196078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.196300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.196495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.196692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.196912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.196993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.197102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.197309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.197539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.197759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.197908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.197988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.198168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.198354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.198560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.198765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.198887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.198973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.199185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.199397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.199637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.199823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.199937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.200022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.200202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.200389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.200580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.200773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.200897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.200984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.201169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.201429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.201633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.977 [2024-11-26 23:20:30.201848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.977 [2024-11-26 23:20:30.201948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.977 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.202030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.202247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.202476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.202703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.202892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.202997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.203076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.203194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.203219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.203334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.203421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.203445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.203529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.203638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.203663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.203746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.203829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.203855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.203968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.204185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.204371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.204593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.204784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.204887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.204995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.205176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.205383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.205586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.205782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.205892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.206002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.206225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.206447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.206673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.206854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.206986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.207065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.207252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.207430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.207656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.207881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.207988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.208071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.208147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.208172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.978 [2024-11-26 23:20:30.208281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.208359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.978 [2024-11-26 23:20:30.208384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.978 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.208459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.208539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.208568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.208677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.208762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.208787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.208872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.208975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.208999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.209082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.209155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.209180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.209264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.209343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.209369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.209483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.209587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.209618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.209710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.209791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.209815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.209931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.210109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.210303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.210549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.210751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.210869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.210948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.211141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.211312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.211559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.211804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.211914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.211990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.212070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.212096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.212209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.212320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.212344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.212433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.212632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.212658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.212765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.212854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.212879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.212959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.213144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.213384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.213597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.213855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.213994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.214078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.214187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.214211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.214316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.214398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.214423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.214514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.214607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.214633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.214711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.214829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.214853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.979 qpair failed and we were unable to recover it. 00:28:03.979 [2024-11-26 23:20:30.214970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.979 [2024-11-26 23:20:30.215105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.215213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.215427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.215618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.215845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.215976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.216067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.216147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.216171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.216260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.216374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.216409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.216556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.216663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.216688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.216801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.216892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.216917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.217000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.217207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.217423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.217652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.217845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.217981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.218070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.218157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.218182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.218259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.218364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.218389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.218488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.218628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.218654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.218732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.218878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.218913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.219006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.219116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.219142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.219224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.219315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.219341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.980 qpair failed and we were unable to recover it. 00:28:03.980 [2024-11-26 23:20:30.219454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.219565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.980 [2024-11-26 23:20:30.219590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.219670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.219748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.219773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.219857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.219930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.219954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.220032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.220241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.220452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.220685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.220869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.220993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.221083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.221274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.221496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.221690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.221877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.221985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.222074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.222155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.222180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.222258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.222333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.222357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.222469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.222587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.222613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.222701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.222783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.222808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.222887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.223123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.223310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.223536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.223728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.223839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.223948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.224143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.224419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.224647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.224850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.224949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.225033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.225113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.225138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.225249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.225327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.225352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.981 [2024-11-26 23:20:30.225444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.225540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.981 [2024-11-26 23:20:30.225567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.981 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.225649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.225724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.225748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.225842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.225919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.225944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.226024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.226138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.226163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.226250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.226328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.226353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.226464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.226558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.226584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.226692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.226774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.226799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.226892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.227159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.227366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.227574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.227793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.227892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.227974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.228148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.228364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.228615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.228817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.228919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.229002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.229224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.229423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.229665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.229884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.229989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.230098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.230179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.230204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.230316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.230399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.230425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.230506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.230590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.230616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.230695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.230809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.230835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.230915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.231162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.231381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.231605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.231799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.231941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.982 qpair failed and we were unable to recover it. 00:28:03.982 [2024-11-26 23:20:30.232049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.982 [2024-11-26 23:20:30.232125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.232233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.232437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.232642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.232830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.232957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.233043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.233123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.233147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.233224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.233371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.233400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.233490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.233640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.233667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.233756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.233853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.233878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.233968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.234189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.234409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.234624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.234847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.234952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.235035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.235216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.235399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.235645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.235836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.235940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.236048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.236239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.236424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.236655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.236846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.236949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.237090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.237275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.237497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.237696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.237885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.237991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.238106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.238180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.238204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.238312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.238421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.983 [2024-11-26 23:20:30.238446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.983 qpair failed and we were unable to recover it. 00:28:03.983 [2024-11-26 23:20:30.238547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.238653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.238678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.238754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.238840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.238865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.238948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.239166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.239339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.239576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.239777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.239920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.239995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.240244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.240424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.240653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.240878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.240974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.241054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.241131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.241155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.241242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.241328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.241353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.241441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.241545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.241570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.241664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.241770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.241795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.241914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.242128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.242379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.242580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.242800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.242898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.243010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.243232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.243407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.243648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.243831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.243958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.984 qpair failed and we were unable to recover it. 00:28:03.984 [2024-11-26 23:20:30.244052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.984 [2024-11-26 23:20:30.244160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.244185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.244267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.244371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.244396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.244501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.244597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.244622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.244701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.244779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.244804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.244898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.244981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.245089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.245310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.245542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.245728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.245839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.245924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.246155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.246371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.246558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.246773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.246891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.246977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.247157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.247375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.247572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.247788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.247898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.247980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.248163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.248365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.248588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.248804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.248910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.249020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.249233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.249447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.249667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.249866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.249971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.250111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.250217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.250242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.250365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.250442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.250467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.985 qpair failed and we were unable to recover it. 00:28:03.985 [2024-11-26 23:20:30.250560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.985 [2024-11-26 23:20:30.250642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.250668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.250760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.250835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.250861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.250969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.251186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.251414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.251686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.251883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.251992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.252098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.252277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.252466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.252679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.252820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.252935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.253124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.253338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.253581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.253795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.253929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.254013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.254122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.254147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.254260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.254372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.254399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.254478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.254554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.254581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.254684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.254808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.254840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.254963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.255158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.255346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.255565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.255791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.255926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.256049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.256265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.256452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.256654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.256883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.256989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.257071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.257148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.986 [2024-11-26 23:20:30.257173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.986 qpair failed and we were unable to recover it. 00:28:03.986 [2024-11-26 23:20:30.257257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.257337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.257364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.257474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.257559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.257586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.257700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.257782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.257808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.257923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.258146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.258340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.258604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.258819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.258983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.259098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.259182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.259208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.259299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.259443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.259469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.259558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.259701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.259727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.259843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.259927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.259952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.260065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.260280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.260467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.260667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.260888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.260998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.261166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.261390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.261616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.261850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.261953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.262090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.262172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.262198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.262287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.262362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.262387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.262477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.262602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.262629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.262742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.262836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.262863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.262962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.263180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.263377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.263611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.263866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.263976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.987 [2024-11-26 23:20:30.264094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.264170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.987 [2024-11-26 23:20:30.264194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.987 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.264332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.264443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.264468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.264567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.264647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.264673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.264813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.264896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.264920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.265019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.265214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.265443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.265678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.265908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.265987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.266094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.266311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.266581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.266800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.266908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.266989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.267214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.267406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.267652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.267882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.267998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.268086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.268161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.268192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.268273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.268356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.268382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.268462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.268551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.268577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.268667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.268803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.268828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.268938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.269132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.269311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.269535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.269721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.269819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.269930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.270005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.988 [2024-11-26 23:20:30.270031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.988 qpair failed and we were unable to recover it. 00:28:03.988 [2024-11-26 23:20:30.270116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.270193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.270223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.270333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.270439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.270464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.270563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.270674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.270700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.270789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.270863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.270888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.270966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.271241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.271425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.271609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.271798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.271911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.271991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.272213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.272441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.272635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.272828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.272929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.273056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.273237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.273461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.273650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.273831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.273967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.274050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.274262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.274478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.274674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.274882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.274993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.275097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.275404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.275633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.275846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.275946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.276061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.276141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.276166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.276247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.276359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.276384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.989 [2024-11-26 23:20:30.276498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.276614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.989 [2024-11-26 23:20:30.276639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.989 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.276723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.276798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.276831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.276909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.277123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.277377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.277553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.277723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.277912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.277991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.278129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.278343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.278566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.278790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.278891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.278967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.279183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.279380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.279611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.279808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.279925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.280043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.280123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.280149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.280235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.280307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.280333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.280415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.280503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.280548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.280633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.280780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.280804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.280926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.281115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.281334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.281566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.281763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.281869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.281992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.282202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.282421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.282678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.282868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.990 [2024-11-26 23:20:30.282986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.990 qpair failed and we were unable to recover it. 00:28:03.990 [2024-11-26 23:20:30.283135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.283212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.283238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.283344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.283462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.283488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.283589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.283670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.283696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.283838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.283923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.283949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.284038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.284225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.284420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.284669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.284858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.284959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.285099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.285210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.285235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.285324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.285430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.285454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.285595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.285680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.285707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.285794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.285870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.285895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.285980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.286198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.286401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.286615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.286794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.286919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.286998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.287078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.287105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.287214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.287299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.287324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.287412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.287532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.287557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.287644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.287725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.991 [2024-11-26 23:20:30.287750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:03.991 qpair failed and we were unable to recover it. 00:28:03.991 [2024-11-26 23:20:30.287836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.287923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.287949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.266 qpair failed and we were unable to recover it. 00:28:04.266 [2024-11-26 23:20:30.288066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.288160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.288187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.266 qpair failed and we were unable to recover it. 00:28:04.266 [2024-11-26 23:20:30.288275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.288385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.288411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.266 qpair failed and we were unable to recover it. 00:28:04.266 [2024-11-26 23:20:30.288509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.288597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.288622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.266 qpair failed and we were unable to recover it. 00:28:04.266 [2024-11-26 23:20:30.288702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.288796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.266 [2024-11-26 23:20:30.288821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.288899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.289144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.289334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.289552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.289780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.289918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.290000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.290189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.290425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.290627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.290836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.290946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.291026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.291104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.291130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.291266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.291350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.291376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.291460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.291571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.291598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.291704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.291800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.291829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.291940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.292165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.292358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.292570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.292762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.292870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.292957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.293146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.293372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.293558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.293762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.293878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.293964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.294041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.294068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.294149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.294226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.294252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.294364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.294447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.294474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.267 [2024-11-26 23:20:30.294572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.294661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.267 [2024-11-26 23:20:30.294687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.267 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.294766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.294878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.294903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.294981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.295199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.295376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.295609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.295810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.295948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.296037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.296147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.296171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.296251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.296364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.296390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.296500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.296605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.296633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.296716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.296834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.296860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.296967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.297043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.297070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.297192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.297300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.297327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.297483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.297585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.297613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.297699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.297777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.297802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.297894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.298111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.298324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.298572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.298788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.298911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.299024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.299265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.299470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.299663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.299894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.299975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.300114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.300329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.300517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.300778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.300911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.268 qpair failed and we were unable to recover it. 00:28:04.268 [2024-11-26 23:20:30.300986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.268 [2024-11-26 23:20:30.301079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.301218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.301427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.301625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.301856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.301988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.302069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.302149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.302175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.302285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.302367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.302392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.302471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.302597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.302627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.302736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.302828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.302852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.302993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.303201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.303392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.303588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.303781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.303904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.304022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.304250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.304440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.304688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.304908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.304985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.305099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.305309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.305547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.305748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.305857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.305978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.306165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.306364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.306554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.306757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.306913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.269 qpair failed and we were unable to recover it. 00:28:04.269 [2024-11-26 23:20:30.306989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.269 [2024-11-26 23:20:30.307067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.307244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.307466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.307685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.307876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.307986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.308113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.308202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.308229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.308310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.308393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.308421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.308508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.308626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.308652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.308736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.308883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.308910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.308998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.309187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.309391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.309595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.309785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.309895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.309975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.310216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.310463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.310702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.310907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.310988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.311099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.311355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.311594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.311830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.311944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.312052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.312235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.312471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.312658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.312877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.312989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.313016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.313111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.313187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.270 [2024-11-26 23:20:30.313214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.270 qpair failed and we were unable to recover it. 00:28:04.270 [2024-11-26 23:20:30.313325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.313413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.313440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.313557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.313636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.313663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.313743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.313854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.313880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.313964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.314187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.314382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.314609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.314800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.314920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.315036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.315225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.315457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.315669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.315862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.315962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.316041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.316219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.316412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.316612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.316805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.316949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.317063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.317138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.317165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.317247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.317362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.317388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.317501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.317627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.317653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.317756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.317867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.317893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.318009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.318088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.318114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.271 [2024-11-26 23:20:30.318208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.318286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.271 [2024-11-26 23:20:30.318313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.271 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.318390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.318471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.318500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.318592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.318678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.318704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.318825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.318911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.318937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.319020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.319196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.319222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.319329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.319417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.319444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.319522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.319644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.319671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.319754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.319835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.319871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.319961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.320186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.320406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.320643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.320865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.320974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.321080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 23:20:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:04.272 [2024-11-26 23:20:30.321156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.321184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.321320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.321397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 23:20:30 -- common/autotest_common.sh@862 -- # return 0 00:28:04.272 [2024-11-26 23:20:30.321424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.321575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.321660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 23:20:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:04.272 [2024-11-26 23:20:30.321687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.321770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 23:20:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:04.272 [2024-11-26 23:20:30.321894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.321920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 23:20:30 -- common/autotest_common.sh@10 -- # set +x 00:28:04.272 [2024-11-26 23:20:30.322028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.322247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.322464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.322653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.322878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.322989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.323106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.323219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.323245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.323354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.323457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.323483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.323578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.323665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.323691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.323778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.323892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.323919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.324030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.324142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.324168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.324253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.324333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.272 [2024-11-26 23:20:30.324359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.272 qpair failed and we were unable to recover it. 00:28:04.272 [2024-11-26 23:20:30.324442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.324558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.324595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.324670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.324764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.324791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.324882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.324965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.324992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.325111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.325196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.325233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.325315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.325420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.325446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.325556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.325650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.325676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.325752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.325841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.325867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.325946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.326160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf60000b90 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.326385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.326644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.326871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.326991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.327074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.327153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.327179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.327301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.327409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.327434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.327562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.327644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.327670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.327761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.327869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.327895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.328003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.328188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.328410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.328651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.328882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.328989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.329099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.329286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.329501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.329737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.329841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.329919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.330035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.330061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.330146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.330223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.330249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.330332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.330443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.330469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.273 qpair failed and we were unable to recover it. 00:28:04.273 [2024-11-26 23:20:30.330567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.330665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.273 [2024-11-26 23:20:30.330691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.330769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.330851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.330876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.330968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.331209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.331466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.331669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.331877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.331982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.332088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.332312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.332534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.332737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.332843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.332927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.333150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.333345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.333564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.333777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.333883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.333988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.334204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.334390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.334582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.334821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.334924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.335066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.335190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.335217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.335327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.335412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.335438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.335546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.335643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.335669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.335785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.335905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.335931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.336015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.336097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.336124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.336210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.336317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.336343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.336433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.336517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.336549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.336647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.336727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.336760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.274 qpair failed and we were unable to recover it. 00:28:04.274 [2024-11-26 23:20:30.336903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.274 [2024-11-26 23:20:30.337014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.337194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.337418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.337650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.337843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.337943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.338022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.338133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.338159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.338234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.338349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.338375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.338456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.338541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.338579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.338666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.338781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.338807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.338895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.339116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.339315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.339545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.339739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.339885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.339997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.340189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.340407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.340624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.340832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.340936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.341018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.341226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.341405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.341631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.341885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.341995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.342103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.342332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.342553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.342772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.342884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.275 qpair failed and we were unable to recover it. 00:28:04.275 [2024-11-26 23:20:30.342990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.343064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.275 [2024-11-26 23:20:30.343090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.343201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.343306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 23:20:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:04.276 [2024-11-26 23:20:30.343333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.343412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.343485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.343511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.276 23:20:30 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.343627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 23:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.276 [2024-11-26 23:20:30.343756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.343786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 23:20:30 -- common/autotest_common.sh@10 -- # set +x 00:28:04.276 [2024-11-26 23:20:30.343881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.343969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.343996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.344091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.344172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.344199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.344341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.344423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.344448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.344542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.344641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.344668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.344778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.344896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.344922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.345000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.345183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.345374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.345579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.345780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.345888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.346000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.346191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.346379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.346592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.346853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.346964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.347046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.347154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.347181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.347288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.347364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.347389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.347475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.347576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.347604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.347712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.347803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.347838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.347923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.348036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.348062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.348139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.348246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.276 [2024-11-26 23:20:30.348272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.276 qpair failed and we were unable to recover it. 00:28:04.276 [2024-11-26 23:20:30.348364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.348480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.348506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.348620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.348707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.348733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.348816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.348931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.348959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.349038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.349164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.349190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.349291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.349390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.349418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.349502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.349598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.349625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.349718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.349831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.349857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.349942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.350124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.350368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.350573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.350783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.350954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.351040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.351161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.351186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.351304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.351379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.351404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.351512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.351603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.351628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.351746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.351823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.351849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.351928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.352118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.352334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.352554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.352753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.352868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.352952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.353170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.353361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.353560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.353753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.353856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.353961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.354043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.354068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.354151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.354232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.277 [2024-11-26 23:20:30.354256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.277 qpair failed and we were unable to recover it. 00:28:04.277 [2024-11-26 23:20:30.354365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.354481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.354507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.354605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.354683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.354707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.354789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.354870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.354899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.355004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.355231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.355456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.355641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.355833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.355973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.356098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.356188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.356213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.356310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.356448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.356473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.356562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.356641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.356667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.356751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.356832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.356856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.356937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.357153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.357401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.357599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.357789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.357921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.358006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.358220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.358505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.358719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.358917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.358990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.359097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.359358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.359609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.359819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.359918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.360012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.360092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.360117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.360231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.360312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.360338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.278 qpair failed and we were unable to recover it. 00:28:04.278 [2024-11-26 23:20:30.360433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.278 [2024-11-26 23:20:30.360546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.360583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.360707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.360816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.360841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.360932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.361139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.361334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.361535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.361758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.361877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.361962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.362208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.362427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.362659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.362890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.362983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.363091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.363287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.363512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.363728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.363834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.363951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.364154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.364391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.364648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.364867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.364974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.365082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.365306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.365487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.365719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.365834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.365931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.366007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.366032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.366145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.366218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.366242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.366322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.366430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.366455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.366543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.366635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.279 [2024-11-26 23:20:30.366660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.279 qpair failed and we were unable to recover it. 00:28:04.279 [2024-11-26 23:20:30.366768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.366850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.366874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.366969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.367168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.367360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.367601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.367818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.367932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.368051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.368131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.368157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.368234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.368346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.368371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.368460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.368592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.368618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 Malloc0 00:28:04.280 [2024-11-26 23:20:30.368709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.368817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.368853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.368943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.369029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.369054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b9 23:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.280 0 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.369147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 23:20:30 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:28:04.280 [2024-11-26 23:20:30.369242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.369268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 23:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.280 [2024-11-26 23:20:30.369353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.369446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 23:20:30 -- common/autotest_common.sh@10 -- # set +x 00:28:04.280 [2024-11-26 23:20:30.369471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.369561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.369647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.369672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.369765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.369876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.369901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.370010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.370229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.370425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.370662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.370856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.370955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.371039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.371155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.371184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.371297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.371383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.371407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf54000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.371517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.371639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.371668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.371815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.371909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.371939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.280 qpair failed and we were unable to recover it. 00:28:04.280 [2024-11-26 23:20:30.372058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.280 [2024-11-26 23:20:30.372151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.372177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.372270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.372357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.372366] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:04.281 [2024-11-26 23:20:30.372385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.372502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.372632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.372659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.372747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.372858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.372883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.372970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.373055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.373081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.373198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.373334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.373361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.373446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.373537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.373565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.373694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.373779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.373810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.373893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.374142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.374332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.374537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.374745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.374871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.374966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.375047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.375074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.375197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.375308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.375335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.375448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.375591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.375619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.375702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.375806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.375833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.375948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.376208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.376416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.376631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.376859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.376977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.377061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.377186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.377212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.377299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.377411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.377437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.377531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.377625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.377652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.377743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.377832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.377859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.377974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.378062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.378088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.378173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.378255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.378282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.281 qpair failed and we were unable to recover it. 00:28:04.281 [2024-11-26 23:20:30.378400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.378480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.281 [2024-11-26 23:20:30.378506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.378635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.378750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.378787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.378931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.379129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.379328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.379545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.379748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.379857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.379972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.380085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.380111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.380191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.380294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.380321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.380418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.380502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.380534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 23:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.282 [2024-11-26 23:20:30.380647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 23:20:30 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:04.282 [2024-11-26 23:20:30.380760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.380796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 23:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.282 [2024-11-26 23:20:30.380907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.380999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 23:20:30 -- common/autotest_common.sh@10 -- # set +x 00:28:04.282 [2024-11-26 23:20:30.381026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.381115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.381203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.381234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.381318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.381457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.381485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.381602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.381686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.381712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.381804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.381885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.381912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.381992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.382185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.382412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.382644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.382862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.382997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.383074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.383155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.383182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.383274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.383396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.383427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.383547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.383639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.383666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.383748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.383833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.383859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.383969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.384047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.384073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.384157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.384242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.384269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.384349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.384455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.384481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.282 qpair failed and we were unable to recover it. 00:28:04.282 [2024-11-26 23:20:30.384593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.282 [2024-11-26 23:20:30.384717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.384746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.384845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.384934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.384960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.385045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.385131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.385158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.385245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.385323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.385349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.385457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.385585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.385613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.385736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.385845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.385871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.385952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.386168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.386352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.386540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.386737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.386925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.386999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.387106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.387301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.387488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.387765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.387884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.387970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.388047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.388073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.388165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.388239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.388264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.388352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.388441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.388468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.388553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 23:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.283 [2024-11-26 23:20:30.388649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.388675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 23:20:30 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:04.283 [2024-11-26 23:20:30.388786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.388875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 23:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.283 [2024-11-26 23:20:30.388901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.388983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 23:20:30 -- common/autotest_common.sh@10 -- # set +x 00:28:04.283 [2024-11-26 23:20:30.389064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.389177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.389389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.389597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.389814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.389932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.390071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.390153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.390179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.390266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.390344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.390370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.283 qpair failed and we were unable to recover it. 00:28:04.283 [2024-11-26 23:20:30.390485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.283 [2024-11-26 23:20:30.390568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.390595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.390677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.390764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.390790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.390872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.390978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.391112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.391307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7faf58000b90 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.391503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.391709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.391908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.391991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.392133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.392317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.392510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.392723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.392833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.392912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.393138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.393388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.393614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.393798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.393937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.394023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.394165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.394190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.394272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.394377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.394403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.394491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.394609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.394636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.394718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.394802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.394828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.394934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.395113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.395331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.395554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.395752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.395855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.395967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.396057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.396084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.396202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.396277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.396304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.396392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.396481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 [2024-11-26 23:20:30.396507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.284 qpair failed and we were unable to recover it. 00:28:04.284 [2024-11-26 23:20:30.396595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.284 23:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.285 [2024-11-26 23:20:30.396672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.396698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 23:20:30 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:04.285 [2024-11-26 23:20:30.396810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.396901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 23:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.285 [2024-11-26 23:20:30.396927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 23:20:30 -- common/autotest_common.sh@10 -- # set +x 00:28:04.285 [2024-11-26 23:20:30.397066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.397152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.397178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.397287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.397372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.397398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.397544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.397624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.397649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.397730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.397809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.397834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.397920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.398114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.398346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.398538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.398729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.398880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.398962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.399218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.399439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.399679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.399909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.399987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.400012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.400096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.400182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.400208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.400295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.400420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.285 [2024-11-26 23:20:30.400450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b4cb0 with addr=10.0.0.2, port=4420 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.400913] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:04.285 [2024-11-26 23:20:30.403091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.285 [2024-11-26 23:20:30.403222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.285 [2024-11-26 23:20:30.403259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.285 [2024-11-26 23:20:30.403275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.285 [2024-11-26 23:20:30.403288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.285 [2024-11-26 23:20:30.403329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 23:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.285 23:20:30 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:04.285 23:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.285 23:20:30 -- common/autotest_common.sh@10 -- # set +x 00:28:04.285 23:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.285 23:20:30 -- host/target_disconnect.sh@58 -- # wait 327691 00:28:04.285 [2024-11-26 23:20:30.412895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.285 [2024-11-26 23:20:30.413001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.285 [2024-11-26 23:20:30.413029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.285 [2024-11-26 23:20:30.413044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.285 [2024-11-26 23:20:30.413057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.285 [2024-11-26 23:20:30.413086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.285 qpair failed and we were unable to recover it. 00:28:04.285 [2024-11-26 23:20:30.422923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.285 [2024-11-26 23:20:30.423017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.423045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.423061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.423074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.423104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.432980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.433080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.433107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.433122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.433142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.433172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.442897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.442987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.443014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.443029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.443041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.443070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.452923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.453049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.453075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.453090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.453103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.453133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.463026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.463115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.463141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.463156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.463169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.463198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.473021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.473118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.473145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.473160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.473172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.473202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.483017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.483117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.483142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.483156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.483168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.483197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.493103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.493211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.493236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.493253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.493266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.493295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.503092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.503186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.503211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.503225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.503238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.503267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.513123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.513219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.513246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.513263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.513277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.513310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.523128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.523222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.523247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.523261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.523280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.523310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.533174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.533279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.533304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.533319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.533332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.533361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.543484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.543593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.543619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.543635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.543648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.543678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.286 qpair failed and we were unable to recover it. 00:28:04.286 [2024-11-26 23:20:30.553289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.286 [2024-11-26 23:20:30.553383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.286 [2024-11-26 23:20:30.553408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.286 [2024-11-26 23:20:30.553423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.286 [2024-11-26 23:20:30.553436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.286 [2024-11-26 23:20:30.553465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.287 [2024-11-26 23:20:30.563322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.287 [2024-11-26 23:20:30.563416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.287 [2024-11-26 23:20:30.563441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.287 [2024-11-26 23:20:30.563455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.287 [2024-11-26 23:20:30.563468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.287 [2024-11-26 23:20:30.563497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.287 [2024-11-26 23:20:30.573308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.287 [2024-11-26 23:20:30.573402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.287 [2024-11-26 23:20:30.573428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.287 [2024-11-26 23:20:30.573442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.287 [2024-11-26 23:20:30.573454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.287 [2024-11-26 23:20:30.573483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.287 [2024-11-26 23:20:30.583300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.287 [2024-11-26 23:20:30.583390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.287 [2024-11-26 23:20:30.583415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.287 [2024-11-26 23:20:30.583429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.287 [2024-11-26 23:20:30.583441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.287 [2024-11-26 23:20:30.583471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.287 [2024-11-26 23:20:30.593334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.287 [2024-11-26 23:20:30.593455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.287 [2024-11-26 23:20:30.593480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.287 [2024-11-26 23:20:30.593495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.287 [2024-11-26 23:20:30.593508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.287 [2024-11-26 23:20:30.593548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.287 [2024-11-26 23:20:30.603394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.287 [2024-11-26 23:20:30.603485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.287 [2024-11-26 23:20:30.603509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.287 [2024-11-26 23:20:30.603532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.287 [2024-11-26 23:20:30.603548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.287 [2024-11-26 23:20:30.603576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.287 [2024-11-26 23:20:30.613391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.287 [2024-11-26 23:20:30.613481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.287 [2024-11-26 23:20:30.613506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.287 [2024-11-26 23:20:30.613520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.287 [2024-11-26 23:20:30.613547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.287 [2024-11-26 23:20:30.613578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.287 [2024-11-26 23:20:30.623441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.287 [2024-11-26 23:20:30.623544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.287 [2024-11-26 23:20:30.623569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.287 [2024-11-26 23:20:30.623583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.287 [2024-11-26 23:20:30.623596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.287 [2024-11-26 23:20:30.623625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.287 [2024-11-26 23:20:30.633562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.287 [2024-11-26 23:20:30.633652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.287 [2024-11-26 23:20:30.633676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.287 [2024-11-26 23:20:30.633691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.287 [2024-11-26 23:20:30.633703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.287 [2024-11-26 23:20:30.633732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.287 qpair failed and we were unable to recover it. 00:28:04.547 [2024-11-26 23:20:30.643541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.547 [2024-11-26 23:20:30.643679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.547 [2024-11-26 23:20:30.643706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.547 [2024-11-26 23:20:30.643721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.547 [2024-11-26 23:20:30.643735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.547 [2024-11-26 23:20:30.643764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.547 qpair failed and we were unable to recover it. 00:28:04.547 [2024-11-26 23:20:30.653515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.547 [2024-11-26 23:20:30.653631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.547 [2024-11-26 23:20:30.653657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.547 [2024-11-26 23:20:30.653671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.547 [2024-11-26 23:20:30.653684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.547 [2024-11-26 23:20:30.653714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.547 qpair failed and we were unable to recover it. 00:28:04.547 [2024-11-26 23:20:30.663573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.547 [2024-11-26 23:20:30.663697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.547 [2024-11-26 23:20:30.663723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.547 [2024-11-26 23:20:30.663739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.547 [2024-11-26 23:20:30.663752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.547 [2024-11-26 23:20:30.663782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.547 qpair failed and we were unable to recover it. 00:28:04.547 [2024-11-26 23:20:30.673603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.547 [2024-11-26 23:20:30.673704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.547 [2024-11-26 23:20:30.673729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.547 [2024-11-26 23:20:30.673744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.547 [2024-11-26 23:20:30.673757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.547 [2024-11-26 23:20:30.673791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.547 qpair failed and we were unable to recover it. 00:28:04.547 [2024-11-26 23:20:30.683637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.547 [2024-11-26 23:20:30.683731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.547 [2024-11-26 23:20:30.683757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.683771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.683786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.683815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.693621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.693705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.693732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.693747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.693760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.693790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.703690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.703776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.703804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.703828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.703843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.703873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.713717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.713808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.713834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.713849] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.713862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.713892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.723746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.723837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.723863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.723878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.723890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.723920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.733752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.733835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.733861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.733876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.733891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.733919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.743818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.743900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.743926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.743940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.743954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.743983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.753819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.753923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.753949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.753964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.753976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.754006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.763838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.763923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.763949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.763964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.763977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.764006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.773886] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.774013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.774039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.774053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.774066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.774096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.783997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.784078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.784104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.784119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.784131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.784161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.793965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.794098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.794124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.794146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.794161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.794190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.804002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.804090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.804115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.804130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.804145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.804174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.548 qpair failed and we were unable to recover it. 00:28:04.548 [2024-11-26 23:20:30.813992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.548 [2024-11-26 23:20:30.814072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.548 [2024-11-26 23:20:30.814098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.548 [2024-11-26 23:20:30.814113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.548 [2024-11-26 23:20:30.814126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.548 [2024-11-26 23:20:30.814155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.824055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.824142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.824171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.824187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.824201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.824230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.834105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.834199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.834225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.834240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.834254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.834283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.844058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.844144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.844170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.844185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.844198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.844227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.854132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.854257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.854283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.854298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.854311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.854341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.864167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.864274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.864300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.864315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.864328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.864358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.874172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.874264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.874291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.874307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.874320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.874350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.884202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.884287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.884313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.884338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.884354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.884384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.894204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.894291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.894317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.894333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.894346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.894375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.904334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.904419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.904445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.904460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.904473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.904504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.914299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.914388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.914414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.914429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.914444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.914472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.924324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.924430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.924456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.924471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.924486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.924515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.549 [2024-11-26 23:20:30.934347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.549 [2024-11-26 23:20:30.934431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.549 [2024-11-26 23:20:30.934457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.549 [2024-11-26 23:20:30.934472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.549 [2024-11-26 23:20:30.934486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.549 [2024-11-26 23:20:30.934515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.549 qpair failed and we were unable to recover it. 00:28:04.809 [2024-11-26 23:20:30.944348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:30.944488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:30.944514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:30.944536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:30.944551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:30.944581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:30.954411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:30.954506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:30.954543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:30.954562] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:30.954577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:30.954607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:30.964435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:30.964518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:30.964550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:30.964566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:30.964579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:30.964609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:30.974489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:30.974586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:30.974612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:30.974635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:30.974649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:30.974679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:30.984471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:30.984557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:30.984583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:30.984598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:30.984612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:30.984642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:30.994565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:30.994658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:30.994685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:30.994700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:30.994712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:30.994743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:31.004544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:31.004632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:31.004659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:31.004674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:31.004687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:31.004717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:31.014630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:31.014728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:31.014754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:31.014768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:31.014781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:31.014812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:31.024588] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:31.024672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:31.024699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:31.024713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:31.024726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:31.024757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:31.034671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:31.034764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:31.034789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:31.034804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:31.034817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:31.034848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:31.044646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:31.044761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:31.044787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:31.044802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:31.044816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:31.044845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:31.054695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:31.054782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:31.054812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:31.054828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:31.054842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:31.054872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:31.064730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:31.064820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:31.064855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.810 [2024-11-26 23:20:31.064873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.810 [2024-11-26 23:20:31.064887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.810 [2024-11-26 23:20:31.064917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.810 qpair failed and we were unable to recover it. 00:28:04.810 [2024-11-26 23:20:31.074739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.810 [2024-11-26 23:20:31.074826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.810 [2024-11-26 23:20:31.074853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.074868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.074882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.074912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.084865] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.084954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.084983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.085001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.085014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.085044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.094878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.094971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.094998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.095013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.095026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.095057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.104846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.104960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.104987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.105002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.105015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.105045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.114878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.115005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.115032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.115047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.115059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.115089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.124909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.124996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.125023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.125038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.125053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.125082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.134926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.135036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.135062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.135078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.135091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.135136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.145066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.145200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.145225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.145241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.145254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.145284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.155060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.155156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.155187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.155203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.155215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.155245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.165002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.165088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.165114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.165129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.165143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.165171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.175060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.175141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.175167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.175182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.175194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.175225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.185061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.185148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.185174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.185189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.185203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.185232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:04.811 [2024-11-26 23:20:31.195140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.811 [2024-11-26 23:20:31.195267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.811 [2024-11-26 23:20:31.195293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.811 [2024-11-26 23:20:31.195308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.811 [2024-11-26 23:20:31.195321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:04.811 [2024-11-26 23:20:31.195356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:04.811 qpair failed and we were unable to recover it. 00:28:05.071 [2024-11-26 23:20:31.205110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.071 [2024-11-26 23:20:31.205195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.071 [2024-11-26 23:20:31.205221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.071 [2024-11-26 23:20:31.205236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.071 [2024-11-26 23:20:31.205249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.071 [2024-11-26 23:20:31.205279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.071 qpair failed and we were unable to recover it. 00:28:05.071 [2024-11-26 23:20:31.215149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.071 [2024-11-26 23:20:31.215235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.071 [2024-11-26 23:20:31.215261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.071 [2024-11-26 23:20:31.215276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.071 [2024-11-26 23:20:31.215288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.071 [2024-11-26 23:20:31.215318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.071 qpair failed and we were unable to recover it. 00:28:05.071 [2024-11-26 23:20:31.225189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.071 [2024-11-26 23:20:31.225281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.071 [2024-11-26 23:20:31.225307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.071 [2024-11-26 23:20:31.225322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.071 [2024-11-26 23:20:31.225335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.071 [2024-11-26 23:20:31.225365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.071 qpair failed and we were unable to recover it. 00:28:05.071 [2024-11-26 23:20:31.235353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.071 [2024-11-26 23:20:31.235482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.071 [2024-11-26 23:20:31.235508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.071 [2024-11-26 23:20:31.235523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.071 [2024-11-26 23:20:31.235544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.071 [2024-11-26 23:20:31.235573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.071 qpair failed and we were unable to recover it. 00:28:05.071 [2024-11-26 23:20:31.245352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.071 [2024-11-26 23:20:31.245439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.071 [2024-11-26 23:20:31.245470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.071 [2024-11-26 23:20:31.245486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.071 [2024-11-26 23:20:31.245498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.071 [2024-11-26 23:20:31.245538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.071 qpair failed and we were unable to recover it. 00:28:05.071 [2024-11-26 23:20:31.255276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.071 [2024-11-26 23:20:31.255358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.071 [2024-11-26 23:20:31.255383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.071 [2024-11-26 23:20:31.255398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.071 [2024-11-26 23:20:31.255411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.071 [2024-11-26 23:20:31.255441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.071 qpair failed and we were unable to recover it. 00:28:05.071 [2024-11-26 23:20:31.265294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.071 [2024-11-26 23:20:31.265374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.071 [2024-11-26 23:20:31.265400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.071 [2024-11-26 23:20:31.265415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.071 [2024-11-26 23:20:31.265430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.071 [2024-11-26 23:20:31.265459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.071 qpair failed and we were unable to recover it. 00:28:05.071 [2024-11-26 23:20:31.275345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.071 [2024-11-26 23:20:31.275434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.071 [2024-11-26 23:20:31.275461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.275476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.275489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.275519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.285394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.285482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.285508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.285530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.285545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.285581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.295384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.295519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.295552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.295568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.295581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.295612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.305460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.305563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.305590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.305605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.305617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.305646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.315473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.315572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.315602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.315618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.315632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.315662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.325496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.325610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.325636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.325652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.325666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.325695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.335543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.335630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.335661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.335677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.335692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.335721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.345621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.345713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.345739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.345754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.345767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.345796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.355574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.355679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.355704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.355719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.355733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.355762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.365700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.365818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.365844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.365860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.365874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.365903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.375634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.375772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.375796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.375813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.375825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.375859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.385688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.385779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.385818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.385833] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.385847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.385876] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.395714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.395824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.395850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.072 [2024-11-26 23:20:31.395865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.072 [2024-11-26 23:20:31.395879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.072 [2024-11-26 23:20:31.395909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.072 qpair failed and we were unable to recover it. 00:28:05.072 [2024-11-26 23:20:31.405708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.072 [2024-11-26 23:20:31.405842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.072 [2024-11-26 23:20:31.405868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.073 [2024-11-26 23:20:31.405883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.073 [2024-11-26 23:20:31.405896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.073 [2024-11-26 23:20:31.405925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.073 qpair failed and we were unable to recover it. 00:28:05.073 [2024-11-26 23:20:31.415757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.073 [2024-11-26 23:20:31.415840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.073 [2024-11-26 23:20:31.415867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.073 [2024-11-26 23:20:31.415887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.073 [2024-11-26 23:20:31.415901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.073 [2024-11-26 23:20:31.415932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.073 qpair failed and we were unable to recover it. 00:28:05.073 [2024-11-26 23:20:31.425771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.073 [2024-11-26 23:20:31.425856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.073 [2024-11-26 23:20:31.425887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.073 [2024-11-26 23:20:31.425903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.073 [2024-11-26 23:20:31.425917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.073 [2024-11-26 23:20:31.425945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.073 qpair failed and we were unable to recover it. 00:28:05.073 [2024-11-26 23:20:31.435795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.073 [2024-11-26 23:20:31.435890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.073 [2024-11-26 23:20:31.435915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.073 [2024-11-26 23:20:31.435929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.073 [2024-11-26 23:20:31.435942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.073 [2024-11-26 23:20:31.435972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.073 qpair failed and we were unable to recover it. 00:28:05.073 [2024-11-26 23:20:31.445840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.073 [2024-11-26 23:20:31.445931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.073 [2024-11-26 23:20:31.445957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.073 [2024-11-26 23:20:31.445972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.073 [2024-11-26 23:20:31.445987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.073 [2024-11-26 23:20:31.446016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.073 qpair failed and we were unable to recover it. 00:28:05.073 [2024-11-26 23:20:31.455856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.073 [2024-11-26 23:20:31.455954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.073 [2024-11-26 23:20:31.455980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.073 [2024-11-26 23:20:31.455995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.073 [2024-11-26 23:20:31.456009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.073 [2024-11-26 23:20:31.456038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.073 qpair failed and we were unable to recover it. 00:28:05.332 [2024-11-26 23:20:31.465873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.332 [2024-11-26 23:20:31.466000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.332 [2024-11-26 23:20:31.466026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.332 [2024-11-26 23:20:31.466041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.332 [2024-11-26 23:20:31.466055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.332 [2024-11-26 23:20:31.466090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.332 qpair failed and we were unable to recover it. 00:28:05.332 [2024-11-26 23:20:31.475937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.332 [2024-11-26 23:20:31.476030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.332 [2024-11-26 23:20:31.476055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.332 [2024-11-26 23:20:31.476071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.332 [2024-11-26 23:20:31.476085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.332 [2024-11-26 23:20:31.476113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.332 qpair failed and we were unable to recover it. 00:28:05.332 [2024-11-26 23:20:31.485987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.332 [2024-11-26 23:20:31.486083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.332 [2024-11-26 23:20:31.486108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.332 [2024-11-26 23:20:31.486123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.332 [2024-11-26 23:20:31.486137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.332 [2024-11-26 23:20:31.486166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.332 qpair failed and we were unable to recover it. 00:28:05.332 [2024-11-26 23:20:31.495990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.332 [2024-11-26 23:20:31.496091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.332 [2024-11-26 23:20:31.496122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.332 [2024-11-26 23:20:31.496137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.332 [2024-11-26 23:20:31.496151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.332 [2024-11-26 23:20:31.496179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.332 qpair failed and we were unable to recover it. 00:28:05.332 [2024-11-26 23:20:31.506070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.332 [2024-11-26 23:20:31.506166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.332 [2024-11-26 23:20:31.506190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.506206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.506219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.506249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.516082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.516205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.516236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.516251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.516265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.516304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.526118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.526232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.526258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.526272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.526286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.526316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.536126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.536209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.536235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.536250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.536263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.536291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.546121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.546247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.546272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.546287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.546300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.546328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.556179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.556301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.556325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.556340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.556362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.556392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.566202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.566289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.566314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.566329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.566342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.566370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.576207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.576290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.576319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.576334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.576347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.576375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.586225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.586310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.586337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.586352] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.586365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.586394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.596250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.596348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.596374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.596388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.596401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.596430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.606374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.606462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.606487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.606502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.606514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.606553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.616325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.616410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.616435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.616450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.616463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.616491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.626340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.626419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.626444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.626458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.626472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.333 [2024-11-26 23:20:31.626500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.333 qpair failed and we were unable to recover it. 00:28:05.333 [2024-11-26 23:20:31.636414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.333 [2024-11-26 23:20:31.636535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.333 [2024-11-26 23:20:31.636570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.333 [2024-11-26 23:20:31.636584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.333 [2024-11-26 23:20:31.636598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.636626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.334 [2024-11-26 23:20:31.646548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.334 [2024-11-26 23:20:31.646681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.334 [2024-11-26 23:20:31.646707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.334 [2024-11-26 23:20:31.646721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.334 [2024-11-26 23:20:31.646740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.646769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.334 [2024-11-26 23:20:31.656437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.334 [2024-11-26 23:20:31.656567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.334 [2024-11-26 23:20:31.656593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.334 [2024-11-26 23:20:31.656607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.334 [2024-11-26 23:20:31.656621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.656649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.334 [2024-11-26 23:20:31.666476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.334 [2024-11-26 23:20:31.666572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.334 [2024-11-26 23:20:31.666598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.334 [2024-11-26 23:20:31.666612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.334 [2024-11-26 23:20:31.666625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.666654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.334 [2024-11-26 23:20:31.676489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.334 [2024-11-26 23:20:31.676584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.334 [2024-11-26 23:20:31.676609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.334 [2024-11-26 23:20:31.676623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.334 [2024-11-26 23:20:31.676637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.676666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.334 [2024-11-26 23:20:31.686508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.334 [2024-11-26 23:20:31.686605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.334 [2024-11-26 23:20:31.686631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.334 [2024-11-26 23:20:31.686644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.334 [2024-11-26 23:20:31.686657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.686686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.334 [2024-11-26 23:20:31.696565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.334 [2024-11-26 23:20:31.696663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.334 [2024-11-26 23:20:31.696688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.334 [2024-11-26 23:20:31.696702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.334 [2024-11-26 23:20:31.696715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.696744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.334 [2024-11-26 23:20:31.706583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.334 [2024-11-26 23:20:31.706664] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.334 [2024-11-26 23:20:31.706689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.334 [2024-11-26 23:20:31.706703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.334 [2024-11-26 23:20:31.706716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.706744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.334 [2024-11-26 23:20:31.716749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.334 [2024-11-26 23:20:31.716846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.334 [2024-11-26 23:20:31.716874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.334 [2024-11-26 23:20:31.716889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.334 [2024-11-26 23:20:31.716902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.334 [2024-11-26 23:20:31.716930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.334 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.726673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.726807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.726836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.726851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.726864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.726892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.736705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.736790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.736816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.736830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.736849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.736878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.746710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.746806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.746831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.746845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.746858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.746887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.756769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.756857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.756883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.756897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.756910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.756938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.766842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.766933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.766958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.766972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.766985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.767013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.776886] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.776972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.776997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.777011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.777024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.777055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.786930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.787064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.787091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.787106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.787119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.787148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.796866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.796956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.796981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.796995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.797009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.797037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.806949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.807071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.807096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.807110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.807123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.807151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.816947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.817029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.817054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.817068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.817081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.817110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.826997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.827081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.827106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.827120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.827138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.827168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.836988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.837119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.594 [2024-11-26 23:20:31.837144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.594 [2024-11-26 23:20:31.837158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.594 [2024-11-26 23:20:31.837171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.594 [2024-11-26 23:20:31.837200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.594 qpair failed and we were unable to recover it. 00:28:05.594 [2024-11-26 23:20:31.847017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.594 [2024-11-26 23:20:31.847098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.847123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.847137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.847151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.847179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.857066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.857175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.857200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.857214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.857227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.857255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.867066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.867149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.867175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.867189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.867202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.867230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.877102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.877222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.877247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.877261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.877274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.877301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.887161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.887272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.887297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.887311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.887324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.887352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.897170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.897255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.897281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.897295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.897307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.897335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.907273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.907367] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.907391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.907405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.907418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.907445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.917241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.917326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.917351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.917372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.917386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.917416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.927245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.927330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.927355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.927369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.927382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.927411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.937281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.937404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.937429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.937443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.937455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.937483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.947321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.947401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.947426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.947440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.947453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.947483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.957368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.957490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.957519] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.957546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.957560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.957590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.967345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.967431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.967456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.967470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.595 [2024-11-26 23:20:31.967483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.595 [2024-11-26 23:20:31.967513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.595 qpair failed and we were unable to recover it. 00:28:05.595 [2024-11-26 23:20:31.977412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.595 [2024-11-26 23:20:31.977537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.595 [2024-11-26 23:20:31.977563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.595 [2024-11-26 23:20:31.977578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.596 [2024-11-26 23:20:31.977591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.596 [2024-11-26 23:20:31.977619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.596 qpair failed and we were unable to recover it. 00:28:05.855 [2024-11-26 23:20:31.987465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.855 [2024-11-26 23:20:31.987579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.855 [2024-11-26 23:20:31.987608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.855 [2024-11-26 23:20:31.987623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.855 [2024-11-26 23:20:31.987636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.855 [2024-11-26 23:20:31.987665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.855 qpair failed and we were unable to recover it. 00:28:05.855 [2024-11-26 23:20:31.997471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.855 [2024-11-26 23:20:31.997603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.855 [2024-11-26 23:20:31.997632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.855 [2024-11-26 23:20:31.997648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.855 [2024-11-26 23:20:31.997661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.855 [2024-11-26 23:20:31.997690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.855 qpair failed and we were unable to recover it. 00:28:05.855 [2024-11-26 23:20:32.007472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.855 [2024-11-26 23:20:32.007570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.855 [2024-11-26 23:20:32.007597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.855 [2024-11-26 23:20:32.007617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.855 [2024-11-26 23:20:32.007631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.855 [2024-11-26 23:20:32.007660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.855 qpair failed and we were unable to recover it. 00:28:05.855 [2024-11-26 23:20:32.017521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.855 [2024-11-26 23:20:32.017631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.855 [2024-11-26 23:20:32.017657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.855 [2024-11-26 23:20:32.017671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.855 [2024-11-26 23:20:32.017685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.855 [2024-11-26 23:20:32.017713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.855 qpair failed and we were unable to recover it. 00:28:05.855 [2024-11-26 23:20:32.027568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.855 [2024-11-26 23:20:32.027651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.855 [2024-11-26 23:20:32.027677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.855 [2024-11-26 23:20:32.027692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.855 [2024-11-26 23:20:32.027708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.855 [2024-11-26 23:20:32.027736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.855 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.037587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.037681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.037706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.037720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.037734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.037762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.047607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.047691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.047715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.047729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.047742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.047770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.057645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.057727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.057753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.057767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.057780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.057808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.067674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.067756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.067781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.067795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.067808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.067838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.077686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.077774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.077800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.077814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.077827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.077855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.087699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.087785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.087810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.087825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.087838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.087867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.097833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.097928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.097953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.097974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.097988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.098018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.107780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.107865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.107890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.107904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.107917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.107946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.117779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.117875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.117901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.117915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.117928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.117956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.127855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.127972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.128002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.128018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.128031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.128060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.137894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.138020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.138046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.138061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.138073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.138103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.147874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.147960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.147985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.148000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.148013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.148043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.157935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.158026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.856 [2024-11-26 23:20:32.158051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.856 [2024-11-26 23:20:32.158065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.856 [2024-11-26 23:20:32.158078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.856 [2024-11-26 23:20:32.158106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.856 qpair failed and we were unable to recover it. 00:28:05.856 [2024-11-26 23:20:32.167929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.856 [2024-11-26 23:20:32.168006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.857 [2024-11-26 23:20:32.168031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.857 [2024-11-26 23:20:32.168046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.857 [2024-11-26 23:20:32.168059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.857 [2024-11-26 23:20:32.168087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.857 qpair failed and we were unable to recover it. 00:28:05.857 [2024-11-26 23:20:32.177995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.857 [2024-11-26 23:20:32.178079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.857 [2024-11-26 23:20:32.178105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.857 [2024-11-26 23:20:32.178119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.857 [2024-11-26 23:20:32.178132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.857 [2024-11-26 23:20:32.178159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.857 qpair failed and we were unable to recover it. 00:28:05.857 [2024-11-26 23:20:32.188064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.857 [2024-11-26 23:20:32.188165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.857 [2024-11-26 23:20:32.188190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.857 [2024-11-26 23:20:32.188211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.857 [2024-11-26 23:20:32.188226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.857 [2024-11-26 23:20:32.188254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.857 qpair failed and we were unable to recover it. 00:28:05.857 [2024-11-26 23:20:32.198051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.857 [2024-11-26 23:20:32.198171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.857 [2024-11-26 23:20:32.198196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.857 [2024-11-26 23:20:32.198210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.857 [2024-11-26 23:20:32.198223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.857 [2024-11-26 23:20:32.198250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.857 qpair failed and we were unable to recover it. 00:28:05.857 [2024-11-26 23:20:32.208128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.857 [2024-11-26 23:20:32.208221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.857 [2024-11-26 23:20:32.208246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.857 [2024-11-26 23:20:32.208260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.857 [2024-11-26 23:20:32.208273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.857 [2024-11-26 23:20:32.208301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.857 qpair failed and we were unable to recover it. 00:28:05.857 [2024-11-26 23:20:32.218103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.857 [2024-11-26 23:20:32.218191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.857 [2024-11-26 23:20:32.218219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.857 [2024-11-26 23:20:32.218234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.857 [2024-11-26 23:20:32.218247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.857 [2024-11-26 23:20:32.218276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.857 qpair failed and we were unable to recover it. 00:28:05.857 [2024-11-26 23:20:32.228109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.857 [2024-11-26 23:20:32.228197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.857 [2024-11-26 23:20:32.228222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.857 [2024-11-26 23:20:32.228236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.857 [2024-11-26 23:20:32.228249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.857 [2024-11-26 23:20:32.228278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.857 qpair failed and we were unable to recover it. 00:28:05.857 [2024-11-26 23:20:32.238179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.857 [2024-11-26 23:20:32.238268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.857 [2024-11-26 23:20:32.238293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.857 [2024-11-26 23:20:32.238308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.857 [2024-11-26 23:20:32.238320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:05.857 [2024-11-26 23:20:32.238348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:05.857 qpair failed and we were unable to recover it. 00:28:06.116 [2024-11-26 23:20:32.248173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.248264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.248289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.248303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.248316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.248344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.258213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.258315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.258340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.258354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.258367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.258397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.268314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.268409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.268434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.268448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.268461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.268489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.278301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.278421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.278451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.278466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.278479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.278508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.288316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.288400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.288426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.288440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.288453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.288481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.298347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.298444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.298469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.298484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.298497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.298533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.308358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.308441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.308466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.308480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.308492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.308520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.318438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.318538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.318563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.318577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.318590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.318619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.328448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.328554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.328582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.328597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.328610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.328640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.338445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.338531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.338556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.338571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.338584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.338612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.348462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.348591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.348616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.348631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.348644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.348674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.358522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.358632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.358660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.358676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.358690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.358719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.368518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.117 [2024-11-26 23:20:32.368609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.117 [2024-11-26 23:20:32.368642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.117 [2024-11-26 23:20:32.368657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.117 [2024-11-26 23:20:32.368670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.117 [2024-11-26 23:20:32.368699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.117 qpair failed and we were unable to recover it. 00:28:06.117 [2024-11-26 23:20:32.378586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.378684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.378709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.378722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.378734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.378762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.388579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.388692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.388717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.388731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.388744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.388772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.398638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.398726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.398751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.398765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.398778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.398806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.408649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.408729] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.408754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.408768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.408781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.408816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.418681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.418761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.418787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.418801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.418813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.418841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.428709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.428792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.428817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.428831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.428843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.428872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.438733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.438828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.438853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.438867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.438880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.438908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.448830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.448912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.448937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.448951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.448964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.448992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.458817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.458902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.458933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.458948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.458961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.458988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.468828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.468904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.468929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.468943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.468957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.468985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.478874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.478961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.478986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.479000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.479013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.479042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.488912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.489040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.489065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.489079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.489092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.489121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.118 [2024-11-26 23:20:32.498933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.118 [2024-11-26 23:20:32.499017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.118 [2024-11-26 23:20:32.499042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.118 [2024-11-26 23:20:32.499056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.118 [2024-11-26 23:20:32.499069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.118 [2024-11-26 23:20:32.499103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.118 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.509045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.509130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.509155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.509169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.509182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.509211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.518991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.519079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.519105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.519119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.519132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.519161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.529108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.529194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.529220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.529234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.529247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.529275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.539045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.539162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.539187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.539202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.539214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.539244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.549042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.549124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.549155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.549170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.549183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.549211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.559201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.559312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.559338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.559353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.559365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.559394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.569227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.569320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.569346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.569361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.569374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.569403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.579202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.579300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.579326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.579340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.579353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.579381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.589354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.589486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.589515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.589540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.589555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.589592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.599230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.599361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.599386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.599401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.599414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.599441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.609272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.609362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.609388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.377 [2024-11-26 23:20:32.609403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.377 [2024-11-26 23:20:32.609416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.377 [2024-11-26 23:20:32.609445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.377 qpair failed and we were unable to recover it. 00:28:06.377 [2024-11-26 23:20:32.619365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.377 [2024-11-26 23:20:32.619464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.377 [2024-11-26 23:20:32.619490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.619504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.619517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.619555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.629311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.629409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.629435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.629448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.629461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.629489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.639359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.639449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.639479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.639493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.639506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.639543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.649390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.649476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.649501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.649516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.649538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.649568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.659405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.659540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.659566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.659580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.659593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.659621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.669462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.669555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.669581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.669595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.669608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.669637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.679468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.679560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.679585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.679599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.679612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.679647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.689490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.689619] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.689645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.689659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.689672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.689701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.699534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.699618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.699643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.699657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.699670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.699699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.709592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.709678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.709704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.709718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.709730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.709759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.719597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.719712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.719737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.719751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.719764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.719792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.729626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.729712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.729743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.729759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.729773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.729801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.739671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.739802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.739827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.739841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.739854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.739882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.378 [2024-11-26 23:20:32.749686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.378 [2024-11-26 23:20:32.749759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.378 [2024-11-26 23:20:32.749784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.378 [2024-11-26 23:20:32.749797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.378 [2024-11-26 23:20:32.749810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.378 [2024-11-26 23:20:32.749839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.378 qpair failed and we were unable to recover it. 00:28:06.379 [2024-11-26 23:20:32.759704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.379 [2024-11-26 23:20:32.759794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.379 [2024-11-26 23:20:32.759819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.379 [2024-11-26 23:20:32.759833] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.379 [2024-11-26 23:20:32.759846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.379 [2024-11-26 23:20:32.759874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.379 qpair failed and we were unable to recover it. 00:28:06.636 [2024-11-26 23:20:32.769716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.636 [2024-11-26 23:20:32.769828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.636 [2024-11-26 23:20:32.769853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.636 [2024-11-26 23:20:32.769868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.636 [2024-11-26 23:20:32.769886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.636 [2024-11-26 23:20:32.769916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.636 qpair failed and we were unable to recover it. 00:28:06.636 [2024-11-26 23:20:32.779763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.636 [2024-11-26 23:20:32.779846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.636 [2024-11-26 23:20:32.779870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.636 [2024-11-26 23:20:32.779885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.636 [2024-11-26 23:20:32.779898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.636 [2024-11-26 23:20:32.779926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.636 qpair failed and we were unable to recover it. 00:28:06.636 [2024-11-26 23:20:32.789800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.636 [2024-11-26 23:20:32.789920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.789945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.789959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.789972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.790000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.799900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.799990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.800015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.800029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.800042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.800070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.809899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.809988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.810012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.810027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.810039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.810067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.819867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.819991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.820020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.820035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.820048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.820076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.829878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.829985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.830010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.830025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.830038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.830066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.839989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.840085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.840111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.840124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.840137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.840166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.850059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.850190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.850214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.850229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.850242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.850270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.860014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.860106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.860131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.860145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.860163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.860192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.870011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.870093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.870118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.870133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.870146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.870174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.880168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.880303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.880329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.880343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.880356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.880384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.890057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.890145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.890171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.890185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.890198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.890226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.900104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.900188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.900213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.900228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.900240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.900268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.910163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.910253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.910278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.910291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.637 [2024-11-26 23:20:32.910304] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.637 [2024-11-26 23:20:32.910333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.637 qpair failed and we were unable to recover it. 00:28:06.637 [2024-11-26 23:20:32.920191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.637 [2024-11-26 23:20:32.920275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.637 [2024-11-26 23:20:32.920300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.637 [2024-11-26 23:20:32.920314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:32.920327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:32.920356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:32.930198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:32.930313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:32.930338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:32.930353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:32.930365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:32.930393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:32.940268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:32.940353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:32.940378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:32.940393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:32.940406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:32.940433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:32.950302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:32.950399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:32.950424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:32.950439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:32.950457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:32.950487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:32.960290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:32.960383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:32.960408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:32.960422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:32.960435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:32.960463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:32.970357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:32.970452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:32.970478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:32.970491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:32.970504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:32.970540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:32.980334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:32.980423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:32.980448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:32.980462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:32.980475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:32.980503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:32.990405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:32.990535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:32.990561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:32.990575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:32.990588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:32.990616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:33.000403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:33.000491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:33.000516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:33.000539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:33.000553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:33.000581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:33.010488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:33.010634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:33.010662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:33.010677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:33.010690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:33.010718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.638 [2024-11-26 23:20:33.020441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.638 [2024-11-26 23:20:33.020532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.638 [2024-11-26 23:20:33.020557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.638 [2024-11-26 23:20:33.020571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.638 [2024-11-26 23:20:33.020584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.638 [2024-11-26 23:20:33.020612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.638 qpair failed and we were unable to recover it. 00:28:06.897 [2024-11-26 23:20:33.030474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.897 [2024-11-26 23:20:33.030613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.897 [2024-11-26 23:20:33.030639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.897 [2024-11-26 23:20:33.030653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.897 [2024-11-26 23:20:33.030666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.897 [2024-11-26 23:20:33.030694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.897 qpair failed and we were unable to recover it. 00:28:06.897 [2024-11-26 23:20:33.040569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.897 [2024-11-26 23:20:33.040661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.897 [2024-11-26 23:20:33.040686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.897 [2024-11-26 23:20:33.040701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.897 [2024-11-26 23:20:33.040719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.897 [2024-11-26 23:20:33.040748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.897 qpair failed and we were unable to recover it. 00:28:06.897 [2024-11-26 23:20:33.050651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.897 [2024-11-26 23:20:33.050777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.897 [2024-11-26 23:20:33.050801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.897 [2024-11-26 23:20:33.050816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.897 [2024-11-26 23:20:33.050829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.897 [2024-11-26 23:20:33.050857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.897 qpair failed and we were unable to recover it. 00:28:06.897 [2024-11-26 23:20:33.060561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.897 [2024-11-26 23:20:33.060644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.897 [2024-11-26 23:20:33.060668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.897 [2024-11-26 23:20:33.060682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.897 [2024-11-26 23:20:33.060695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.897 [2024-11-26 23:20:33.060723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.897 qpair failed and we were unable to recover it. 00:28:06.897 [2024-11-26 23:20:33.070598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.897 [2024-11-26 23:20:33.070679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.897 [2024-11-26 23:20:33.070704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.897 [2024-11-26 23:20:33.070718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.897 [2024-11-26 23:20:33.070730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.897 [2024-11-26 23:20:33.070759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.897 qpair failed and we were unable to recover it. 00:28:06.897 [2024-11-26 23:20:33.080635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.897 [2024-11-26 23:20:33.080727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.897 [2024-11-26 23:20:33.080752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.897 [2024-11-26 23:20:33.080766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.897 [2024-11-26 23:20:33.080779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.897 [2024-11-26 23:20:33.080806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.897 qpair failed and we were unable to recover it. 00:28:06.897 [2024-11-26 23:20:33.090728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.897 [2024-11-26 23:20:33.090808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.897 [2024-11-26 23:20:33.090833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.897 [2024-11-26 23:20:33.090847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.897 [2024-11-26 23:20:33.090860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.897 [2024-11-26 23:20:33.090887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.897 qpair failed and we were unable to recover it. 00:28:06.897 [2024-11-26 23:20:33.100699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.897 [2024-11-26 23:20:33.100782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.897 [2024-11-26 23:20:33.100806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.897 [2024-11-26 23:20:33.100820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.897 [2024-11-26 23:20:33.100833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.100862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.110697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.110781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.110808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.110822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.110835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.110864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.120750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.120837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.120862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.120876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.120889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.120918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.130817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.130922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.130947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.130967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.130982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.131010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.140812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.140936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.140962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.140977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.140989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.141017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.150807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.150941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.150966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.150980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.150993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.151021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.160940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.161033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.161057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.161072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.161086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.161114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.170909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.170989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.171014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.171028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.171041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.171070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.180913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.181001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.181026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.181040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.181053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.181081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.190930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.191063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.191089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.191103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.191116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.191144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.200962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.201052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.201077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.201092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.201104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.201132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.211084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.211172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.211197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.211211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.211224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.211253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.221045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.221146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.221171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.221192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.221205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.221233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.231066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.898 [2024-11-26 23:20:33.231148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.898 [2024-11-26 23:20:33.231173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.898 [2024-11-26 23:20:33.231187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.898 [2024-11-26 23:20:33.231200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.898 [2024-11-26 23:20:33.231228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.898 qpair failed and we were unable to recover it. 00:28:06.898 [2024-11-26 23:20:33.241118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.899 [2024-11-26 23:20:33.241226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.899 [2024-11-26 23:20:33.241250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.899 [2024-11-26 23:20:33.241265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.899 [2024-11-26 23:20:33.241277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.899 [2024-11-26 23:20:33.241305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.899 qpair failed and we were unable to recover it. 00:28:06.899 [2024-11-26 23:20:33.251136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.899 [2024-11-26 23:20:33.251230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.899 [2024-11-26 23:20:33.251259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.899 [2024-11-26 23:20:33.251274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.899 [2024-11-26 23:20:33.251287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.899 [2024-11-26 23:20:33.251315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.899 qpair failed and we were unable to recover it. 00:28:06.899 [2024-11-26 23:20:33.261185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.899 [2024-11-26 23:20:33.261269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.899 [2024-11-26 23:20:33.261294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.899 [2024-11-26 23:20:33.261309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.899 [2024-11-26 23:20:33.261322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.899 [2024-11-26 23:20:33.261350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.899 qpair failed and we were unable to recover it. 00:28:06.899 [2024-11-26 23:20:33.271203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.899 [2024-11-26 23:20:33.271326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.899 [2024-11-26 23:20:33.271351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.899 [2024-11-26 23:20:33.271365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.899 [2024-11-26 23:20:33.271379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.899 [2024-11-26 23:20:33.271407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.899 qpair failed and we were unable to recover it. 00:28:06.899 [2024-11-26 23:20:33.281232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.899 [2024-11-26 23:20:33.281320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.899 [2024-11-26 23:20:33.281345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.899 [2024-11-26 23:20:33.281360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.899 [2024-11-26 23:20:33.281373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:06.899 [2024-11-26 23:20:33.281402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:06.899 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.291232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.291311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.291336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.291350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.291362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.291392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.301307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.301391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.301417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.301431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.301444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.301472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.311307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.311410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.311435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.311455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.311467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.311495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.321341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.321428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.321453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.321467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.321480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.321508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.331364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.331452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.331476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.331491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.331503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.331538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.341389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.341487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.341513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.341535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.341550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.341579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.351404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.351487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.351512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.351536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.351552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.351581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.361434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.361517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.361553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.361567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.361580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.361608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.371488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.371579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.371605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.371619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.158 [2024-11-26 23:20:33.371631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.158 [2024-11-26 23:20:33.371660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.158 qpair failed and we were unable to recover it. 00:28:07.158 [2024-11-26 23:20:33.381573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.158 [2024-11-26 23:20:33.381661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.158 [2024-11-26 23:20:33.381685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.158 [2024-11-26 23:20:33.381698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.381710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.381738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.391544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.391627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.391652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.391666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.391679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.391708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.401660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.401745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.401771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.401791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.401805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.401834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.411609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.411689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.411714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.411728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.411740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.411768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.421640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.421722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.421747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.421762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.421775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.421802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.431684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.431767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.431792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.431806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.431818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.431846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.441686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.441820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.441845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.441859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.441873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.441903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.451725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.451809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.451835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.451849] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.451861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.451889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.461882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.461968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.461996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.462014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.462028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.462056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.471768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.471851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.471876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.471890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.471903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.471932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.481790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.481879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.481907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.481923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.481936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.481964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.491832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.491913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.491943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.491959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.491972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.492000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.501949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.502077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.502103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.502117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.502130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.502158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.511887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.159 [2024-11-26 23:20:33.511975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.159 [2024-11-26 23:20:33.512000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.159 [2024-11-26 23:20:33.512014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.159 [2024-11-26 23:20:33.512027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.159 [2024-11-26 23:20:33.512055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.159 qpair failed and we were unable to recover it. 00:28:07.159 [2024-11-26 23:20:33.521905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.160 [2024-11-26 23:20:33.521990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.160 [2024-11-26 23:20:33.522016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.160 [2024-11-26 23:20:33.522030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.160 [2024-11-26 23:20:33.522043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.160 [2024-11-26 23:20:33.522071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.160 qpair failed and we were unable to recover it. 00:28:07.160 [2024-11-26 23:20:33.531970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.160 [2024-11-26 23:20:33.532097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.160 [2024-11-26 23:20:33.532122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.160 [2024-11-26 23:20:33.532136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.160 [2024-11-26 23:20:33.532149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.160 [2024-11-26 23:20:33.532177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.160 qpair failed and we were unable to recover it. 00:28:07.160 [2024-11-26 23:20:33.542000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.160 [2024-11-26 23:20:33.542086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.160 [2024-11-26 23:20:33.542112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.160 [2024-11-26 23:20:33.542125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.160 [2024-11-26 23:20:33.542138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.160 [2024-11-26 23:20:33.542166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.160 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.552016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.552092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.552117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.552131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.552143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.552172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.562052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.562146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.562171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.562185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.562197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.562225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.572072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.572156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.572181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.572195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.572208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.572236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.582118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.582204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.582234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.582249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.582262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.582290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.592143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.592237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.592262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.592277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.592290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.592318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.602159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.602247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.602271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.602286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.602299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.602328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.612204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.612302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.612327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.612341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.612354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.612383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.622231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.622317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.622342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.622356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.622370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.622405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.632236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.632329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.632355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.632369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.632382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.632409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.642291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.642376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.642401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.642416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.642430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.642457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.652301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.652387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.652413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.652426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.652439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.652468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.662338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.662470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.662495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.662510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.662522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.662561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.672385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.672469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.672499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.672515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.672536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.672566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.682396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.419 [2024-11-26 23:20:33.682480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.419 [2024-11-26 23:20:33.682505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.419 [2024-11-26 23:20:33.682519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.419 [2024-11-26 23:20:33.682541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.419 [2024-11-26 23:20:33.682572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.419 qpair failed and we were unable to recover it. 00:28:07.419 [2024-11-26 23:20:33.692465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.692555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.692581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.692595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.692607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.692637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.702447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.702577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.702603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.702617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.702630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.702658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.712493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.712631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.712661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.712677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.712690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.712726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.722566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.722656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.722681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.722695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.722709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.722737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.732540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.732626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.732651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.732665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.732678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.732706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.742572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.742658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.742685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.742699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.742713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.742744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.752636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.752763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.752788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.752803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.752815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.752843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.762721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.762817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.762849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.762864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.762877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.762905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.772687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.772777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.772815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.772830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.772843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.772871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.782688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.782775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.782801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.782816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.782828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.782857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.792731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.792827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.792852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.792866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.792879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.792907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.420 [2024-11-26 23:20:33.802795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.420 [2024-11-26 23:20:33.802888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.420 [2024-11-26 23:20:33.802913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.420 [2024-11-26 23:20:33.802928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.420 [2024-11-26 23:20:33.802942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.420 [2024-11-26 23:20:33.802977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.420 qpair failed and we were unable to recover it. 00:28:07.679 [2024-11-26 23:20:33.812823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.679 [2024-11-26 23:20:33.812916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.679 [2024-11-26 23:20:33.812941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.679 [2024-11-26 23:20:33.812955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.679 [2024-11-26 23:20:33.812968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.679 [2024-11-26 23:20:33.812996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.679 qpair failed and we were unable to recover it. 00:28:07.679 [2024-11-26 23:20:33.822851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.679 [2024-11-26 23:20:33.822973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.679 [2024-11-26 23:20:33.822999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.679 [2024-11-26 23:20:33.823013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.679 [2024-11-26 23:20:33.823026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.679 [2024-11-26 23:20:33.823056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.679 qpair failed and we were unable to recover it. 00:28:07.679 [2024-11-26 23:20:33.832870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.679 [2024-11-26 23:20:33.832988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.679 [2024-11-26 23:20:33.833013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.679 [2024-11-26 23:20:33.833027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.679 [2024-11-26 23:20:33.833041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.679 [2024-11-26 23:20:33.833069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.679 qpair failed and we were unable to recover it. 00:28:07.679 [2024-11-26 23:20:33.842896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.679 [2024-11-26 23:20:33.842982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.679 [2024-11-26 23:20:33.843007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.679 [2024-11-26 23:20:33.843021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.679 [2024-11-26 23:20:33.843034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.843064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.852928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.853019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.853052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.853067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.853080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.853109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.862953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.863038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.863064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.863079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.863091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.863119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.872998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.873085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.873110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.873124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.873137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.873165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.882977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.883065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.883089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.883104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.883116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.883144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.893062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.893195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.893220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.893234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.893247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.893281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.903043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.903126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.903151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.903165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.903178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.903206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.913094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.913173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.913198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.913212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.913225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.913254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.923111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.923194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.923219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.923234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.923246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.923274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.933151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.933241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.933266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.933281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.933294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.933322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.943144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.943247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.943277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.943293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.943306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.943334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.953197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.953278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.953303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.953318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.953331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.953358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.963244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.963366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.963391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.963405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.963417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.963445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.973238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.680 [2024-11-26 23:20:33.973323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.680 [2024-11-26 23:20:33.973348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.680 [2024-11-26 23:20:33.973362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.680 [2024-11-26 23:20:33.973375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.680 [2024-11-26 23:20:33.973403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.680 qpair failed and we were unable to recover it. 00:28:07.680 [2024-11-26 23:20:33.983362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:33.983457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:33.983482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:33.983496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:33.983515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:33.983553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.681 [2024-11-26 23:20:33.993292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:33.993374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:33.993399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:33.993414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:33.993427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:33.993454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.681 [2024-11-26 23:20:34.003331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:34.003417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:34.003442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:34.003456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:34.003469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:34.003497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.681 [2024-11-26 23:20:34.013389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:34.013515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:34.013551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:34.013568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:34.013581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:34.013611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.681 [2024-11-26 23:20:34.023403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:34.023485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:34.023513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:34.023539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:34.023554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:34.023584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.681 [2024-11-26 23:20:34.033407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:34.033499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:34.033531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:34.033548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:34.033561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:34.033590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.681 [2024-11-26 23:20:34.043493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:34.043592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:34.043620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:34.043635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:34.043647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:34.043676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.681 [2024-11-26 23:20:34.053472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:34.053566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:34.053592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:34.053606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:34.053619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:34.053647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.681 [2024-11-26 23:20:34.063493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.681 [2024-11-26 23:20:34.063587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.681 [2024-11-26 23:20:34.063612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.681 [2024-11-26 23:20:34.063627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.681 [2024-11-26 23:20:34.063639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.681 [2024-11-26 23:20:34.063668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.681 qpair failed and we were unable to recover it. 00:28:07.940 [2024-11-26 23:20:34.073558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.940 [2024-11-26 23:20:34.073647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.940 [2024-11-26 23:20:34.073673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.940 [2024-11-26 23:20:34.073687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.940 [2024-11-26 23:20:34.073705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.940 [2024-11-26 23:20:34.073734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.940 qpair failed and we were unable to recover it. 00:28:07.940 [2024-11-26 23:20:34.083590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.940 [2024-11-26 23:20:34.083711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.940 [2024-11-26 23:20:34.083736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.940 [2024-11-26 23:20:34.083751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.940 [2024-11-26 23:20:34.083764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.940 [2024-11-26 23:20:34.083794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.940 qpair failed and we were unable to recover it. 00:28:07.940 [2024-11-26 23:20:34.093615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.940 [2024-11-26 23:20:34.093740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.940 [2024-11-26 23:20:34.093764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.940 [2024-11-26 23:20:34.093778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.940 [2024-11-26 23:20:34.093790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.940 [2024-11-26 23:20:34.093819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.940 qpair failed and we were unable to recover it. 00:28:07.940 [2024-11-26 23:20:34.103622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.940 [2024-11-26 23:20:34.103735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.940 [2024-11-26 23:20:34.103760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.940 [2024-11-26 23:20:34.103774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.940 [2024-11-26 23:20:34.103787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.940 [2024-11-26 23:20:34.103814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.940 qpair failed and we were unable to recover it. 00:28:07.940 [2024-11-26 23:20:34.113741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.940 [2024-11-26 23:20:34.113829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.940 [2024-11-26 23:20:34.113855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.940 [2024-11-26 23:20:34.113868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.940 [2024-11-26 23:20:34.113882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.940 [2024-11-26 23:20:34.113909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.940 qpair failed and we were unable to recover it. 00:28:07.940 [2024-11-26 23:20:34.123792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.940 [2024-11-26 23:20:34.123885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.940 [2024-11-26 23:20:34.123911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.940 [2024-11-26 23:20:34.123925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.940 [2024-11-26 23:20:34.123939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.123966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.133711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.133803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.133829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.133843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.133855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.133884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.143748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.143834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.143860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.143874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.143887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.143915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.153774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.153859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.153884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.153898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.153911] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.153939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.163808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.163897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.163924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.163940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.163958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.163988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.173835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.173921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.173946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.173960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.173973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.174001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.183934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.184017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.184042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.184057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.184069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.184097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.193901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.193984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.194009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.194024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.194036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.194064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.203946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.204038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.204067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.204083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.204096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.204125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.213969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.214063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.214089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.214103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.214116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.214144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.223980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.224063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.224088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.224103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.224116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.224144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.234070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.234175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.234200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.234214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.234227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.234255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.244032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.244119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.244145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.244159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.244171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.244200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.254072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.254181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.941 [2024-11-26 23:20:34.254207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.941 [2024-11-26 23:20:34.254221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.941 [2024-11-26 23:20:34.254240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.941 [2024-11-26 23:20:34.254269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.941 qpair failed and we were unable to recover it. 00:28:07.941 [2024-11-26 23:20:34.264115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.941 [2024-11-26 23:20:34.264204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.942 [2024-11-26 23:20:34.264233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.942 [2024-11-26 23:20:34.264252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.942 [2024-11-26 23:20:34.264266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.942 [2024-11-26 23:20:34.264295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.942 qpair failed and we were unable to recover it. 00:28:07.942 [2024-11-26 23:20:34.274221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.942 [2024-11-26 23:20:34.274306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.942 [2024-11-26 23:20:34.274331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.942 [2024-11-26 23:20:34.274345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.942 [2024-11-26 23:20:34.274358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.942 [2024-11-26 23:20:34.274386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.942 qpair failed and we were unable to recover it. 00:28:07.942 [2024-11-26 23:20:34.284181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.942 [2024-11-26 23:20:34.284303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.942 [2024-11-26 23:20:34.284328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.942 [2024-11-26 23:20:34.284342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.942 [2024-11-26 23:20:34.284354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.942 [2024-11-26 23:20:34.284383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.942 qpair failed and we were unable to recover it. 00:28:07.942 [2024-11-26 23:20:34.294184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.942 [2024-11-26 23:20:34.294298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.942 [2024-11-26 23:20:34.294324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.942 [2024-11-26 23:20:34.294338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.942 [2024-11-26 23:20:34.294352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.942 [2024-11-26 23:20:34.294382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.942 qpair failed and we were unable to recover it. 00:28:07.942 [2024-11-26 23:20:34.304203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.942 [2024-11-26 23:20:34.304281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.942 [2024-11-26 23:20:34.304307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.942 [2024-11-26 23:20:34.304322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.942 [2024-11-26 23:20:34.304335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.942 [2024-11-26 23:20:34.304363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.942 qpair failed and we were unable to recover it. 00:28:07.942 [2024-11-26 23:20:34.314255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.942 [2024-11-26 23:20:34.314383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.942 [2024-11-26 23:20:34.314408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.942 [2024-11-26 23:20:34.314422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.942 [2024-11-26 23:20:34.314434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.942 [2024-11-26 23:20:34.314462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.942 qpair failed and we were unable to recover it. 00:28:07.942 [2024-11-26 23:20:34.324278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.942 [2024-11-26 23:20:34.324368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.942 [2024-11-26 23:20:34.324393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.942 [2024-11-26 23:20:34.324407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.942 [2024-11-26 23:20:34.324420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:07.942 [2024-11-26 23:20:34.324449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:07.942 qpair failed and we were unable to recover it. 00:28:08.201 [2024-11-26 23:20:34.334401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.201 [2024-11-26 23:20:34.334487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.201 [2024-11-26 23:20:34.334513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.201 [2024-11-26 23:20:34.334541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.201 [2024-11-26 23:20:34.334557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.201 [2024-11-26 23:20:34.334585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.201 qpair failed and we were unable to recover it. 00:28:08.201 [2024-11-26 23:20:34.344314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.201 [2024-11-26 23:20:34.344392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.201 [2024-11-26 23:20:34.344418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.201 [2024-11-26 23:20:34.344438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.201 [2024-11-26 23:20:34.344452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.201 [2024-11-26 23:20:34.344480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.201 qpair failed and we were unable to recover it. 00:28:08.201 [2024-11-26 23:20:34.354379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.201 [2024-11-26 23:20:34.354466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.201 [2024-11-26 23:20:34.354491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.201 [2024-11-26 23:20:34.354505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.201 [2024-11-26 23:20:34.354518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.201 [2024-11-26 23:20:34.354567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.201 qpair failed and we were unable to recover it. 00:28:08.201 [2024-11-26 23:20:34.364391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.201 [2024-11-26 23:20:34.364475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.201 [2024-11-26 23:20:34.364500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.201 [2024-11-26 23:20:34.364514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.201 [2024-11-26 23:20:34.364534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.201 [2024-11-26 23:20:34.364565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.201 qpair failed and we were unable to recover it. 00:28:08.201 [2024-11-26 23:20:34.374453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.201 [2024-11-26 23:20:34.374553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.201 [2024-11-26 23:20:34.374578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.201 [2024-11-26 23:20:34.374593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.201 [2024-11-26 23:20:34.374605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.201 [2024-11-26 23:20:34.374634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.201 qpair failed and we were unable to recover it. 00:28:08.201 [2024-11-26 23:20:34.384433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.201 [2024-11-26 23:20:34.384568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.201 [2024-11-26 23:20:34.384593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.201 [2024-11-26 23:20:34.384606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.201 [2024-11-26 23:20:34.384618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.201 [2024-11-26 23:20:34.384645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.201 qpair failed and we were unable to recover it. 00:28:08.201 [2024-11-26 23:20:34.394454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.201 [2024-11-26 23:20:34.394537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.201 [2024-11-26 23:20:34.394562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.201 [2024-11-26 23:20:34.394577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.201 [2024-11-26 23:20:34.394590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.201 [2024-11-26 23:20:34.394617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.201 qpair failed and we were unable to recover it. 00:28:08.201 [2024-11-26 23:20:34.404492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.201 [2024-11-26 23:20:34.404589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.201 [2024-11-26 23:20:34.404616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.201 [2024-11-26 23:20:34.404630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.201 [2024-11-26 23:20:34.404643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.201 [2024-11-26 23:20:34.404673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.414563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.414658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.414683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.414698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.414711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.414739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.424587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.424692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.424717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.424731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.424744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.424772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.434623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.434715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.434740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.434761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.434775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.434803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.444663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.444762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.444787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.444801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.444814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.444843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.454676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.454759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.454784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.454799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.454811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.454840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.464687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.464772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.464797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.464811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.464824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.464852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.474752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.474843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.474872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.474888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.474902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.474931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.484842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.484932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.484957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.484971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.484984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.485013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.494776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.494856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.494881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.494895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.494908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.494936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.504818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.504903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.504928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.504942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.504955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.504984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.514874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.514958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.514983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.514996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.515009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.515038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.524852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.524945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.524969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.524990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.525004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.525032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.534885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.534968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.202 [2024-11-26 23:20:34.534993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.202 [2024-11-26 23:20:34.535007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.202 [2024-11-26 23:20:34.535020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.202 [2024-11-26 23:20:34.535048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.202 qpair failed and we were unable to recover it. 00:28:08.202 [2024-11-26 23:20:34.544911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.202 [2024-11-26 23:20:34.544997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.203 [2024-11-26 23:20:34.545022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.203 [2024-11-26 23:20:34.545036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.203 [2024-11-26 23:20:34.545048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.203 [2024-11-26 23:20:34.545076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.203 qpair failed and we were unable to recover it. 00:28:08.203 [2024-11-26 23:20:34.554931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.203 [2024-11-26 23:20:34.555015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.203 [2024-11-26 23:20:34.555040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.203 [2024-11-26 23:20:34.555054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.203 [2024-11-26 23:20:34.555067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.203 [2024-11-26 23:20:34.555097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.203 qpair failed and we were unable to recover it. 00:28:08.203 [2024-11-26 23:20:34.565037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.203 [2024-11-26 23:20:34.565134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.203 [2024-11-26 23:20:34.565159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.203 [2024-11-26 23:20:34.565174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.203 [2024-11-26 23:20:34.565187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.203 [2024-11-26 23:20:34.565215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.203 qpair failed and we were unable to recover it. 00:28:08.203 [2024-11-26 23:20:34.575040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.203 [2024-11-26 23:20:34.575131] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.203 [2024-11-26 23:20:34.575156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.203 [2024-11-26 23:20:34.575170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.203 [2024-11-26 23:20:34.575183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.203 [2024-11-26 23:20:34.575211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.203 qpair failed and we were unable to recover it. 00:28:08.203 [2024-11-26 23:20:34.585027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.203 [2024-11-26 23:20:34.585111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.203 [2024-11-26 23:20:34.585136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.203 [2024-11-26 23:20:34.585150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.203 [2024-11-26 23:20:34.585163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.203 [2024-11-26 23:20:34.585191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.203 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.595143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.595263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.595287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.595301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.595313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.595341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.605094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.605182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.605207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.605220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.605233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.605263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.615157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.615247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.615272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.615292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.615306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.615334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.625146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.625231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.625256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.625270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.625282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.625310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.635173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.635257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.635285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.635305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.635319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.635348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.645224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.645343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.645369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.645383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.645396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.645424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.655229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.655334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.655360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.655374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.655387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.655415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.665251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.665339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.665364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.665378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.665391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.665419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.675287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.675374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.675399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.675413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.675426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.462 [2024-11-26 23:20:34.675454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.462 qpair failed and we were unable to recover it. 00:28:08.462 [2024-11-26 23:20:34.685339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.462 [2024-11-26 23:20:34.685462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.462 [2024-11-26 23:20:34.685488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.462 [2024-11-26 23:20:34.685502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.462 [2024-11-26 23:20:34.685514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.685550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.695341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.695423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.695448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.695462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.695475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.695503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.705395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.705484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.705514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.705541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.705555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.705584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.715430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.715513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.715545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.715560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.715574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.715602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.725433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.725562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.725588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.725602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.725614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.725643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.735480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.735575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.735601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.735615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.735628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.735656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.745502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.745604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.745633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.745649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.745662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.745692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.755553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.755640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.755666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.755680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.755693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.755724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.765550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.765640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.765665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.765679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.765692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.765720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.775603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.775722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.775747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.775762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.775775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.775803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.785604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.785689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.785715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.785730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.785743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.785772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.795661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.795743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.795773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.795789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.795802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.795830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.805676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.805805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.805831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.805845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.805858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.805886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.815679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.463 [2024-11-26 23:20:34.815802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.463 [2024-11-26 23:20:34.815833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.463 [2024-11-26 23:20:34.815848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.463 [2024-11-26 23:20:34.815861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.463 [2024-11-26 23:20:34.815889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.463 qpair failed and we were unable to recover it. 00:28:08.463 [2024-11-26 23:20:34.825741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.464 [2024-11-26 23:20:34.825866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.464 [2024-11-26 23:20:34.825892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.464 [2024-11-26 23:20:34.825906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.464 [2024-11-26 23:20:34.825919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.464 [2024-11-26 23:20:34.825948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.464 qpair failed and we were unable to recover it. 00:28:08.464 [2024-11-26 23:20:34.835766] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.464 [2024-11-26 23:20:34.835856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.464 [2024-11-26 23:20:34.835881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.464 [2024-11-26 23:20:34.835895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.464 [2024-11-26 23:20:34.835907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.464 [2024-11-26 23:20:34.835942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.464 qpair failed and we were unable to recover it. 00:28:08.464 [2024-11-26 23:20:34.845801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.464 [2024-11-26 23:20:34.845902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.464 [2024-11-26 23:20:34.845929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.464 [2024-11-26 23:20:34.845946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.464 [2024-11-26 23:20:34.845959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.464 [2024-11-26 23:20:34.845988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.464 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-26 23:20:34.855830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.723 [2024-11-26 23:20:34.855922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.723 [2024-11-26 23:20:34.855948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.723 [2024-11-26 23:20:34.855962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.723 [2024-11-26 23:20:34.855976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.723 [2024-11-26 23:20:34.856004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-26 23:20:34.865830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.723 [2024-11-26 23:20:34.865914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.723 [2024-11-26 23:20:34.865939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.723 [2024-11-26 23:20:34.865954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.723 [2024-11-26 23:20:34.865967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.723 [2024-11-26 23:20:34.865996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-26 23:20:34.875860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.723 [2024-11-26 23:20:34.875943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.723 [2024-11-26 23:20:34.875969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.723 [2024-11-26 23:20:34.875983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.723 [2024-11-26 23:20:34.875996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.723 [2024-11-26 23:20:34.876024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-26 23:20:34.885920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.723 [2024-11-26 23:20:34.886020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.723 [2024-11-26 23:20:34.886050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.723 [2024-11-26 23:20:34.886065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.723 [2024-11-26 23:20:34.886078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.723 [2024-11-26 23:20:34.886107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-26 23:20:34.895933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.723 [2024-11-26 23:20:34.896031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.723 [2024-11-26 23:20:34.896057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.723 [2024-11-26 23:20:34.896072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.723 [2024-11-26 23:20:34.896084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.723 [2024-11-26 23:20:34.896113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-26 23:20:34.905971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.723 [2024-11-26 23:20:34.906063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.723 [2024-11-26 23:20:34.906091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.723 [2024-11-26 23:20:34.906107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.723 [2024-11-26 23:20:34.906120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.723 [2024-11-26 23:20:34.906148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-26 23:20:34.916014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.723 [2024-11-26 23:20:34.916103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.723 [2024-11-26 23:20:34.916128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.723 [2024-11-26 23:20:34.916143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.723 [2024-11-26 23:20:34.916155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.723 [2024-11-26 23:20:34.916184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.723 qpair failed and we were unable to recover it. 00:28:08.723 [2024-11-26 23:20:34.926009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.723 [2024-11-26 23:20:34.926096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:34.926121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:34.926135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:34.926148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:34.926182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:34.936115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:34.936223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:34.936248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:34.936262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:34.936276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:34.936304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:34.946082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:34.946163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:34.946188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:34.946202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:34.946215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:34.946242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:34.956107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:34.956195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:34.956221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:34.956235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:34.956248] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:34.956276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:34.966170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:34.966298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:34.966324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:34.966338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:34.966351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:34.966379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:34.976169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:34.976255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:34.976285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:34.976300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:34.976313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:34.976341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:34.986193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:34.986275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:34.986300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:34.986314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:34.986327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:34.986355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:34.996215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:34.996302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:34.996327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:34.996341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:34.996354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:34.996382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:35.006387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:35.006475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:35.006501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:35.006515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:35.006536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:35.006567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:35.016301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:35.016391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:35.016416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:35.016431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:35.016444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:35.016477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:35.026342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:35.026424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:35.026449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:35.026463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:35.026476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:35.026505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:35.036341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:35.036442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:35.036468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:35.036483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:35.036496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:35.036531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:35.046389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:35.046481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:35.046506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:35.046520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:35.046540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.724 [2024-11-26 23:20:35.046570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.724 qpair failed and we were unable to recover it. 00:28:08.724 [2024-11-26 23:20:35.056432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.724 [2024-11-26 23:20:35.056535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.724 [2024-11-26 23:20:35.056564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.724 [2024-11-26 23:20:35.056579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.724 [2024-11-26 23:20:35.056593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.725 [2024-11-26 23:20:35.056622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-26 23:20:35.066402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.725 [2024-11-26 23:20:35.066483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.725 [2024-11-26 23:20:35.066513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.725 [2024-11-26 23:20:35.066539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.725 [2024-11-26 23:20:35.066554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.725 [2024-11-26 23:20:35.066585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-26 23:20:35.076422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.725 [2024-11-26 23:20:35.076503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.725 [2024-11-26 23:20:35.076537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.725 [2024-11-26 23:20:35.076553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.725 [2024-11-26 23:20:35.076566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.725 [2024-11-26 23:20:35.076594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-26 23:20:35.086487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.725 [2024-11-26 23:20:35.086583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.725 [2024-11-26 23:20:35.086620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.725 [2024-11-26 23:20:35.086637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.725 [2024-11-26 23:20:35.086650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.725 [2024-11-26 23:20:35.086679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-26 23:20:35.096520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.725 [2024-11-26 23:20:35.096614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.725 [2024-11-26 23:20:35.096643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.725 [2024-11-26 23:20:35.096659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.725 [2024-11-26 23:20:35.096671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.725 [2024-11-26 23:20:35.096700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.725 [2024-11-26 23:20:35.106538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.725 [2024-11-26 23:20:35.106623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.725 [2024-11-26 23:20:35.106649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.725 [2024-11-26 23:20:35.106663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.725 [2024-11-26 23:20:35.106676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.725 [2024-11-26 23:20:35.106710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.725 qpair failed and we were unable to recover it. 00:28:08.984 [2024-11-26 23:20:35.116559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.984 [2024-11-26 23:20:35.116650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.984 [2024-11-26 23:20:35.116675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.984 [2024-11-26 23:20:35.116689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.984 [2024-11-26 23:20:35.116702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.984 [2024-11-26 23:20:35.116731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.984 qpair failed and we were unable to recover it. 00:28:08.984 [2024-11-26 23:20:35.126714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.984 [2024-11-26 23:20:35.126839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.984 [2024-11-26 23:20:35.126864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.984 [2024-11-26 23:20:35.126878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.984 [2024-11-26 23:20:35.126891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.984 [2024-11-26 23:20:35.126919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.984 qpair failed and we were unable to recover it. 00:28:08.984 [2024-11-26 23:20:35.136648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.984 [2024-11-26 23:20:35.136739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.984 [2024-11-26 23:20:35.136768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.984 [2024-11-26 23:20:35.136787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.984 [2024-11-26 23:20:35.136800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.984 [2024-11-26 23:20:35.136829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.984 qpair failed and we were unable to recover it. 00:28:08.984 [2024-11-26 23:20:35.146656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.984 [2024-11-26 23:20:35.146780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.984 [2024-11-26 23:20:35.146805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.984 [2024-11-26 23:20:35.146820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.984 [2024-11-26 23:20:35.146833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.984 [2024-11-26 23:20:35.146861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.984 qpair failed and we were unable to recover it. 00:28:08.984 [2024-11-26 23:20:35.156665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.984 [2024-11-26 23:20:35.156753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.984 [2024-11-26 23:20:35.156783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.984 [2024-11-26 23:20:35.156798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.984 [2024-11-26 23:20:35.156811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.984 [2024-11-26 23:20:35.156840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.984 qpair failed and we were unable to recover it. 00:28:08.984 [2024-11-26 23:20:35.166738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.984 [2024-11-26 23:20:35.166828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.984 [2024-11-26 23:20:35.166853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.984 [2024-11-26 23:20:35.166867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.984 [2024-11-26 23:20:35.166880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.984 [2024-11-26 23:20:35.166908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.984 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.176733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.176820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.176846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.176860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.176873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.176901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.186768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.186846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.186871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.186885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.186898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.186927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.196795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.196882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.196907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.196921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.196939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.196969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.206911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.206994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.207019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.207033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.207046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.207075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.216856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.216954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.216978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.216993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.217005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.217033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.226876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.226962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.226987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.227001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.227014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.227042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.236916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.236996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.237021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.237035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.237048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.237076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.246940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.247036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.247062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.247076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.247089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.247118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.257011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.257100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.257125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.257139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.257152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.257180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.266992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.267079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.267104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.267117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.267130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.267158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.276995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.277077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.277103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.277117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.277130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.277158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.287087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.287185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.287210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.287224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.287242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.287271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.297080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.297212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.985 [2024-11-26 23:20:35.297237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.985 [2024-11-26 23:20:35.297251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.985 [2024-11-26 23:20:35.297264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.985 [2024-11-26 23:20:35.297293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.985 qpair failed and we were unable to recover it. 00:28:08.985 [2024-11-26 23:20:35.307085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.985 [2024-11-26 23:20:35.307171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.986 [2024-11-26 23:20:35.307197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.986 [2024-11-26 23:20:35.307210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.986 [2024-11-26 23:20:35.307223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.986 [2024-11-26 23:20:35.307252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.986 qpair failed and we were unable to recover it. 00:28:08.986 [2024-11-26 23:20:35.317107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.986 [2024-11-26 23:20:35.317184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.986 [2024-11-26 23:20:35.317209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.986 [2024-11-26 23:20:35.317223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.986 [2024-11-26 23:20:35.317235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.986 [2024-11-26 23:20:35.317263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.986 qpair failed and we were unable to recover it. 00:28:08.986 [2024-11-26 23:20:35.327146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.986 [2024-11-26 23:20:35.327236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.986 [2024-11-26 23:20:35.327261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.986 [2024-11-26 23:20:35.327276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.986 [2024-11-26 23:20:35.327289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.986 [2024-11-26 23:20:35.327317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.986 qpair failed and we were unable to recover it. 00:28:08.986 [2024-11-26 23:20:35.337264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.986 [2024-11-26 23:20:35.337364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.986 [2024-11-26 23:20:35.337389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.986 [2024-11-26 23:20:35.337403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.986 [2024-11-26 23:20:35.337416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.986 [2024-11-26 23:20:35.337444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.986 qpair failed and we were unable to recover it. 00:28:08.986 [2024-11-26 23:20:35.347246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.986 [2024-11-26 23:20:35.347372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.986 [2024-11-26 23:20:35.347397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.986 [2024-11-26 23:20:35.347411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.986 [2024-11-26 23:20:35.347424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.986 [2024-11-26 23:20:35.347452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.986 qpair failed and we were unable to recover it. 00:28:08.986 [2024-11-26 23:20:35.357256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.986 [2024-11-26 23:20:35.357339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.986 [2024-11-26 23:20:35.357364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.986 [2024-11-26 23:20:35.357379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.986 [2024-11-26 23:20:35.357392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.986 [2024-11-26 23:20:35.357420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.986 qpair failed and we were unable to recover it. 00:28:08.986 [2024-11-26 23:20:35.367392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.986 [2024-11-26 23:20:35.367535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.986 [2024-11-26 23:20:35.367561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.986 [2024-11-26 23:20:35.367575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.986 [2024-11-26 23:20:35.367588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:08.986 [2024-11-26 23:20:35.367616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:08.986 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.377294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.377383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.377408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.377422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.377441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.377471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.387379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.387475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.387499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.387513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.387532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.387562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.397452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.397540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.397566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.397580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.397593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.397621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.407480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.407586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.407611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.407625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.407640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.407669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.417415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.417497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.417522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.417548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.417561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.417590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.427443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.427542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.427568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.427583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.427595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.427624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.437465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.437565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.437591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.437605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.437618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.437646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.447540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.447631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.447657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.447671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.447684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.447712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.457549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.457638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.457663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.457677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.457690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.457721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.467563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.467659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.467685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.467699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.467720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.467752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.477626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.477720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.477746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.477760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.477772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x20b4cb0 00:28:09.245 [2024-11-26 23:20:35.477801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:09.245 qpair failed and we were unable to recover it. 00:28:09.245 [2024-11-26 23:20:35.487628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.245 [2024-11-26 23:20:35.487763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.245 [2024-11-26 23:20:35.487795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.245 [2024-11-26 23:20:35.487813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.245 [2024-11-26 23:20:35.487827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7faf54000b90 00:28:09.245 [2024-11-26 23:20:35.487860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:09.246 qpair failed and we were unable to recover it. 00:28:09.246 [2024-11-26 23:20:35.497676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.246 [2024-11-26 23:20:35.497796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.246 [2024-11-26 23:20:35.497823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.246 [2024-11-26 23:20:35.497839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.246 [2024-11-26 23:20:35.497853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7faf54000b90 00:28:09.246 [2024-11-26 23:20:35.497885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:09.246 qpair failed and we were unable to recover it. 00:28:09.246 [2024-11-26 23:20:35.507731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.246 [2024-11-26 23:20:35.507821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.246 [2024-11-26 23:20:35.507854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.246 [2024-11-26 23:20:35.507870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.246 [2024-11-26 23:20:35.507883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7faf60000b90 00:28:09.246 [2024-11-26 23:20:35.507914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:09.246 qpair failed and we were unable to recover it. 00:28:09.246 [2024-11-26 23:20:35.517791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.246 [2024-11-26 23:20:35.517876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.246 [2024-11-26 23:20:35.517904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.246 [2024-11-26 23:20:35.517919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.246 [2024-11-26 23:20:35.517932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7faf60000b90 00:28:09.246 [2024-11-26 23:20:35.517975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:09.246 qpair failed and we were unable to recover it. 00:28:09.246 [2024-11-26 23:20:35.518114] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:28:09.246 A controller has encountered a failure and is being reset. 00:28:09.246 [2024-11-26 23:20:35.518175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20c2600 (9): Bad file descriptor 00:28:09.246 Controller properly reset. 00:28:09.246 Initializing NVMe Controllers 00:28:09.246 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:09.246 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:09.246 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:09.246 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:09.246 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:09.246 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:09.246 Initialization complete. Launching workers. 00:28:09.246 Starting thread on core 1 00:28:09.246 Starting thread on core 2 00:28:09.246 Starting thread on core 3 00:28:09.246 Starting thread on core 0 00:28:09.246 23:20:35 -- host/target_disconnect.sh@59 -- # sync 00:28:09.246 00:28:09.246 real 0m11.524s 00:28:09.246 user 0m22.286s 00:28:09.246 sys 0m5.381s 00:28:09.246 23:20:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:09.246 23:20:35 -- common/autotest_common.sh@10 -- # set +x 00:28:09.246 ************************************ 00:28:09.246 END TEST nvmf_target_disconnect_tc2 00:28:09.246 ************************************ 00:28:09.246 23:20:35 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:09.246 23:20:35 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:09.246 23:20:35 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:09.246 23:20:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:09.246 23:20:35 -- nvmf/common.sh@116 -- # sync 00:28:09.246 23:20:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:09.246 23:20:35 -- nvmf/common.sh@119 -- # set +e 00:28:09.246 23:20:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:09.246 23:20:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:09.246 rmmod nvme_tcp 00:28:09.246 rmmod nvme_fabrics 00:28:09.246 rmmod nvme_keyring 00:28:09.504 23:20:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:09.504 23:20:35 -- nvmf/common.sh@123 -- # set -e 00:28:09.504 23:20:35 -- nvmf/common.sh@124 -- # return 0 00:28:09.504 23:20:35 -- nvmf/common.sh@477 -- # '[' -n 328199 ']' 00:28:09.504 23:20:35 -- nvmf/common.sh@478 -- # killprocess 328199 00:28:09.504 23:20:35 -- common/autotest_common.sh@936 -- # '[' -z 328199 ']' 00:28:09.504 23:20:35 -- common/autotest_common.sh@940 -- # kill -0 328199 00:28:09.504 23:20:35 -- common/autotest_common.sh@941 -- # uname 00:28:09.504 23:20:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:09.504 23:20:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 328199 00:28:09.504 23:20:35 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:28:09.504 23:20:35 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:28:09.504 23:20:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 328199' 00:28:09.504 killing process with pid 328199 00:28:09.504 23:20:35 -- common/autotest_common.sh@955 -- # kill 328199 00:28:09.504 23:20:35 -- common/autotest_common.sh@960 -- # wait 328199 00:28:09.764 23:20:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:09.764 23:20:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:09.764 23:20:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:09.764 23:20:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:09.764 23:20:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:09.764 23:20:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:09.764 23:20:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:09.764 23:20:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:11.670 23:20:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:11.670 00:28:11.670 real 0m16.378s 00:28:11.670 user 0m48.315s 00:28:11.670 sys 0m7.348s 00:28:11.670 23:20:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:11.671 23:20:38 -- common/autotest_common.sh@10 -- # set +x 00:28:11.671 ************************************ 00:28:11.671 END TEST nvmf_target_disconnect 00:28:11.671 ************************************ 00:28:11.671 23:20:38 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:11.671 23:20:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:11.671 23:20:38 -- common/autotest_common.sh@10 -- # set +x 00:28:11.930 23:20:38 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:11.930 00:28:11.930 real 21m28.267s 00:28:11.930 user 62m14.469s 00:28:11.930 sys 5m0.254s 00:28:11.930 23:20:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:11.930 23:20:38 -- common/autotest_common.sh@10 -- # set +x 00:28:11.930 ************************************ 00:28:11.930 END TEST nvmf_tcp 00:28:11.930 ************************************ 00:28:11.930 23:20:38 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:11.930 23:20:38 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:11.930 23:20:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:11.930 23:20:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:11.930 23:20:38 -- common/autotest_common.sh@10 -- # set +x 00:28:11.930 ************************************ 00:28:11.930 START TEST spdkcli_nvmf_tcp 00:28:11.930 ************************************ 00:28:11.930 23:20:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:11.930 * Looking for test storage... 00:28:11.930 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:11.930 23:20:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:11.930 23:20:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:11.930 23:20:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:11.930 23:20:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:11.930 23:20:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:11.930 23:20:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:11.930 23:20:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:11.930 23:20:38 -- scripts/common.sh@335 -- # IFS=.-: 00:28:11.930 23:20:38 -- scripts/common.sh@335 -- # read -ra ver1 00:28:11.930 23:20:38 -- scripts/common.sh@336 -- # IFS=.-: 00:28:11.930 23:20:38 -- scripts/common.sh@336 -- # read -ra ver2 00:28:11.930 23:20:38 -- scripts/common.sh@337 -- # local 'op=<' 00:28:11.930 23:20:38 -- scripts/common.sh@339 -- # ver1_l=2 00:28:11.930 23:20:38 -- scripts/common.sh@340 -- # ver2_l=1 00:28:11.930 23:20:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:11.930 23:20:38 -- scripts/common.sh@343 -- # case "$op" in 00:28:11.930 23:20:38 -- scripts/common.sh@344 -- # : 1 00:28:11.930 23:20:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:11.930 23:20:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:11.930 23:20:38 -- scripts/common.sh@364 -- # decimal 1 00:28:11.930 23:20:38 -- scripts/common.sh@352 -- # local d=1 00:28:11.930 23:20:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:11.930 23:20:38 -- scripts/common.sh@354 -- # echo 1 00:28:11.930 23:20:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:11.930 23:20:38 -- scripts/common.sh@365 -- # decimal 2 00:28:11.930 23:20:38 -- scripts/common.sh@352 -- # local d=2 00:28:11.930 23:20:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:11.930 23:20:38 -- scripts/common.sh@354 -- # echo 2 00:28:11.930 23:20:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:11.930 23:20:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:11.930 23:20:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:11.930 23:20:38 -- scripts/common.sh@367 -- # return 0 00:28:11.930 23:20:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:11.930 23:20:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:11.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:11.930 --rc genhtml_branch_coverage=1 00:28:11.930 --rc genhtml_function_coverage=1 00:28:11.930 --rc genhtml_legend=1 00:28:11.930 --rc geninfo_all_blocks=1 00:28:11.930 --rc geninfo_unexecuted_blocks=1 00:28:11.930 00:28:11.930 ' 00:28:11.930 23:20:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:11.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:11.930 --rc genhtml_branch_coverage=1 00:28:11.930 --rc genhtml_function_coverage=1 00:28:11.930 --rc genhtml_legend=1 00:28:11.930 --rc geninfo_all_blocks=1 00:28:11.930 --rc geninfo_unexecuted_blocks=1 00:28:11.930 00:28:11.930 ' 00:28:11.930 23:20:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:11.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:11.930 --rc genhtml_branch_coverage=1 00:28:11.930 --rc genhtml_function_coverage=1 00:28:11.930 --rc genhtml_legend=1 00:28:11.930 --rc geninfo_all_blocks=1 00:28:11.930 --rc geninfo_unexecuted_blocks=1 00:28:11.930 00:28:11.930 ' 00:28:11.930 23:20:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:11.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:11.930 --rc genhtml_branch_coverage=1 00:28:11.930 --rc genhtml_function_coverage=1 00:28:11.930 --rc genhtml_legend=1 00:28:11.930 --rc geninfo_all_blocks=1 00:28:11.930 --rc geninfo_unexecuted_blocks=1 00:28:11.930 00:28:11.930 ' 00:28:11.930 23:20:38 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:11.930 23:20:38 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:11.930 23:20:38 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:11.930 23:20:38 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:11.930 23:20:38 -- nvmf/common.sh@7 -- # uname -s 00:28:11.930 23:20:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:11.930 23:20:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:11.930 23:20:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:11.930 23:20:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:11.930 23:20:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:11.930 23:20:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:11.930 23:20:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:11.930 23:20:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:11.930 23:20:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:11.930 23:20:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:11.930 23:20:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:11.930 23:20:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:11.930 23:20:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:11.931 23:20:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:11.931 23:20:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:11.931 23:20:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:11.931 23:20:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:11.931 23:20:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:11.931 23:20:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:11.931 23:20:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:11.931 23:20:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:11.931 23:20:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:11.931 23:20:38 -- paths/export.sh@5 -- # export PATH 00:28:11.931 23:20:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:11.931 23:20:38 -- nvmf/common.sh@46 -- # : 0 00:28:11.931 23:20:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:11.931 23:20:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:11.931 23:20:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:11.931 23:20:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:11.931 23:20:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:11.931 23:20:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:11.931 23:20:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:11.931 23:20:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:11.931 23:20:38 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:11.931 23:20:38 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:11.931 23:20:38 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:11.931 23:20:38 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:11.931 23:20:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:11.931 23:20:38 -- common/autotest_common.sh@10 -- # set +x 00:28:11.931 23:20:38 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:11.931 23:20:38 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=329368 00:28:11.931 23:20:38 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:11.931 23:20:38 -- spdkcli/common.sh@34 -- # waitforlisten 329368 00:28:11.931 23:20:38 -- common/autotest_common.sh@829 -- # '[' -z 329368 ']' 00:28:11.931 23:20:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:11.931 23:20:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:11.931 23:20:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:11.931 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:11.931 23:20:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:11.931 23:20:38 -- common/autotest_common.sh@10 -- # set +x 00:28:11.931 [2024-11-26 23:20:38.310034] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:11.931 [2024-11-26 23:20:38.310111] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid329368 ] 00:28:12.190 EAL: No free 2048 kB hugepages reported on node 1 00:28:12.190 [2024-11-26 23:20:38.373956] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:12.190 [2024-11-26 23:20:38.486142] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:12.190 [2024-11-26 23:20:38.486369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:12.190 [2024-11-26 23:20:38.486374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:13.124 23:20:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:13.124 23:20:39 -- common/autotest_common.sh@862 -- # return 0 00:28:13.124 23:20:39 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:13.124 23:20:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:13.124 23:20:39 -- common/autotest_common.sh@10 -- # set +x 00:28:13.124 23:20:39 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:13.124 23:20:39 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:13.124 23:20:39 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:13.124 23:20:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:13.124 23:20:39 -- common/autotest_common.sh@10 -- # set +x 00:28:13.124 23:20:39 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:13.124 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:13.124 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:13.124 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:13.124 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:13.124 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:13.124 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:13.124 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:13.124 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:13.124 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:13.124 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:13.125 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:13.125 ' 00:28:13.691 [2024-11-26 23:20:39.822333] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:16.217 [2024-11-26 23:20:41.998977] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:17.151 [2024-11-26 23:20:43.235438] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:19.680 [2024-11-26 23:20:45.522839] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:21.578 [2024-11-26 23:20:47.513296] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:22.952 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:22.952 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:22.952 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:22.952 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:22.952 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:22.952 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:22.952 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:22.952 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:22.952 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:22.952 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:22.952 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:22.952 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:22.952 23:20:49 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:22.952 23:20:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:22.952 23:20:49 -- common/autotest_common.sh@10 -- # set +x 00:28:22.952 23:20:49 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:22.952 23:20:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:22.952 23:20:49 -- common/autotest_common.sh@10 -- # set +x 00:28:22.952 23:20:49 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:22.952 23:20:49 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:23.516 23:20:49 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:23.516 23:20:49 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:23.516 23:20:49 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:23.517 23:20:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:23.517 23:20:49 -- common/autotest_common.sh@10 -- # set +x 00:28:23.517 23:20:49 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:23.517 23:20:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:23.517 23:20:49 -- common/autotest_common.sh@10 -- # set +x 00:28:23.517 23:20:49 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:23.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:23.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:23.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:23.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:23.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:23.517 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:23.517 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:23.517 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:23.517 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:23.517 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:23.517 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:23.517 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:23.517 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:23.517 ' 00:28:28.786 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:28.786 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:28.786 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:28.786 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:28.786 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:28.786 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:28.786 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:28.786 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:28.786 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:28.786 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:28.786 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:28.786 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:28.786 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:28.786 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:28.786 23:20:54 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:28.786 23:20:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:28.786 23:20:54 -- common/autotest_common.sh@10 -- # set +x 00:28:28.786 23:20:54 -- spdkcli/nvmf.sh@90 -- # killprocess 329368 00:28:28.786 23:20:54 -- common/autotest_common.sh@936 -- # '[' -z 329368 ']' 00:28:28.786 23:20:54 -- common/autotest_common.sh@940 -- # kill -0 329368 00:28:28.786 23:20:54 -- common/autotest_common.sh@941 -- # uname 00:28:28.786 23:20:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:28.786 23:20:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 329368 00:28:28.786 23:20:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:28.786 23:20:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:28.786 23:20:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 329368' 00:28:28.786 killing process with pid 329368 00:28:28.786 23:20:55 -- common/autotest_common.sh@955 -- # kill 329368 00:28:28.786 [2024-11-26 23:20:55.034466] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:28.786 23:20:55 -- common/autotest_common.sh@960 -- # wait 329368 00:28:29.045 23:20:55 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:29.045 23:20:55 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:29.045 23:20:55 -- spdkcli/common.sh@13 -- # '[' -n 329368 ']' 00:28:29.045 23:20:55 -- spdkcli/common.sh@14 -- # killprocess 329368 00:28:29.045 23:20:55 -- common/autotest_common.sh@936 -- # '[' -z 329368 ']' 00:28:29.045 23:20:55 -- common/autotest_common.sh@940 -- # kill -0 329368 00:28:29.045 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (329368) - No such process 00:28:29.045 23:20:55 -- common/autotest_common.sh@963 -- # echo 'Process with pid 329368 is not found' 00:28:29.045 Process with pid 329368 is not found 00:28:29.045 23:20:55 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:29.045 23:20:55 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:29.045 23:20:55 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:29.045 00:28:29.045 real 0m17.209s 00:28:29.045 user 0m36.630s 00:28:29.045 sys 0m0.934s 00:28:29.045 23:20:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:29.045 23:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:29.045 ************************************ 00:28:29.045 END TEST spdkcli_nvmf_tcp 00:28:29.045 ************************************ 00:28:29.045 23:20:55 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:29.045 23:20:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:29.045 23:20:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:29.045 23:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:29.045 ************************************ 00:28:29.045 START TEST nvmf_identify_passthru 00:28:29.045 ************************************ 00:28:29.045 23:20:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:29.045 * Looking for test storage... 00:28:29.045 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:29.045 23:20:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:29.045 23:20:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:29.045 23:20:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:29.304 23:20:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:29.304 23:20:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:29.304 23:20:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:29.304 23:20:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:29.304 23:20:55 -- scripts/common.sh@335 -- # IFS=.-: 00:28:29.304 23:20:55 -- scripts/common.sh@335 -- # read -ra ver1 00:28:29.304 23:20:55 -- scripts/common.sh@336 -- # IFS=.-: 00:28:29.304 23:20:55 -- scripts/common.sh@336 -- # read -ra ver2 00:28:29.304 23:20:55 -- scripts/common.sh@337 -- # local 'op=<' 00:28:29.304 23:20:55 -- scripts/common.sh@339 -- # ver1_l=2 00:28:29.304 23:20:55 -- scripts/common.sh@340 -- # ver2_l=1 00:28:29.304 23:20:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:29.304 23:20:55 -- scripts/common.sh@343 -- # case "$op" in 00:28:29.304 23:20:55 -- scripts/common.sh@344 -- # : 1 00:28:29.304 23:20:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:29.304 23:20:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:29.304 23:20:55 -- scripts/common.sh@364 -- # decimal 1 00:28:29.304 23:20:55 -- scripts/common.sh@352 -- # local d=1 00:28:29.304 23:20:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:29.304 23:20:55 -- scripts/common.sh@354 -- # echo 1 00:28:29.304 23:20:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:29.304 23:20:55 -- scripts/common.sh@365 -- # decimal 2 00:28:29.304 23:20:55 -- scripts/common.sh@352 -- # local d=2 00:28:29.304 23:20:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:29.304 23:20:55 -- scripts/common.sh@354 -- # echo 2 00:28:29.304 23:20:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:29.304 23:20:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:29.304 23:20:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:29.304 23:20:55 -- scripts/common.sh@367 -- # return 0 00:28:29.304 23:20:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:29.304 23:20:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:29.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:29.304 --rc genhtml_branch_coverage=1 00:28:29.304 --rc genhtml_function_coverage=1 00:28:29.304 --rc genhtml_legend=1 00:28:29.304 --rc geninfo_all_blocks=1 00:28:29.304 --rc geninfo_unexecuted_blocks=1 00:28:29.304 00:28:29.304 ' 00:28:29.304 23:20:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:29.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:29.304 --rc genhtml_branch_coverage=1 00:28:29.304 --rc genhtml_function_coverage=1 00:28:29.304 --rc genhtml_legend=1 00:28:29.304 --rc geninfo_all_blocks=1 00:28:29.304 --rc geninfo_unexecuted_blocks=1 00:28:29.304 00:28:29.304 ' 00:28:29.304 23:20:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:29.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:29.304 --rc genhtml_branch_coverage=1 00:28:29.304 --rc genhtml_function_coverage=1 00:28:29.304 --rc genhtml_legend=1 00:28:29.304 --rc geninfo_all_blocks=1 00:28:29.304 --rc geninfo_unexecuted_blocks=1 00:28:29.304 00:28:29.304 ' 00:28:29.304 23:20:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:29.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:29.304 --rc genhtml_branch_coverage=1 00:28:29.304 --rc genhtml_function_coverage=1 00:28:29.304 --rc genhtml_legend=1 00:28:29.304 --rc geninfo_all_blocks=1 00:28:29.304 --rc geninfo_unexecuted_blocks=1 00:28:29.304 00:28:29.304 ' 00:28:29.304 23:20:55 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:29.304 23:20:55 -- nvmf/common.sh@7 -- # uname -s 00:28:29.304 23:20:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:29.304 23:20:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:29.304 23:20:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:29.304 23:20:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:29.304 23:20:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:29.304 23:20:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:29.304 23:20:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:29.304 23:20:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:29.304 23:20:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:29.304 23:20:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:29.304 23:20:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:29.304 23:20:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:29.304 23:20:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:29.304 23:20:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:29.304 23:20:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:29.304 23:20:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:29.304 23:20:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:29.304 23:20:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:29.304 23:20:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:29.304 23:20:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.305 23:20:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.305 23:20:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.305 23:20:55 -- paths/export.sh@5 -- # export PATH 00:28:29.305 23:20:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.305 23:20:55 -- nvmf/common.sh@46 -- # : 0 00:28:29.305 23:20:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:29.305 23:20:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:29.305 23:20:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:29.305 23:20:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:29.305 23:20:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:29.305 23:20:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:29.305 23:20:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:29.305 23:20:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:29.305 23:20:55 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:29.305 23:20:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:29.305 23:20:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:29.305 23:20:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:29.305 23:20:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.305 23:20:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.305 23:20:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.305 23:20:55 -- paths/export.sh@5 -- # export PATH 00:28:29.305 23:20:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:29.305 23:20:55 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:29.305 23:20:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:29.305 23:20:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:29.305 23:20:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:29.305 23:20:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:29.305 23:20:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:29.305 23:20:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:29.305 23:20:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:29.305 23:20:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:29.305 23:20:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:29.305 23:20:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:29.305 23:20:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:29.305 23:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:31.208 23:20:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:31.208 23:20:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:31.208 23:20:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:31.208 23:20:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:31.208 23:20:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:31.208 23:20:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:31.208 23:20:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:31.208 23:20:57 -- nvmf/common.sh@294 -- # net_devs=() 00:28:31.208 23:20:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:31.208 23:20:57 -- nvmf/common.sh@295 -- # e810=() 00:28:31.208 23:20:57 -- nvmf/common.sh@295 -- # local -ga e810 00:28:31.208 23:20:57 -- nvmf/common.sh@296 -- # x722=() 00:28:31.208 23:20:57 -- nvmf/common.sh@296 -- # local -ga x722 00:28:31.208 23:20:57 -- nvmf/common.sh@297 -- # mlx=() 00:28:31.208 23:20:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:31.208 23:20:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:31.208 23:20:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:31.208 23:20:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:31.208 23:20:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:31.208 23:20:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:31.208 23:20:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:31.208 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:31.208 23:20:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:31.208 23:20:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:31.208 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:31.208 23:20:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:31.208 23:20:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:31.208 23:20:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:31.208 23:20:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:31.208 23:20:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:31.208 23:20:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:31.208 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:31.208 23:20:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:31.208 23:20:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:31.208 23:20:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:31.208 23:20:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:31.208 23:20:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:31.208 23:20:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:31.208 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:31.208 23:20:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:31.208 23:20:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:31.208 23:20:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:31.208 23:20:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:31.208 23:20:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:31.208 23:20:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:31.208 23:20:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:31.208 23:20:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:31.208 23:20:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:31.208 23:20:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:31.208 23:20:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:31.208 23:20:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:31.208 23:20:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:31.208 23:20:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:31.208 23:20:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:31.208 23:20:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:31.208 23:20:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:31.208 23:20:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:31.208 23:20:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:31.208 23:20:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:31.208 23:20:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:31.208 23:20:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:31.208 23:20:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:31.208 23:20:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:31.208 23:20:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:31.208 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:31.209 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:28:31.209 00:28:31.209 --- 10.0.0.2 ping statistics --- 00:28:31.209 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:31.209 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:28:31.209 23:20:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:31.209 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:31.209 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.057 ms 00:28:31.209 00:28:31.209 --- 10.0.0.1 ping statistics --- 00:28:31.209 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:31.209 rtt min/avg/max/mdev = 0.057/0.057/0.057/0.000 ms 00:28:31.209 23:20:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:31.209 23:20:57 -- nvmf/common.sh@410 -- # return 0 00:28:31.209 23:20:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:31.209 23:20:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:31.209 23:20:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:31.209 23:20:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:31.209 23:20:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:31.209 23:20:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:31.209 23:20:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:31.209 23:20:57 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:31.209 23:20:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:31.209 23:20:57 -- common/autotest_common.sh@10 -- # set +x 00:28:31.209 23:20:57 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:31.209 23:20:57 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:31.209 23:20:57 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:31.209 23:20:57 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:31.209 23:20:57 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:31.209 23:20:57 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:31.209 23:20:57 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:31.209 23:20:57 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:31.209 23:20:57 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:31.209 23:20:57 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:31.209 23:20:57 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:31.209 23:20:57 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:31.467 23:20:57 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:31.467 23:20:57 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:31.467 23:20:57 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:31.467 23:20:57 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:31.467 23:20:57 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:31.467 23:20:57 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:31.467 EAL: No free 2048 kB hugepages reported on node 1 00:28:35.653 23:21:01 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:35.653 23:21:01 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:35.653 23:21:01 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:35.653 23:21:01 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:35.653 EAL: No free 2048 kB hugepages reported on node 1 00:28:39.842 23:21:06 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:39.842 23:21:06 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:39.842 23:21:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:39.842 23:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:39.842 23:21:06 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:39.842 23:21:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:39.842 23:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:39.842 23:21:06 -- target/identify_passthru.sh@31 -- # nvmfpid=334318 00:28:39.842 23:21:06 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:39.842 23:21:06 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:39.842 23:21:06 -- target/identify_passthru.sh@35 -- # waitforlisten 334318 00:28:39.842 23:21:06 -- common/autotest_common.sh@829 -- # '[' -z 334318 ']' 00:28:39.842 23:21:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:39.842 23:21:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:39.842 23:21:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:39.842 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:39.842 23:21:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:39.842 23:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:39.842 [2024-11-26 23:21:06.079520] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:39.842 [2024-11-26 23:21:06.079609] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:39.842 EAL: No free 2048 kB hugepages reported on node 1 00:28:39.842 [2024-11-26 23:21:06.149733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:40.099 [2024-11-26 23:21:06.267475] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:40.099 [2024-11-26 23:21:06.267658] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:40.099 [2024-11-26 23:21:06.267678] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:40.099 [2024-11-26 23:21:06.267690] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:40.099 [2024-11-26 23:21:06.267750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:40.099 [2024-11-26 23:21:06.267923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:40.099 [2024-11-26 23:21:06.267982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:40.099 [2024-11-26 23:21:06.267985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:40.099 23:21:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:40.099 23:21:06 -- common/autotest_common.sh@862 -- # return 0 00:28:40.099 23:21:06 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:40.099 23:21:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.099 23:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:40.099 INFO: Log level set to 20 00:28:40.099 INFO: Requests: 00:28:40.099 { 00:28:40.099 "jsonrpc": "2.0", 00:28:40.099 "method": "nvmf_set_config", 00:28:40.099 "id": 1, 00:28:40.099 "params": { 00:28:40.099 "admin_cmd_passthru": { 00:28:40.099 "identify_ctrlr": true 00:28:40.099 } 00:28:40.099 } 00:28:40.099 } 00:28:40.099 00:28:40.099 INFO: response: 00:28:40.099 { 00:28:40.099 "jsonrpc": "2.0", 00:28:40.099 "id": 1, 00:28:40.099 "result": true 00:28:40.099 } 00:28:40.099 00:28:40.099 23:21:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.099 23:21:06 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:40.099 23:21:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.099 23:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:40.099 INFO: Setting log level to 20 00:28:40.099 INFO: Setting log level to 20 00:28:40.099 INFO: Log level set to 20 00:28:40.099 INFO: Log level set to 20 00:28:40.099 INFO: Requests: 00:28:40.099 { 00:28:40.099 "jsonrpc": "2.0", 00:28:40.099 "method": "framework_start_init", 00:28:40.099 "id": 1 00:28:40.099 } 00:28:40.099 00:28:40.099 INFO: Requests: 00:28:40.099 { 00:28:40.099 "jsonrpc": "2.0", 00:28:40.099 "method": "framework_start_init", 00:28:40.099 "id": 1 00:28:40.099 } 00:28:40.099 00:28:40.099 [2024-11-26 23:21:06.413929] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:40.099 INFO: response: 00:28:40.099 { 00:28:40.099 "jsonrpc": "2.0", 00:28:40.099 "id": 1, 00:28:40.099 "result": true 00:28:40.099 } 00:28:40.099 00:28:40.099 INFO: response: 00:28:40.099 { 00:28:40.099 "jsonrpc": "2.0", 00:28:40.099 "id": 1, 00:28:40.099 "result": true 00:28:40.099 } 00:28:40.099 00:28:40.099 23:21:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.099 23:21:06 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:40.099 23:21:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.099 23:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:40.099 INFO: Setting log level to 40 00:28:40.099 INFO: Setting log level to 40 00:28:40.099 INFO: Setting log level to 40 00:28:40.099 [2024-11-26 23:21:06.424040] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:40.099 23:21:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.099 23:21:06 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:40.099 23:21:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:40.099 23:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:40.099 23:21:06 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:40.099 23:21:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.099 23:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:43.373 Nvme0n1 00:28:43.373 23:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.373 23:21:09 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:43.373 23:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.373 23:21:09 -- common/autotest_common.sh@10 -- # set +x 00:28:43.373 23:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.373 23:21:09 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:43.373 23:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.373 23:21:09 -- common/autotest_common.sh@10 -- # set +x 00:28:43.373 23:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.373 23:21:09 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:43.373 23:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.373 23:21:09 -- common/autotest_common.sh@10 -- # set +x 00:28:43.373 [2024-11-26 23:21:09.326687] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:43.373 23:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.373 23:21:09 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:43.373 23:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.373 23:21:09 -- common/autotest_common.sh@10 -- # set +x 00:28:43.373 [2024-11-26 23:21:09.334409] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:43.373 [ 00:28:43.373 { 00:28:43.373 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:43.373 "subtype": "Discovery", 00:28:43.373 "listen_addresses": [], 00:28:43.373 "allow_any_host": true, 00:28:43.374 "hosts": [] 00:28:43.374 }, 00:28:43.374 { 00:28:43.374 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:43.374 "subtype": "NVMe", 00:28:43.374 "listen_addresses": [ 00:28:43.374 { 00:28:43.374 "transport": "TCP", 00:28:43.374 "trtype": "TCP", 00:28:43.374 "adrfam": "IPv4", 00:28:43.374 "traddr": "10.0.0.2", 00:28:43.374 "trsvcid": "4420" 00:28:43.374 } 00:28:43.374 ], 00:28:43.374 "allow_any_host": true, 00:28:43.374 "hosts": [], 00:28:43.374 "serial_number": "SPDK00000000000001", 00:28:43.374 "model_number": "SPDK bdev Controller", 00:28:43.374 "max_namespaces": 1, 00:28:43.374 "min_cntlid": 1, 00:28:43.374 "max_cntlid": 65519, 00:28:43.374 "namespaces": [ 00:28:43.374 { 00:28:43.374 "nsid": 1, 00:28:43.374 "bdev_name": "Nvme0n1", 00:28:43.374 "name": "Nvme0n1", 00:28:43.374 "nguid": "C1C92B1038AE41A789110DC68C1E4D8C", 00:28:43.374 "uuid": "c1c92b10-38ae-41a7-8911-0dc68c1e4d8c" 00:28:43.374 } 00:28:43.374 ] 00:28:43.374 } 00:28:43.374 ] 00:28:43.374 23:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.374 23:21:09 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:43.374 23:21:09 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:43.374 23:21:09 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:43.374 EAL: No free 2048 kB hugepages reported on node 1 00:28:43.374 23:21:09 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:43.374 23:21:09 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:43.374 23:21:09 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:43.374 23:21:09 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:43.374 EAL: No free 2048 kB hugepages reported on node 1 00:28:43.374 23:21:09 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:43.374 23:21:09 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:43.374 23:21:09 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:43.374 23:21:09 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:43.374 23:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.374 23:21:09 -- common/autotest_common.sh@10 -- # set +x 00:28:43.374 23:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.374 23:21:09 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:43.374 23:21:09 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:43.374 23:21:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:43.374 23:21:09 -- nvmf/common.sh@116 -- # sync 00:28:43.374 23:21:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:43.374 23:21:09 -- nvmf/common.sh@119 -- # set +e 00:28:43.374 23:21:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:43.374 23:21:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:43.374 rmmod nvme_tcp 00:28:43.374 rmmod nvme_fabrics 00:28:43.374 rmmod nvme_keyring 00:28:43.374 23:21:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:43.374 23:21:09 -- nvmf/common.sh@123 -- # set -e 00:28:43.374 23:21:09 -- nvmf/common.sh@124 -- # return 0 00:28:43.374 23:21:09 -- nvmf/common.sh@477 -- # '[' -n 334318 ']' 00:28:43.374 23:21:09 -- nvmf/common.sh@478 -- # killprocess 334318 00:28:43.374 23:21:09 -- common/autotest_common.sh@936 -- # '[' -z 334318 ']' 00:28:43.374 23:21:09 -- common/autotest_common.sh@940 -- # kill -0 334318 00:28:43.374 23:21:09 -- common/autotest_common.sh@941 -- # uname 00:28:43.374 23:21:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:43.374 23:21:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 334318 00:28:43.374 23:21:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:43.374 23:21:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:43.374 23:21:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 334318' 00:28:43.374 killing process with pid 334318 00:28:43.374 23:21:09 -- common/autotest_common.sh@955 -- # kill 334318 00:28:43.374 [2024-11-26 23:21:09.737028] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:43.374 23:21:09 -- common/autotest_common.sh@960 -- # wait 334318 00:28:45.276 23:21:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:45.276 23:21:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:45.276 23:21:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:45.276 23:21:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:45.276 23:21:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:45.276 23:21:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:45.276 23:21:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:45.276 23:21:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:47.180 23:21:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:47.180 00:28:47.180 real 0m18.029s 00:28:47.180 user 0m26.598s 00:28:47.180 sys 0m2.288s 00:28:47.180 23:21:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:47.180 23:21:13 -- common/autotest_common.sh@10 -- # set +x 00:28:47.180 ************************************ 00:28:47.180 END TEST nvmf_identify_passthru 00:28:47.180 ************************************ 00:28:47.180 23:21:13 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:47.180 23:21:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:47.180 23:21:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:47.180 23:21:13 -- common/autotest_common.sh@10 -- # set +x 00:28:47.180 ************************************ 00:28:47.180 START TEST nvmf_dif 00:28:47.180 ************************************ 00:28:47.180 23:21:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:47.180 * Looking for test storage... 00:28:47.180 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:47.180 23:21:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:47.180 23:21:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:47.180 23:21:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:47.180 23:21:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:47.180 23:21:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:47.180 23:21:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:47.180 23:21:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:47.180 23:21:13 -- scripts/common.sh@335 -- # IFS=.-: 00:28:47.180 23:21:13 -- scripts/common.sh@335 -- # read -ra ver1 00:28:47.180 23:21:13 -- scripts/common.sh@336 -- # IFS=.-: 00:28:47.180 23:21:13 -- scripts/common.sh@336 -- # read -ra ver2 00:28:47.180 23:21:13 -- scripts/common.sh@337 -- # local 'op=<' 00:28:47.180 23:21:13 -- scripts/common.sh@339 -- # ver1_l=2 00:28:47.180 23:21:13 -- scripts/common.sh@340 -- # ver2_l=1 00:28:47.180 23:21:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:47.180 23:21:13 -- scripts/common.sh@343 -- # case "$op" in 00:28:47.180 23:21:13 -- scripts/common.sh@344 -- # : 1 00:28:47.180 23:21:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:47.180 23:21:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:47.180 23:21:13 -- scripts/common.sh@364 -- # decimal 1 00:28:47.180 23:21:13 -- scripts/common.sh@352 -- # local d=1 00:28:47.181 23:21:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:47.181 23:21:13 -- scripts/common.sh@354 -- # echo 1 00:28:47.181 23:21:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:47.181 23:21:13 -- scripts/common.sh@365 -- # decimal 2 00:28:47.181 23:21:13 -- scripts/common.sh@352 -- # local d=2 00:28:47.181 23:21:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:47.181 23:21:13 -- scripts/common.sh@354 -- # echo 2 00:28:47.181 23:21:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:47.181 23:21:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:47.181 23:21:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:47.181 23:21:13 -- scripts/common.sh@367 -- # return 0 00:28:47.181 23:21:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:47.181 23:21:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:47.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.181 --rc genhtml_branch_coverage=1 00:28:47.181 --rc genhtml_function_coverage=1 00:28:47.181 --rc genhtml_legend=1 00:28:47.181 --rc geninfo_all_blocks=1 00:28:47.181 --rc geninfo_unexecuted_blocks=1 00:28:47.181 00:28:47.181 ' 00:28:47.181 23:21:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:47.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.181 --rc genhtml_branch_coverage=1 00:28:47.181 --rc genhtml_function_coverage=1 00:28:47.181 --rc genhtml_legend=1 00:28:47.181 --rc geninfo_all_blocks=1 00:28:47.181 --rc geninfo_unexecuted_blocks=1 00:28:47.181 00:28:47.181 ' 00:28:47.181 23:21:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:47.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.181 --rc genhtml_branch_coverage=1 00:28:47.181 --rc genhtml_function_coverage=1 00:28:47.181 --rc genhtml_legend=1 00:28:47.181 --rc geninfo_all_blocks=1 00:28:47.181 --rc geninfo_unexecuted_blocks=1 00:28:47.181 00:28:47.181 ' 00:28:47.181 23:21:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:47.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:47.181 --rc genhtml_branch_coverage=1 00:28:47.181 --rc genhtml_function_coverage=1 00:28:47.181 --rc genhtml_legend=1 00:28:47.181 --rc geninfo_all_blocks=1 00:28:47.181 --rc geninfo_unexecuted_blocks=1 00:28:47.181 00:28:47.181 ' 00:28:47.181 23:21:13 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:47.181 23:21:13 -- nvmf/common.sh@7 -- # uname -s 00:28:47.181 23:21:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:47.181 23:21:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:47.181 23:21:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:47.181 23:21:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:47.181 23:21:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:47.181 23:21:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:47.181 23:21:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:47.181 23:21:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:47.181 23:21:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:47.181 23:21:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:47.181 23:21:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:47.181 23:21:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:47.181 23:21:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:47.181 23:21:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:47.181 23:21:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:47.181 23:21:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:47.181 23:21:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:47.181 23:21:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:47.181 23:21:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:47.181 23:21:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.181 23:21:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.181 23:21:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.181 23:21:13 -- paths/export.sh@5 -- # export PATH 00:28:47.181 23:21:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:47.181 23:21:13 -- nvmf/common.sh@46 -- # : 0 00:28:47.181 23:21:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:47.181 23:21:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:47.181 23:21:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:47.181 23:21:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:47.181 23:21:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:47.181 23:21:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:47.181 23:21:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:47.181 23:21:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:47.181 23:21:13 -- target/dif.sh@15 -- # NULL_META=16 00:28:47.181 23:21:13 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:47.181 23:21:13 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:47.181 23:21:13 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:47.181 23:21:13 -- target/dif.sh@135 -- # nvmftestinit 00:28:47.181 23:21:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:47.181 23:21:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:47.181 23:21:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:47.181 23:21:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:47.181 23:21:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:47.181 23:21:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:47.181 23:21:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:47.181 23:21:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:47.181 23:21:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:47.181 23:21:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:47.181 23:21:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:47.181 23:21:13 -- common/autotest_common.sh@10 -- # set +x 00:28:49.083 23:21:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:49.083 23:21:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:49.083 23:21:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:49.083 23:21:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:49.083 23:21:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:49.083 23:21:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:49.083 23:21:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:49.083 23:21:15 -- nvmf/common.sh@294 -- # net_devs=() 00:28:49.083 23:21:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:49.083 23:21:15 -- nvmf/common.sh@295 -- # e810=() 00:28:49.083 23:21:15 -- nvmf/common.sh@295 -- # local -ga e810 00:28:49.083 23:21:15 -- nvmf/common.sh@296 -- # x722=() 00:28:49.083 23:21:15 -- nvmf/common.sh@296 -- # local -ga x722 00:28:49.083 23:21:15 -- nvmf/common.sh@297 -- # mlx=() 00:28:49.083 23:21:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:49.083 23:21:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:49.083 23:21:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:49.084 23:21:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:49.084 23:21:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:49.340 23:21:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:49.340 23:21:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:49.340 23:21:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:49.340 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:49.340 23:21:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:49.340 23:21:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:49.340 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:49.340 23:21:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:49.340 23:21:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:49.340 23:21:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:49.340 23:21:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:49.340 23:21:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:49.340 23:21:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:49.340 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:49.340 23:21:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:49.340 23:21:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:49.340 23:21:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:49.340 23:21:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:49.340 23:21:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:49.340 23:21:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:49.340 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:49.340 23:21:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:49.340 23:21:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:49.340 23:21:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:49.340 23:21:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:49.340 23:21:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:49.340 23:21:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:49.340 23:21:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:49.340 23:21:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:49.340 23:21:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:49.340 23:21:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:49.340 23:21:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:49.340 23:21:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:49.341 23:21:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:49.341 23:21:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:49.341 23:21:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:49.341 23:21:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:49.341 23:21:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:49.341 23:21:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:49.341 23:21:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:49.341 23:21:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:49.341 23:21:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:49.341 23:21:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:49.341 23:21:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:49.341 23:21:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:49.341 23:21:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:49.341 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:49.341 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.327 ms 00:28:49.341 00:28:49.341 --- 10.0.0.2 ping statistics --- 00:28:49.341 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:49.341 rtt min/avg/max/mdev = 0.327/0.327/0.327/0.000 ms 00:28:49.341 23:21:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:49.341 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:49.341 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:28:49.341 00:28:49.341 --- 10.0.0.1 ping statistics --- 00:28:49.341 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:49.341 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:28:49.341 23:21:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:49.341 23:21:15 -- nvmf/common.sh@410 -- # return 0 00:28:49.341 23:21:15 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:49.341 23:21:15 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:50.715 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:50.715 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:50.715 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:50.715 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:50.715 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:50.715 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:50.715 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:50.715 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:50.715 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:50.715 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:50.715 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:50.715 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:50.715 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:50.715 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:50.715 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:50.715 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:50.715 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:50.715 23:21:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:50.715 23:21:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:50.715 23:21:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:50.715 23:21:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:50.715 23:21:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:50.716 23:21:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:50.716 23:21:17 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:50.716 23:21:17 -- target/dif.sh@137 -- # nvmfappstart 00:28:50.716 23:21:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:50.716 23:21:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:50.716 23:21:17 -- common/autotest_common.sh@10 -- # set +x 00:28:50.716 23:21:17 -- nvmf/common.sh@469 -- # nvmfpid=338151 00:28:50.716 23:21:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:50.716 23:21:17 -- nvmf/common.sh@470 -- # waitforlisten 338151 00:28:50.716 23:21:17 -- common/autotest_common.sh@829 -- # '[' -z 338151 ']' 00:28:50.716 23:21:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:50.716 23:21:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:50.716 23:21:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:50.716 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:50.716 23:21:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:50.716 23:21:17 -- common/autotest_common.sh@10 -- # set +x 00:28:50.716 [2024-11-26 23:21:17.082079] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:50.716 [2024-11-26 23:21:17.082168] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:50.974 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.974 [2024-11-26 23:21:17.149055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:50.974 [2024-11-26 23:21:17.264258] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:50.974 [2024-11-26 23:21:17.264440] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:50.974 [2024-11-26 23:21:17.264457] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:50.974 [2024-11-26 23:21:17.264470] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:50.974 [2024-11-26 23:21:17.264495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:51.910 23:21:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:51.910 23:21:18 -- common/autotest_common.sh@862 -- # return 0 00:28:51.910 23:21:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:51.910 23:21:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:51.910 23:21:18 -- common/autotest_common.sh@10 -- # set +x 00:28:51.910 23:21:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:51.910 23:21:18 -- target/dif.sh@139 -- # create_transport 00:28:51.910 23:21:18 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:51.910 23:21:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.910 23:21:18 -- common/autotest_common.sh@10 -- # set +x 00:28:51.910 [2024-11-26 23:21:18.101175] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:51.910 23:21:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.910 23:21:18 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:51.910 23:21:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:51.910 23:21:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:51.910 23:21:18 -- common/autotest_common.sh@10 -- # set +x 00:28:51.910 ************************************ 00:28:51.910 START TEST fio_dif_1_default 00:28:51.911 ************************************ 00:28:51.911 23:21:18 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:51.911 23:21:18 -- target/dif.sh@86 -- # create_subsystems 0 00:28:51.911 23:21:18 -- target/dif.sh@28 -- # local sub 00:28:51.911 23:21:18 -- target/dif.sh@30 -- # for sub in "$@" 00:28:51.911 23:21:18 -- target/dif.sh@31 -- # create_subsystem 0 00:28:51.911 23:21:18 -- target/dif.sh@18 -- # local sub_id=0 00:28:51.911 23:21:18 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:51.911 23:21:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.911 23:21:18 -- common/autotest_common.sh@10 -- # set +x 00:28:51.911 bdev_null0 00:28:51.911 23:21:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.911 23:21:18 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:51.911 23:21:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.911 23:21:18 -- common/autotest_common.sh@10 -- # set +x 00:28:51.911 23:21:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.911 23:21:18 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:51.911 23:21:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.911 23:21:18 -- common/autotest_common.sh@10 -- # set +x 00:28:51.911 23:21:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.911 23:21:18 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:51.911 23:21:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.911 23:21:18 -- common/autotest_common.sh@10 -- # set +x 00:28:51.911 [2024-11-26 23:21:18.137441] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:51.911 23:21:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.911 23:21:18 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:51.911 23:21:18 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:51.911 23:21:18 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:51.911 23:21:18 -- nvmf/common.sh@520 -- # config=() 00:28:51.911 23:21:18 -- nvmf/common.sh@520 -- # local subsystem config 00:28:51.911 23:21:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:51.911 23:21:18 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:51.911 23:21:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:51.911 { 00:28:51.911 "params": { 00:28:51.911 "name": "Nvme$subsystem", 00:28:51.911 "trtype": "$TEST_TRANSPORT", 00:28:51.911 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:51.911 "adrfam": "ipv4", 00:28:51.911 "trsvcid": "$NVMF_PORT", 00:28:51.911 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:51.911 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:51.911 "hdgst": ${hdgst:-false}, 00:28:51.911 "ddgst": ${ddgst:-false} 00:28:51.911 }, 00:28:51.911 "method": "bdev_nvme_attach_controller" 00:28:51.911 } 00:28:51.911 EOF 00:28:51.911 )") 00:28:51.911 23:21:18 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:51.911 23:21:18 -- target/dif.sh@82 -- # gen_fio_conf 00:28:51.911 23:21:18 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:51.911 23:21:18 -- target/dif.sh@54 -- # local file 00:28:51.911 23:21:18 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:51.911 23:21:18 -- target/dif.sh@56 -- # cat 00:28:51.911 23:21:18 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:51.911 23:21:18 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:51.911 23:21:18 -- common/autotest_common.sh@1330 -- # shift 00:28:51.911 23:21:18 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:51.911 23:21:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:51.911 23:21:18 -- nvmf/common.sh@542 -- # cat 00:28:51.911 23:21:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:51.911 23:21:18 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:51.911 23:21:18 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:51.911 23:21:18 -- target/dif.sh@72 -- # (( file <= files )) 00:28:51.911 23:21:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:51.911 23:21:18 -- nvmf/common.sh@544 -- # jq . 00:28:51.911 23:21:18 -- nvmf/common.sh@545 -- # IFS=, 00:28:51.911 23:21:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:51.911 "params": { 00:28:51.911 "name": "Nvme0", 00:28:51.911 "trtype": "tcp", 00:28:51.911 "traddr": "10.0.0.2", 00:28:51.911 "adrfam": "ipv4", 00:28:51.911 "trsvcid": "4420", 00:28:51.911 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:51.911 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:51.911 "hdgst": false, 00:28:51.911 "ddgst": false 00:28:51.911 }, 00:28:51.911 "method": "bdev_nvme_attach_controller" 00:28:51.911 }' 00:28:51.911 23:21:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:51.911 23:21:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:51.911 23:21:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:51.911 23:21:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:51.911 23:21:18 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:51.911 23:21:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:51.911 23:21:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:51.911 23:21:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:51.911 23:21:18 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:51.911 23:21:18 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:52.170 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:52.170 fio-3.35 00:28:52.170 Starting 1 thread 00:28:52.170 EAL: No free 2048 kB hugepages reported on node 1 00:28:52.429 [2024-11-26 23:21:18.815721] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:52.429 [2024-11-26 23:21:18.815778] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:04.633 00:29:04.633 filename0: (groupid=0, jobs=1): err= 0: pid=338396: Tue Nov 26 23:21:28 2024 00:29:04.633 read: IOPS=98, BW=393KiB/s (403kB/s)(3936KiB/10011msec) 00:29:04.634 slat (nsec): min=4059, max=50927, avg=9203.42, stdev=2833.05 00:29:04.634 clat (usec): min=593, max=45084, avg=40662.64, stdev=3637.71 00:29:04.634 lat (usec): min=601, max=45114, avg=40671.85, stdev=3637.59 00:29:04.634 clat percentiles (usec): 00:29:04.634 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:04.634 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:04.634 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:04.634 | 99.00th=[41157], 99.50th=[41157], 99.90th=[44827], 99.95th=[44827], 00:29:04.634 | 99.99th=[44827] 00:29:04.634 bw ( KiB/s): min= 384, max= 448, per=99.70%, avg=392.00, stdev=17.60, samples=20 00:29:04.634 iops : min= 96, max= 112, avg=98.00, stdev= 4.40, samples=20 00:29:04.634 lat (usec) : 750=0.81% 00:29:04.634 lat (msec) : 50=99.19% 00:29:04.634 cpu : usr=91.68%, sys=8.01%, ctx=21, majf=0, minf=248 00:29:04.634 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.634 issued rwts: total=984,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.634 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:04.634 00:29:04.634 Run status group 0 (all jobs): 00:29:04.634 READ: bw=393KiB/s (403kB/s), 393KiB/s-393KiB/s (403kB/s-403kB/s), io=3936KiB (4030kB), run=10011-10011msec 00:29:04.634 23:21:29 -- target/dif.sh@88 -- # destroy_subsystems 0 00:29:04.634 23:21:29 -- target/dif.sh@43 -- # local sub 00:29:04.634 23:21:29 -- target/dif.sh@45 -- # for sub in "$@" 00:29:04.634 23:21:29 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:04.634 23:21:29 -- target/dif.sh@36 -- # local sub_id=0 00:29:04.634 23:21:29 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 00:29:04.634 real 0m11.068s 00:29:04.634 user 0m10.297s 00:29:04.634 sys 0m1.066s 00:29:04.634 23:21:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 ************************************ 00:29:04.634 END TEST fio_dif_1_default 00:29:04.634 ************************************ 00:29:04.634 23:21:29 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:29:04.634 23:21:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:04.634 23:21:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 ************************************ 00:29:04.634 START TEST fio_dif_1_multi_subsystems 00:29:04.634 ************************************ 00:29:04.634 23:21:29 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:29:04.634 23:21:29 -- target/dif.sh@92 -- # local files=1 00:29:04.634 23:21:29 -- target/dif.sh@94 -- # create_subsystems 0 1 00:29:04.634 23:21:29 -- target/dif.sh@28 -- # local sub 00:29:04.634 23:21:29 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.634 23:21:29 -- target/dif.sh@31 -- # create_subsystem 0 00:29:04.634 23:21:29 -- target/dif.sh@18 -- # local sub_id=0 00:29:04.634 23:21:29 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 bdev_null0 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 [2024-11-26 23:21:29.237454] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.634 23:21:29 -- target/dif.sh@31 -- # create_subsystem 1 00:29:04.634 23:21:29 -- target/dif.sh@18 -- # local sub_id=1 00:29:04.634 23:21:29 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 bdev_null1 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:04.634 23:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.634 23:21:29 -- common/autotest_common.sh@10 -- # set +x 00:29:04.634 23:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.634 23:21:29 -- target/dif.sh@95 -- # fio /dev/fd/62 00:29:04.634 23:21:29 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:29:04.634 23:21:29 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:04.634 23:21:29 -- nvmf/common.sh@520 -- # config=() 00:29:04.634 23:21:29 -- nvmf/common.sh@520 -- # local subsystem config 00:29:04.634 23:21:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.634 23:21:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.634 { 00:29:04.634 "params": { 00:29:04.634 "name": "Nvme$subsystem", 00:29:04.634 "trtype": "$TEST_TRANSPORT", 00:29:04.634 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.634 "adrfam": "ipv4", 00:29:04.634 "trsvcid": "$NVMF_PORT", 00:29:04.634 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.634 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.634 "hdgst": ${hdgst:-false}, 00:29:04.634 "ddgst": ${ddgst:-false} 00:29:04.634 }, 00:29:04.634 "method": "bdev_nvme_attach_controller" 00:29:04.634 } 00:29:04.634 EOF 00:29:04.634 )") 00:29:04.634 23:21:29 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.634 23:21:29 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.634 23:21:29 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:04.634 23:21:29 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:04.634 23:21:29 -- target/dif.sh@82 -- # gen_fio_conf 00:29:04.634 23:21:29 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:04.634 23:21:29 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.634 23:21:29 -- target/dif.sh@54 -- # local file 00:29:04.634 23:21:29 -- common/autotest_common.sh@1330 -- # shift 00:29:04.634 23:21:29 -- target/dif.sh@56 -- # cat 00:29:04.634 23:21:29 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:04.634 23:21:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:04.634 23:21:29 -- nvmf/common.sh@542 -- # cat 00:29:04.634 23:21:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.634 23:21:29 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:04.634 23:21:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:04.634 23:21:29 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:04.634 23:21:29 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.634 23:21:29 -- target/dif.sh@73 -- # cat 00:29:04.634 23:21:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.634 23:21:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.634 { 00:29:04.634 "params": { 00:29:04.634 "name": "Nvme$subsystem", 00:29:04.634 "trtype": "$TEST_TRANSPORT", 00:29:04.634 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.634 "adrfam": "ipv4", 00:29:04.634 "trsvcid": "$NVMF_PORT", 00:29:04.634 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.634 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.634 "hdgst": ${hdgst:-false}, 00:29:04.634 "ddgst": ${ddgst:-false} 00:29:04.634 }, 00:29:04.635 "method": "bdev_nvme_attach_controller" 00:29:04.635 } 00:29:04.635 EOF 00:29:04.635 )") 00:29:04.635 23:21:29 -- nvmf/common.sh@542 -- # cat 00:29:04.635 23:21:29 -- target/dif.sh@72 -- # (( file++ )) 00:29:04.635 23:21:29 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.635 23:21:29 -- nvmf/common.sh@544 -- # jq . 00:29:04.635 23:21:29 -- nvmf/common.sh@545 -- # IFS=, 00:29:04.635 23:21:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:04.635 "params": { 00:29:04.635 "name": "Nvme0", 00:29:04.635 "trtype": "tcp", 00:29:04.635 "traddr": "10.0.0.2", 00:29:04.635 "adrfam": "ipv4", 00:29:04.635 "trsvcid": "4420", 00:29:04.635 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:04.635 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:04.635 "hdgst": false, 00:29:04.635 "ddgst": false 00:29:04.635 }, 00:29:04.635 "method": "bdev_nvme_attach_controller" 00:29:04.635 },{ 00:29:04.635 "params": { 00:29:04.635 "name": "Nvme1", 00:29:04.635 "trtype": "tcp", 00:29:04.635 "traddr": "10.0.0.2", 00:29:04.635 "adrfam": "ipv4", 00:29:04.635 "trsvcid": "4420", 00:29:04.635 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:04.635 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:04.635 "hdgst": false, 00:29:04.635 "ddgst": false 00:29:04.635 }, 00:29:04.635 "method": "bdev_nvme_attach_controller" 00:29:04.635 }' 00:29:04.635 23:21:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:04.635 23:21:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:04.635 23:21:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:04.635 23:21:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.635 23:21:29 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:04.635 23:21:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:04.635 23:21:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:04.635 23:21:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:04.635 23:21:29 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:04.635 23:21:29 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.635 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:04.635 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:04.635 fio-3.35 00:29:04.635 Starting 2 threads 00:29:04.635 EAL: No free 2048 kB hugepages reported on node 1 00:29:04.635 [2024-11-26 23:21:30.093818] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:04.635 [2024-11-26 23:21:30.093928] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:14.598 00:29:14.598 filename0: (groupid=0, jobs=1): err= 0: pid=339832: Tue Nov 26 23:21:40 2024 00:29:14.598 read: IOPS=191, BW=768KiB/s (786kB/s)(7680KiB/10004msec) 00:29:14.598 slat (nsec): min=4777, max=38459, avg=9335.10, stdev=2427.56 00:29:14.598 clat (usec): min=538, max=46779, avg=20812.21, stdev=20359.38 00:29:14.598 lat (usec): min=546, max=46792, avg=20821.55, stdev=20359.20 00:29:14.598 clat percentiles (usec): 00:29:14.598 | 1.00th=[ 562], 5.00th=[ 570], 10.00th=[ 578], 20.00th=[ 611], 00:29:14.598 | 30.00th=[ 635], 40.00th=[ 660], 50.00th=[ 898], 60.00th=[41157], 00:29:14.598 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:14.598 | 99.00th=[41681], 99.50th=[41681], 99.90th=[46924], 99.95th=[46924], 00:29:14.598 | 99.99th=[46924] 00:29:14.598 bw ( KiB/s): min= 672, max= 832, per=50.30%, avg=769.68, stdev=37.67, samples=19 00:29:14.598 iops : min= 168, max= 208, avg=192.42, stdev= 9.42, samples=19 00:29:14.598 lat (usec) : 750=48.75%, 1000=1.67% 00:29:14.598 lat (msec) : 50=49.58% 00:29:14.598 cpu : usr=95.23%, sys=4.47%, ctx=12, majf=0, minf=208 00:29:14.598 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.598 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.598 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.598 issued rwts: total=1920,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.598 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:14.598 filename1: (groupid=0, jobs=1): err= 0: pid=339833: Tue Nov 26 23:21:40 2024 00:29:14.598 read: IOPS=190, BW=762KiB/s (780kB/s)(7632KiB/10016msec) 00:29:14.598 slat (nsec): min=4250, max=30934, avg=9875.81, stdev=3554.88 00:29:14.599 clat (usec): min=538, max=44822, avg=20966.99, stdev=20298.58 00:29:14.599 lat (usec): min=545, max=44838, avg=20976.87, stdev=20299.08 00:29:14.599 clat percentiles (usec): 00:29:14.599 | 1.00th=[ 570], 5.00th=[ 611], 10.00th=[ 676], 20.00th=[ 717], 00:29:14.599 | 30.00th=[ 734], 40.00th=[ 750], 50.00th=[ 1106], 60.00th=[41157], 00:29:14.599 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:14.599 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44827], 99.95th=[44827], 00:29:14.599 | 99.99th=[44827] 00:29:14.599 bw ( KiB/s): min= 704, max= 832, per=49.78%, avg=761.60, stdev=33.80, samples=20 00:29:14.599 iops : min= 176, max= 208, avg=190.40, stdev= 8.45, samples=20 00:29:14.599 lat (usec) : 750=40.30%, 1000=8.65% 00:29:14.599 lat (msec) : 2=1.15%, 50=49.90% 00:29:14.599 cpu : usr=94.95%, sys=4.76%, ctx=14, majf=0, minf=118 00:29:14.599 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.599 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.599 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.599 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.599 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:14.599 00:29:14.599 Run status group 0 (all jobs): 00:29:14.599 READ: bw=1529KiB/s (1565kB/s), 762KiB/s-768KiB/s (780kB/s-786kB/s), io=15.0MiB (15.7MB), run=10004-10016msec 00:29:14.599 23:21:40 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:14.599 23:21:40 -- target/dif.sh@43 -- # local sub 00:29:14.599 23:21:40 -- target/dif.sh@45 -- # for sub in "$@" 00:29:14.599 23:21:40 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:14.599 23:21:40 -- target/dif.sh@36 -- # local sub_id=0 00:29:14.599 23:21:40 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:14.599 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.599 23:21:40 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:14.599 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.599 23:21:40 -- target/dif.sh@45 -- # for sub in "$@" 00:29:14.599 23:21:40 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:14.599 23:21:40 -- target/dif.sh@36 -- # local sub_id=1 00:29:14.599 23:21:40 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:14.599 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.599 23:21:40 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:14.599 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.599 00:29:14.599 real 0m11.324s 00:29:14.599 user 0m20.323s 00:29:14.599 sys 0m1.236s 00:29:14.599 23:21:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 ************************************ 00:29:14.599 END TEST fio_dif_1_multi_subsystems 00:29:14.599 ************************************ 00:29:14.599 23:21:40 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:14.599 23:21:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:14.599 23:21:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 ************************************ 00:29:14.599 START TEST fio_dif_rand_params 00:29:14.599 ************************************ 00:29:14.599 23:21:40 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:14.599 23:21:40 -- target/dif.sh@100 -- # local NULL_DIF 00:29:14.599 23:21:40 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:14.599 23:21:40 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:14.599 23:21:40 -- target/dif.sh@103 -- # bs=128k 00:29:14.599 23:21:40 -- target/dif.sh@103 -- # numjobs=3 00:29:14.599 23:21:40 -- target/dif.sh@103 -- # iodepth=3 00:29:14.599 23:21:40 -- target/dif.sh@103 -- # runtime=5 00:29:14.599 23:21:40 -- target/dif.sh@105 -- # create_subsystems 0 00:29:14.599 23:21:40 -- target/dif.sh@28 -- # local sub 00:29:14.599 23:21:40 -- target/dif.sh@30 -- # for sub in "$@" 00:29:14.599 23:21:40 -- target/dif.sh@31 -- # create_subsystem 0 00:29:14.599 23:21:40 -- target/dif.sh@18 -- # local sub_id=0 00:29:14.599 23:21:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:14.599 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 bdev_null0 00:29:14.599 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.599 23:21:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:14.599 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.599 23:21:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:14.599 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.599 23:21:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:14.599 23:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.599 23:21:40 -- common/autotest_common.sh@10 -- # set +x 00:29:14.599 [2024-11-26 23:21:40.595159] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:14.599 23:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.599 23:21:40 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:14.599 23:21:40 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:14.599 23:21:40 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:14.599 23:21:40 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:14.599 23:21:40 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:14.599 23:21:40 -- nvmf/common.sh@520 -- # config=() 00:29:14.599 23:21:40 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:14.599 23:21:40 -- target/dif.sh@82 -- # gen_fio_conf 00:29:14.599 23:21:40 -- nvmf/common.sh@520 -- # local subsystem config 00:29:14.600 23:21:40 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:14.600 23:21:40 -- target/dif.sh@54 -- # local file 00:29:14.600 23:21:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:14.600 23:21:40 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:14.600 23:21:40 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:14.600 23:21:40 -- target/dif.sh@56 -- # cat 00:29:14.600 23:21:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:14.600 { 00:29:14.600 "params": { 00:29:14.600 "name": "Nvme$subsystem", 00:29:14.600 "trtype": "$TEST_TRANSPORT", 00:29:14.600 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:14.600 "adrfam": "ipv4", 00:29:14.600 "trsvcid": "$NVMF_PORT", 00:29:14.600 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:14.600 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:14.600 "hdgst": ${hdgst:-false}, 00:29:14.600 "ddgst": ${ddgst:-false} 00:29:14.600 }, 00:29:14.600 "method": "bdev_nvme_attach_controller" 00:29:14.600 } 00:29:14.600 EOF 00:29:14.600 )") 00:29:14.600 23:21:40 -- common/autotest_common.sh@1330 -- # shift 00:29:14.600 23:21:40 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:14.600 23:21:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:14.600 23:21:40 -- nvmf/common.sh@542 -- # cat 00:29:14.600 23:21:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:14.600 23:21:40 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:14.600 23:21:40 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:14.600 23:21:40 -- target/dif.sh@72 -- # (( file <= files )) 00:29:14.600 23:21:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:14.600 23:21:40 -- nvmf/common.sh@544 -- # jq . 00:29:14.600 23:21:40 -- nvmf/common.sh@545 -- # IFS=, 00:29:14.600 23:21:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:14.600 "params": { 00:29:14.600 "name": "Nvme0", 00:29:14.600 "trtype": "tcp", 00:29:14.600 "traddr": "10.0.0.2", 00:29:14.600 "adrfam": "ipv4", 00:29:14.600 "trsvcid": "4420", 00:29:14.600 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:14.600 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:14.600 "hdgst": false, 00:29:14.600 "ddgst": false 00:29:14.600 }, 00:29:14.600 "method": "bdev_nvme_attach_controller" 00:29:14.600 }' 00:29:14.600 23:21:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:14.600 23:21:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:14.600 23:21:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:14.600 23:21:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:14.600 23:21:40 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:14.600 23:21:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:14.600 23:21:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:14.600 23:21:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:14.600 23:21:40 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:14.600 23:21:40 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:14.600 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:14.600 ... 00:29:14.600 fio-3.35 00:29:14.600 Starting 3 threads 00:29:14.600 EAL: No free 2048 kB hugepages reported on node 1 00:29:15.165 [2024-11-26 23:21:41.419999] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:15.165 [2024-11-26 23:21:41.420087] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:20.428 00:29:20.428 filename0: (groupid=0, jobs=1): err= 0: pid=341267: Tue Nov 26 23:21:46 2024 00:29:20.428 read: IOPS=232, BW=29.1MiB/s (30.5MB/s)(147MiB/5044msec) 00:29:20.428 slat (nsec): min=5257, max=74871, avg=20149.50, stdev=6577.91 00:29:20.428 clat (usec): min=4466, max=53066, avg=12827.88, stdev=3287.38 00:29:20.428 lat (usec): min=4478, max=53087, avg=12848.03, stdev=3287.36 00:29:20.428 clat percentiles (usec): 00:29:20.428 | 1.00th=[ 5342], 5.00th=[ 8979], 10.00th=[10159], 20.00th=[11207], 00:29:20.428 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12649], 60.00th=[13173], 00:29:20.428 | 70.00th=[13698], 80.00th=[14353], 90.00th=[15270], 95.00th=[16188], 00:29:20.428 | 99.00th=[17957], 99.50th=[22414], 99.90th=[52691], 99.95th=[53216], 00:29:20.428 | 99.99th=[53216] 00:29:20.428 bw ( KiB/s): min=25856, max=32577, per=33.96%, avg=30009.70, stdev=1890.16, samples=10 00:29:20.428 iops : min= 202, max= 254, avg=234.40, stdev=14.69, samples=10 00:29:20.428 lat (msec) : 10=9.37%, 20=89.95%, 50=0.34%, 100=0.34% 00:29:20.428 cpu : usr=92.11%, sys=6.01%, ctx=115, majf=0, minf=79 00:29:20.428 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:20.428 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.428 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.428 issued rwts: total=1174,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.428 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:20.428 filename0: (groupid=0, jobs=1): err= 0: pid=341268: Tue Nov 26 23:21:46 2024 00:29:20.428 read: IOPS=232, BW=29.1MiB/s (30.5MB/s)(147MiB/5046msec) 00:29:20.428 slat (nsec): min=5074, max=49585, avg=15407.02, stdev=4962.36 00:29:20.428 clat (usec): min=7518, max=55252, avg=12804.60, stdev=5259.71 00:29:20.428 lat (usec): min=7530, max=55270, avg=12820.00, stdev=5259.54 00:29:20.428 clat percentiles (usec): 00:29:20.428 | 1.00th=[ 8455], 5.00th=[ 9896], 10.00th=[10421], 20.00th=[10945], 00:29:20.428 | 30.00th=[11469], 40.00th=[11863], 50.00th=[12125], 60.00th=[12518], 00:29:20.428 | 70.00th=[12911], 80.00th=[13435], 90.00th=[14222], 95.00th=[14877], 00:29:20.428 | 99.00th=[51643], 99.50th=[53216], 99.90th=[54789], 99.95th=[55313], 00:29:20.428 | 99.99th=[55313] 00:29:20.428 bw ( KiB/s): min=24625, max=33024, per=33.93%, avg=29982.50, stdev=2252.63, samples=10 00:29:20.428 iops : min= 192, max= 258, avg=234.20, stdev=17.70, samples=10 00:29:20.428 lat (msec) : 10=5.45%, 20=92.93%, 100=1.62% 00:29:20.428 cpu : usr=94.19%, sys=5.31%, ctx=6, majf=0, minf=109 00:29:20.428 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:20.428 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.428 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.428 issued rwts: total=1174,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.428 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:20.428 filename0: (groupid=0, jobs=1): err= 0: pid=341269: Tue Nov 26 23:21:46 2024 00:29:20.428 read: IOPS=225, BW=28.1MiB/s (29.5MB/s)(142MiB/5047msec) 00:29:20.428 slat (nsec): min=5430, max=62206, avg=15716.45, stdev=5515.52 00:29:20.428 clat (usec): min=6637, max=53887, avg=13273.42, stdev=3850.75 00:29:20.428 lat (usec): min=6649, max=53901, avg=13289.14, stdev=3850.77 00:29:20.428 clat percentiles (usec): 00:29:20.428 | 1.00th=[ 7570], 5.00th=[ 8848], 10.00th=[10290], 20.00th=[11207], 00:29:20.428 | 30.00th=[11863], 40.00th=[12518], 50.00th=[13173], 60.00th=[13698], 00:29:20.428 | 70.00th=[14353], 80.00th=[15008], 90.00th=[15795], 95.00th=[16450], 00:29:20.428 | 99.00th=[17957], 99.50th=[49546], 99.90th=[53740], 99.95th=[53740], 00:29:20.428 | 99.99th=[53740] 00:29:20.428 bw ( KiB/s): min=25600, max=34048, per=32.82%, avg=29004.80, stdev=2505.52, samples=10 00:29:20.428 iops : min= 200, max= 266, avg=226.60, stdev=19.57, samples=10 00:29:20.428 lat (msec) : 10=8.63%, 20=90.67%, 50=0.44%, 100=0.26% 00:29:20.428 cpu : usr=94.29%, sys=5.21%, ctx=10, majf=0, minf=150 00:29:20.428 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:20.428 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.428 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.428 issued rwts: total=1136,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.428 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:20.428 00:29:20.428 Run status group 0 (all jobs): 00:29:20.428 READ: bw=86.3MiB/s (90.5MB/s), 28.1MiB/s-29.1MiB/s (29.5MB/s-30.5MB/s), io=436MiB (457MB), run=5044-5047msec 00:29:20.687 23:21:46 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:20.687 23:21:46 -- target/dif.sh@43 -- # local sub 00:29:20.687 23:21:46 -- target/dif.sh@45 -- # for sub in "$@" 00:29:20.687 23:21:46 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:20.687 23:21:46 -- target/dif.sh@36 -- # local sub_id=0 00:29:20.687 23:21:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:20.687 23:21:46 -- target/dif.sh@109 -- # bs=4k 00:29:20.687 23:21:46 -- target/dif.sh@109 -- # numjobs=8 00:29:20.687 23:21:46 -- target/dif.sh@109 -- # iodepth=16 00:29:20.687 23:21:46 -- target/dif.sh@109 -- # runtime= 00:29:20.687 23:21:46 -- target/dif.sh@109 -- # files=2 00:29:20.687 23:21:46 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:20.687 23:21:46 -- target/dif.sh@28 -- # local sub 00:29:20.687 23:21:46 -- target/dif.sh@30 -- # for sub in "$@" 00:29:20.687 23:21:46 -- target/dif.sh@31 -- # create_subsystem 0 00:29:20.687 23:21:46 -- target/dif.sh@18 -- # local sub_id=0 00:29:20.687 23:21:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 bdev_null0 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 [2024-11-26 23:21:46.957627] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@30 -- # for sub in "$@" 00:29:20.687 23:21:46 -- target/dif.sh@31 -- # create_subsystem 1 00:29:20.687 23:21:46 -- target/dif.sh@18 -- # local sub_id=1 00:29:20.687 23:21:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 bdev_null1 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:46 -- target/dif.sh@30 -- # for sub in "$@" 00:29:20.687 23:21:46 -- target/dif.sh@31 -- # create_subsystem 2 00:29:20.687 23:21:46 -- target/dif.sh@18 -- # local sub_id=2 00:29:20.687 23:21:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:20.687 23:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:46 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 bdev_null2 00:29:20.687 23:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:20.687 23:21:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:47 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:20.687 23:21:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:47 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:20.687 23:21:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.687 23:21:47 -- common/autotest_common.sh@10 -- # set +x 00:29:20.687 23:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.687 23:21:47 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:20.687 23:21:47 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:20.687 23:21:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:20.687 23:21:47 -- nvmf/common.sh@520 -- # config=() 00:29:20.687 23:21:47 -- nvmf/common.sh@520 -- # local subsystem config 00:29:20.687 23:21:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:20.687 23:21:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:20.687 23:21:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:20.687 { 00:29:20.687 "params": { 00:29:20.687 "name": "Nvme$subsystem", 00:29:20.687 "trtype": "$TEST_TRANSPORT", 00:29:20.687 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:20.687 "adrfam": "ipv4", 00:29:20.687 "trsvcid": "$NVMF_PORT", 00:29:20.687 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:20.687 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:20.687 "hdgst": ${hdgst:-false}, 00:29:20.687 "ddgst": ${ddgst:-false} 00:29:20.687 }, 00:29:20.687 "method": "bdev_nvme_attach_controller" 00:29:20.687 } 00:29:20.687 EOF 00:29:20.688 )") 00:29:20.688 23:21:47 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:20.688 23:21:47 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:20.688 23:21:47 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:20.688 23:21:47 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:20.688 23:21:47 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:20.688 23:21:47 -- target/dif.sh@82 -- # gen_fio_conf 00:29:20.688 23:21:47 -- common/autotest_common.sh@1330 -- # shift 00:29:20.688 23:21:47 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:20.688 23:21:47 -- target/dif.sh@54 -- # local file 00:29:20.688 23:21:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:20.688 23:21:47 -- target/dif.sh@56 -- # cat 00:29:20.688 23:21:47 -- nvmf/common.sh@542 -- # cat 00:29:20.688 23:21:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:20.688 23:21:47 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:20.688 23:21:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:20.688 23:21:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:20.688 23:21:47 -- target/dif.sh@72 -- # (( file <= files )) 00:29:20.688 23:21:47 -- target/dif.sh@73 -- # cat 00:29:20.688 23:21:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:20.688 23:21:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:20.688 { 00:29:20.688 "params": { 00:29:20.688 "name": "Nvme$subsystem", 00:29:20.688 "trtype": "$TEST_TRANSPORT", 00:29:20.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:20.688 "adrfam": "ipv4", 00:29:20.688 "trsvcid": "$NVMF_PORT", 00:29:20.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:20.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:20.688 "hdgst": ${hdgst:-false}, 00:29:20.688 "ddgst": ${ddgst:-false} 00:29:20.688 }, 00:29:20.688 "method": "bdev_nvme_attach_controller" 00:29:20.688 } 00:29:20.688 EOF 00:29:20.688 )") 00:29:20.688 23:21:47 -- nvmf/common.sh@542 -- # cat 00:29:20.688 23:21:47 -- target/dif.sh@72 -- # (( file++ )) 00:29:20.688 23:21:47 -- target/dif.sh@72 -- # (( file <= files )) 00:29:20.688 23:21:47 -- target/dif.sh@73 -- # cat 00:29:20.688 23:21:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:20.688 23:21:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:20.688 { 00:29:20.688 "params": { 00:29:20.688 "name": "Nvme$subsystem", 00:29:20.688 "trtype": "$TEST_TRANSPORT", 00:29:20.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:20.688 "adrfam": "ipv4", 00:29:20.688 "trsvcid": "$NVMF_PORT", 00:29:20.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:20.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:20.688 "hdgst": ${hdgst:-false}, 00:29:20.688 "ddgst": ${ddgst:-false} 00:29:20.688 }, 00:29:20.688 "method": "bdev_nvme_attach_controller" 00:29:20.688 } 00:29:20.688 EOF 00:29:20.688 )") 00:29:20.688 23:21:47 -- target/dif.sh@72 -- # (( file++ )) 00:29:20.688 23:21:47 -- target/dif.sh@72 -- # (( file <= files )) 00:29:20.688 23:21:47 -- nvmf/common.sh@542 -- # cat 00:29:20.688 23:21:47 -- nvmf/common.sh@544 -- # jq . 00:29:20.688 23:21:47 -- nvmf/common.sh@545 -- # IFS=, 00:29:20.688 23:21:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:20.688 "params": { 00:29:20.688 "name": "Nvme0", 00:29:20.688 "trtype": "tcp", 00:29:20.688 "traddr": "10.0.0.2", 00:29:20.688 "adrfam": "ipv4", 00:29:20.688 "trsvcid": "4420", 00:29:20.688 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:20.688 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:20.688 "hdgst": false, 00:29:20.688 "ddgst": false 00:29:20.688 }, 00:29:20.688 "method": "bdev_nvme_attach_controller" 00:29:20.688 },{ 00:29:20.688 "params": { 00:29:20.688 "name": "Nvme1", 00:29:20.688 "trtype": "tcp", 00:29:20.688 "traddr": "10.0.0.2", 00:29:20.688 "adrfam": "ipv4", 00:29:20.688 "trsvcid": "4420", 00:29:20.688 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:20.688 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:20.688 "hdgst": false, 00:29:20.688 "ddgst": false 00:29:20.688 }, 00:29:20.688 "method": "bdev_nvme_attach_controller" 00:29:20.688 },{ 00:29:20.688 "params": { 00:29:20.688 "name": "Nvme2", 00:29:20.688 "trtype": "tcp", 00:29:20.688 "traddr": "10.0.0.2", 00:29:20.688 "adrfam": "ipv4", 00:29:20.688 "trsvcid": "4420", 00:29:20.688 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:20.688 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:20.688 "hdgst": false, 00:29:20.688 "ddgst": false 00:29:20.688 }, 00:29:20.688 "method": "bdev_nvme_attach_controller" 00:29:20.688 }' 00:29:20.688 23:21:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:20.688 23:21:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:20.688 23:21:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:20.688 23:21:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:20.688 23:21:47 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:20.688 23:21:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:20.688 23:21:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:20.688 23:21:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:20.688 23:21:47 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:20.688 23:21:47 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:20.946 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:20.946 ... 00:29:20.946 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:20.947 ... 00:29:20.947 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:20.947 ... 00:29:20.947 fio-3.35 00:29:20.947 Starting 24 threads 00:29:20.947 EAL: No free 2048 kB hugepages reported on node 1 00:29:21.883 [2024-11-26 23:21:48.040917] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:21.883 [2024-11-26 23:21:48.040974] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:31.869 00:29:31.869 filename0: (groupid=0, jobs=1): err= 0: pid=342160: Tue Nov 26 23:21:58 2024 00:29:31.869 read: IOPS=476, BW=1906KiB/s (1952kB/s)(18.6MiB/10006msec) 00:29:31.869 slat (usec): min=8, max=153, avg=31.61, stdev=11.20 00:29:31.869 clat (msec): min=8, max=446, avg=33.30, stdev=25.64 00:29:31.869 lat (msec): min=8, max=446, avg=33.33, stdev=25.64 00:29:31.869 clat percentiles (msec): 00:29:31.869 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.869 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.869 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.869 | 99.00th=[ 182], 99.50th=[ 284], 99.90th=[ 347], 99.95th=[ 347], 00:29:31.869 | 99.99th=[ 447] 00:29:31.869 bw ( KiB/s): min= 128, max= 2176, per=4.15%, avg=1893.05, stdev=506.13, samples=19 00:29:31.869 iops : min= 32, max= 544, avg=473.26, stdev=126.53, samples=19 00:29:31.869 lat (msec) : 10=0.34%, 50=98.66%, 250=0.38%, 500=0.63% 00:29:31.869 cpu : usr=97.27%, sys=1.61%, ctx=232, majf=0, minf=51 00:29:31.869 IO depths : 1=5.4%, 2=11.6%, 4=24.9%, 8=51.0%, 16=7.1%, 32=0.0%, >=64=0.0% 00:29:31.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.869 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.869 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.869 filename0: (groupid=0, jobs=1): err= 0: pid=342161: Tue Nov 26 23:21:58 2024 00:29:31.869 read: IOPS=476, BW=1905KiB/s (1950kB/s)(18.6MiB/10013msec) 00:29:31.869 slat (usec): min=8, max=154, avg=34.71, stdev=23.27 00:29:31.869 clat (msec): min=20, max=281, avg=33.32, stdev=21.49 00:29:31.869 lat (msec): min=20, max=281, avg=33.35, stdev=21.50 00:29:31.869 clat percentiles (msec): 00:29:31.869 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.869 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:29:31.869 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.870 | 99.00th=[ 203], 99.50th=[ 209], 99.90th=[ 284], 99.95th=[ 284], 00:29:31.870 | 99.99th=[ 284] 00:29:31.870 bw ( KiB/s): min= 256, max= 2176, per=4.16%, avg=1900.80, stdev=483.01, samples=20 00:29:31.870 iops : min= 64, max= 544, avg=475.20, stdev=120.75, samples=20 00:29:31.870 lat (msec) : 50=98.66%, 250=1.01%, 500=0.34% 00:29:31.870 cpu : usr=95.92%, sys=2.31%, ctx=468, majf=0, minf=30 00:29:31.870 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.870 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.870 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.870 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.870 filename0: (groupid=0, jobs=1): err= 0: pid=342162: Tue Nov 26 23:21:58 2024 00:29:31.870 read: IOPS=477, BW=1911KiB/s (1956kB/s)(18.7MiB/10016msec) 00:29:31.870 slat (nsec): min=5345, max=77417, avg=30169.60, stdev=6703.26 00:29:31.870 clat (msec): min=19, max=264, avg=33.24, stdev=19.31 00:29:31.870 lat (msec): min=19, max=264, avg=33.27, stdev=19.31 00:29:31.870 clat percentiles (msec): 00:29:31.870 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.870 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.870 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.870 | 99.00th=[ 161], 99.50th=[ 201], 99.90th=[ 249], 99.95th=[ 249], 00:29:31.870 | 99.99th=[ 266] 00:29:31.870 bw ( KiB/s): min= 384, max= 2176, per=4.18%, avg=1907.20, stdev=460.39, samples=20 00:29:31.870 iops : min= 96, max= 544, avg=476.80, stdev=115.10, samples=20 00:29:31.870 lat (msec) : 20=0.04%, 50=98.33%, 250=1.59%, 500=0.04% 00:29:31.870 cpu : usr=98.08%, sys=1.29%, ctx=68, majf=0, minf=26 00:29:31.870 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.871 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.871 issued rwts: total=4784,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.871 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.871 filename0: (groupid=0, jobs=1): err= 0: pid=342163: Tue Nov 26 23:21:58 2024 00:29:31.871 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10010msec) 00:29:31.871 slat (usec): min=8, max=115, avg=36.69, stdev=20.32 00:29:31.871 clat (msec): min=24, max=362, avg=33.37, stdev=25.24 00:29:31.871 lat (msec): min=24, max=362, avg=33.40, stdev=25.24 00:29:31.871 clat percentiles (msec): 00:29:31.871 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.871 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 31], 00:29:31.871 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.871 | 99.00th=[ 203], 99.50th=[ 266], 99.90th=[ 326], 99.95th=[ 326], 00:29:31.871 | 99.99th=[ 363] 00:29:31.871 bw ( KiB/s): min= 128, max= 2048, per=4.15%, avg=1894.40, stdev=488.91, samples=20 00:29:31.871 iops : min= 32, max= 512, avg=473.60, stdev=122.23, samples=20 00:29:31.871 lat (msec) : 50=98.99%, 250=0.34%, 500=0.67% 00:29:31.871 cpu : usr=97.97%, sys=1.37%, ctx=83, majf=0, minf=33 00:29:31.871 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.871 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.871 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.871 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.871 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.871 filename0: (groupid=0, jobs=1): err= 0: pid=342164: Tue Nov 26 23:21:58 2024 00:29:31.871 read: IOPS=475, BW=1900KiB/s (1946kB/s)(18.6MiB/10004msec) 00:29:31.871 slat (usec): min=9, max=117, avg=67.64, stdev=27.67 00:29:31.871 clat (msec): min=21, max=454, avg=33.08, stdev=25.96 00:29:31.871 lat (msec): min=21, max=454, avg=33.15, stdev=25.96 00:29:31.871 clat percentiles (msec): 00:29:31.871 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.876 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 31], 00:29:31.876 | 70.00th=[ 31], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.876 | 99.00th=[ 182], 99.50th=[ 284], 99.90th=[ 355], 99.95th=[ 355], 00:29:31.876 | 99.99th=[ 456] 00:29:31.876 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=1886.32, stdev=500.93, samples=19 00:29:31.876 iops : min= 32, max= 512, avg=471.58, stdev=125.23, samples=19 00:29:31.876 lat (msec) : 50=98.99%, 250=0.38%, 500=0.63% 00:29:31.876 cpu : usr=97.51%, sys=1.55%, ctx=128, majf=0, minf=29 00:29:31.876 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.876 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.876 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.876 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.876 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.876 filename0: (groupid=0, jobs=1): err= 0: pid=342165: Tue Nov 26 23:21:58 2024 00:29:31.876 read: IOPS=476, BW=1905KiB/s (1950kB/s)(18.6MiB/10013msec) 00:29:31.876 slat (nsec): min=7066, max=58867, avg=29578.79, stdev=7031.77 00:29:31.876 clat (msec): min=19, max=265, avg=33.34, stdev=19.25 00:29:31.876 lat (msec): min=19, max=265, avg=33.37, stdev=19.24 00:29:31.876 clat percentiles (msec): 00:29:31.876 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.876 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.876 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.876 | 99.00th=[ 169], 99.50th=[ 209], 99.90th=[ 211], 99.95th=[ 211], 00:29:31.876 | 99.99th=[ 266] 00:29:31.876 bw ( KiB/s): min= 256, max= 2176, per=4.16%, avg=1900.80, stdev=466.67, samples=20 00:29:31.876 iops : min= 64, max= 544, avg=475.20, stdev=116.67, samples=20 00:29:31.876 lat (msec) : 20=0.04%, 50=98.32%, 250=1.59%, 500=0.04% 00:29:31.876 cpu : usr=97.80%, sys=1.38%, ctx=88, majf=0, minf=33 00:29:31.876 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.877 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.877 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.877 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.877 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.877 filename0: (groupid=0, jobs=1): err= 0: pid=342166: Tue Nov 26 23:21:58 2024 00:29:31.877 read: IOPS=476, BW=1906KiB/s (1952kB/s)(18.6MiB/10007msec) 00:29:31.877 slat (usec): min=8, max=118, avg=41.57, stdev=25.86 00:29:31.877 clat (msec): min=2, max=559, avg=33.27, stdev=28.86 00:29:31.877 lat (msec): min=2, max=559, avg=33.31, stdev=28.86 00:29:31.877 clat percentiles (msec): 00:29:31.877 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.877 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.877 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.877 | 99.00th=[ 124], 99.50th=[ 271], 99.90th=[ 451], 99.95th=[ 451], 00:29:31.877 | 99.99th=[ 558] 00:29:31.877 bw ( KiB/s): min= 112, max= 2160, per=4.13%, avg=1886.32, stdev=521.06, samples=19 00:29:31.877 iops : min= 28, max= 540, avg=471.58, stdev=130.26, samples=19 00:29:31.877 lat (msec) : 4=0.04%, 10=0.34%, 20=0.29%, 50=98.32%, 250=0.38% 00:29:31.877 lat (msec) : 500=0.59%, 750=0.04% 00:29:31.877 cpu : usr=98.26%, sys=1.24%, ctx=64, majf=0, minf=36 00:29:31.877 IO depths : 1=0.1%, 2=6.3%, 4=25.0%, 8=56.2%, 16=12.4%, 32=0.0%, >=64=0.0% 00:29:31.877 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.877 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.877 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.877 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.877 filename0: (groupid=0, jobs=1): err= 0: pid=342167: Tue Nov 26 23:21:58 2024 00:29:31.877 read: IOPS=478, BW=1914KiB/s (1960kB/s)(18.8MiB/10029msec) 00:29:31.877 slat (nsec): min=5078, max=92848, avg=20001.58, stdev=10508.00 00:29:31.877 clat (msec): min=19, max=257, avg=33.27, stdev=19.32 00:29:31.877 lat (msec): min=19, max=257, avg=33.29, stdev=19.33 00:29:31.877 clat percentiles (msec): 00:29:31.877 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.877 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:31.877 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.877 | 99.00th=[ 157], 99.50th=[ 197], 99.90th=[ 257], 99.95th=[ 257], 00:29:31.877 | 99.99th=[ 257] 00:29:31.877 bw ( KiB/s): min= 496, max= 2176, per=4.19%, avg=1913.60, stdev=438.99, samples=20 00:29:31.877 iops : min= 124, max= 544, avg=478.40, stdev=109.75, samples=20 00:29:31.877 lat (msec) : 20=0.15%, 50=98.19%, 100=0.33%, 250=1.00%, 500=0.33% 00:29:31.877 cpu : usr=98.26%, sys=1.21%, ctx=39, majf=0, minf=37 00:29:31.877 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:31.877 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.877 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.877 issued rwts: total=4800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.877 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.877 filename1: (groupid=0, jobs=1): err= 0: pid=342168: Tue Nov 26 23:21:58 2024 00:29:31.877 read: IOPS=476, BW=1905KiB/s (1950kB/s)(18.6MiB/10013msec) 00:29:31.877 slat (nsec): min=8117, max=83628, avg=29233.18, stdev=8461.33 00:29:31.877 clat (msec): min=20, max=307, avg=33.36, stdev=21.56 00:29:31.877 lat (msec): min=20, max=307, avg=33.39, stdev=21.56 00:29:31.877 clat percentiles (msec): 00:29:31.878 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.878 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:29:31.878 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.878 | 99.00th=[ 182], 99.50th=[ 209], 99.90th=[ 284], 99.95th=[ 284], 00:29:31.878 | 99.99th=[ 309] 00:29:31.878 bw ( KiB/s): min= 256, max= 2176, per=4.16%, avg=1900.80, stdev=483.01, samples=20 00:29:31.878 iops : min= 64, max= 544, avg=475.20, stdev=120.75, samples=20 00:29:31.878 lat (msec) : 50=98.66%, 250=1.01%, 500=0.34% 00:29:31.878 cpu : usr=98.24%, sys=1.29%, ctx=25, majf=0, minf=32 00:29:31.878 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.878 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.878 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.878 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.878 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.878 filename1: (groupid=0, jobs=1): err= 0: pid=342169: Tue Nov 26 23:21:58 2024 00:29:31.878 read: IOPS=476, BW=1905KiB/s (1951kB/s)(18.6MiB/10010msec) 00:29:31.878 slat (nsec): min=8921, max=85557, avg=29546.95, stdev=7832.46 00:29:31.878 clat (msec): min=22, max=272, avg=33.32, stdev=21.13 00:29:31.878 lat (msec): min=22, max=272, avg=33.35, stdev=21.13 00:29:31.878 clat percentiles (msec): 00:29:31.878 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.878 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.878 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.878 | 99.00th=[ 209], 99.50th=[ 211], 99.90th=[ 266], 99.95th=[ 266], 00:29:31.878 | 99.99th=[ 271] 00:29:31.878 bw ( KiB/s): min= 256, max= 2048, per=4.16%, avg=1900.80, stdev=464.82, samples=20 00:29:31.878 iops : min= 64, max= 512, avg=475.20, stdev=116.20, samples=20 00:29:31.878 lat (msec) : 50=98.66%, 250=1.01%, 500=0.34% 00:29:31.878 cpu : usr=98.49%, sys=1.07%, ctx=26, majf=0, minf=34 00:29:31.878 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:31.878 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.878 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.879 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.879 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.879 filename1: (groupid=0, jobs=1): err= 0: pid=342170: Tue Nov 26 23:21:58 2024 00:29:31.879 read: IOPS=476, BW=1905KiB/s (1951kB/s)(18.6MiB/10010msec) 00:29:31.879 slat (usec): min=7, max=120, avg=44.88, stdev=27.88 00:29:31.879 clat (msec): min=22, max=265, avg=33.20, stdev=21.35 00:29:31.879 lat (msec): min=22, max=265, avg=33.25, stdev=21.35 00:29:31.879 clat percentiles (msec): 00:29:31.879 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.879 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.879 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.879 | 99.00th=[ 171], 99.50th=[ 249], 99.90th=[ 266], 99.95th=[ 266], 00:29:31.879 | 99.99th=[ 266] 00:29:31.879 bw ( KiB/s): min= 256, max= 2048, per=4.16%, avg=1900.80, stdev=464.82, samples=20 00:29:31.879 iops : min= 64, max= 512, avg=475.20, stdev=116.20, samples=20 00:29:31.879 lat (msec) : 50=98.66%, 250=1.01%, 500=0.34% 00:29:31.879 cpu : usr=97.45%, sys=1.61%, ctx=100, majf=0, minf=32 00:29:31.879 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.879 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.879 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.879 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.879 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.879 filename1: (groupid=0, jobs=1): err= 0: pid=342171: Tue Nov 26 23:21:58 2024 00:29:31.879 read: IOPS=477, BW=1910KiB/s (1956kB/s)(18.7MiB/10018msec) 00:29:31.879 slat (nsec): min=7639, max=88632, avg=25603.46, stdev=10198.86 00:29:31.879 clat (msec): min=19, max=248, avg=33.30, stdev=18.99 00:29:31.879 lat (msec): min=19, max=248, avg=33.32, stdev=18.99 00:29:31.879 clat percentiles (msec): 00:29:31.880 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.880 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:31.880 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.880 | 99.00th=[ 161], 99.50th=[ 201], 99.90th=[ 249], 99.95th=[ 249], 00:29:31.880 | 99.99th=[ 249] 00:29:31.880 bw ( KiB/s): min= 384, max= 2176, per=4.18%, avg=1907.20, stdev=460.39, samples=20 00:29:31.880 iops : min= 96, max= 544, avg=476.80, stdev=115.10, samples=20 00:29:31.880 lat (msec) : 20=0.13%, 50=98.20%, 250=1.67% 00:29:31.880 cpu : usr=96.07%, sys=2.42%, ctx=337, majf=0, minf=38 00:29:31.880 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.880 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.880 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.880 issued rwts: total=4784,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.880 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.880 filename1: (groupid=0, jobs=1): err= 0: pid=342172: Tue Nov 26 23:21:58 2024 00:29:31.880 read: IOPS=475, BW=1900KiB/s (1946kB/s)(18.6MiB/10004msec) 00:29:31.880 slat (usec): min=14, max=129, avg=40.48, stdev=19.86 00:29:31.880 clat (msec): min=14, max=454, avg=33.41, stdev=26.01 00:29:31.880 lat (msec): min=14, max=454, avg=33.45, stdev=26.01 00:29:31.880 clat percentiles (msec): 00:29:31.880 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.880 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.880 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.880 | 99.00th=[ 114], 99.50th=[ 284], 99.90th=[ 355], 99.95th=[ 355], 00:29:31.880 | 99.99th=[ 456] 00:29:31.880 bw ( KiB/s): min= 128, max= 2064, per=4.13%, avg=1886.32, stdev=503.00, samples=19 00:29:31.881 iops : min= 32, max= 516, avg=471.58, stdev=125.75, samples=19 00:29:31.881 lat (msec) : 20=0.04%, 50=98.95%, 250=0.34%, 500=0.67% 00:29:31.881 cpu : usr=97.70%, sys=1.43%, ctx=79, majf=0, minf=43 00:29:31.881 IO depths : 1=0.1%, 2=6.4%, 4=25.0%, 8=56.1%, 16=12.4%, 32=0.0%, >=64=0.0% 00:29:31.881 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.881 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.881 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.881 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.881 filename1: (groupid=0, jobs=1): err= 0: pid=342173: Tue Nov 26 23:21:58 2024 00:29:31.881 read: IOPS=476, BW=1905KiB/s (1951kB/s)(18.6MiB/10006msec) 00:29:31.881 slat (usec): min=6, max=164, avg=45.88, stdev=25.52 00:29:31.881 clat (msec): min=8, max=347, avg=33.20, stdev=25.40 00:29:31.881 lat (msec): min=8, max=347, avg=33.25, stdev=25.40 00:29:31.881 clat percentiles (msec): 00:29:31.881 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.881 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 31], 00:29:31.881 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.881 | 99.00th=[ 203], 99.50th=[ 284], 99.90th=[ 347], 99.95th=[ 347], 00:29:31.881 | 99.99th=[ 347] 00:29:31.881 bw ( KiB/s): min= 128, max= 2176, per=4.15%, avg=1892.21, stdev=505.85, samples=19 00:29:31.881 iops : min= 32, max= 544, avg=473.05, stdev=126.46, samples=19 00:29:31.881 lat (msec) : 10=0.34%, 50=98.66%, 250=0.34%, 500=0.67% 00:29:31.881 cpu : usr=96.90%, sys=1.84%, ctx=173, majf=0, minf=30 00:29:31.881 IO depths : 1=5.4%, 2=11.7%, 4=25.0%, 8=50.8%, 16=7.1%, 32=0.0%, >=64=0.0% 00:29:31.881 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.881 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.881 issued rwts: total=4766,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.881 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.881 filename1: (groupid=0, jobs=1): err= 0: pid=342174: Tue Nov 26 23:21:58 2024 00:29:31.881 read: IOPS=475, BW=1900KiB/s (1946kB/s)(18.6MiB/10002msec) 00:29:31.881 slat (usec): min=8, max=154, avg=65.74, stdev=28.23 00:29:31.881 clat (msec): min=29, max=318, avg=33.09, stdev=24.85 00:29:31.881 lat (msec): min=29, max=318, avg=33.15, stdev=24.85 00:29:31.881 clat percentiles (msec): 00:29:31.881 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.881 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 31], 00:29:31.881 | 70.00th=[ 31], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.881 | 99.00th=[ 249], 99.50th=[ 266], 99.90th=[ 317], 99.95th=[ 317], 00:29:31.882 | 99.99th=[ 317] 00:29:31.882 bw ( KiB/s): min= 128, max= 2176, per=4.15%, avg=1893.05, stdev=504.08, samples=19 00:29:31.882 iops : min= 32, max= 544, avg=473.26, stdev=126.02, samples=19 00:29:31.882 lat (msec) : 50=98.99%, 250=0.34%, 500=0.67% 00:29:31.882 cpu : usr=95.58%, sys=2.45%, ctx=227, majf=0, minf=28 00:29:31.882 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:31.882 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.882 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.882 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.882 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.882 filename1: (groupid=0, jobs=1): err= 0: pid=342175: Tue Nov 26 23:21:58 2024 00:29:31.882 read: IOPS=476, BW=1906KiB/s (1951kB/s)(18.6MiB/10008msec) 00:29:31.882 slat (nsec): min=7994, max=82017, avg=27999.38, stdev=8268.23 00:29:31.882 clat (msec): min=8, max=349, avg=33.32, stdev=25.42 00:29:31.882 lat (msec): min=8, max=349, avg=33.35, stdev=25.42 00:29:31.882 clat percentiles (msec): 00:29:31.882 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.882 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.882 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.882 | 99.00th=[ 203], 99.50th=[ 279], 99.90th=[ 351], 99.95th=[ 351], 00:29:31.883 | 99.99th=[ 351] 00:29:31.883 bw ( KiB/s): min= 128, max= 2176, per=4.13%, avg=1886.32, stdev=504.84, samples=19 00:29:31.883 iops : min= 32, max= 544, avg=471.58, stdev=126.21, samples=19 00:29:31.883 lat (msec) : 10=0.34%, 20=0.34%, 50=98.32%, 250=0.34%, 500=0.67% 00:29:31.883 cpu : usr=98.58%, sys=1.00%, ctx=27, majf=0, minf=38 00:29:31.883 IO depths : 1=6.0%, 2=12.2%, 4=24.8%, 8=50.4%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:31.883 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.883 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.883 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.883 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.883 filename2: (groupid=0, jobs=1): err= 0: pid=342176: Tue Nov 26 23:21:58 2024 00:29:31.883 read: IOPS=474, BW=1900KiB/s (1945kB/s)(18.6MiB/10005msec) 00:29:31.883 slat (usec): min=11, max=119, avg=37.75, stdev=18.65 00:29:31.883 clat (msec): min=21, max=369, avg=33.35, stdev=25.93 00:29:31.883 lat (msec): min=21, max=369, avg=33.39, stdev=25.93 00:29:31.883 clat percentiles (msec): 00:29:31.883 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.883 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.883 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.883 | 99.00th=[ 114], 99.50th=[ 284], 99.90th=[ 355], 99.95th=[ 355], 00:29:31.883 | 99.99th=[ 372] 00:29:31.883 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=1886.32, stdev=500.93, samples=19 00:29:31.883 iops : min= 32, max= 512, avg=471.58, stdev=125.23, samples=19 00:29:31.883 lat (msec) : 50=98.99%, 250=0.34%, 500=0.67% 00:29:31.883 cpu : usr=98.52%, sys=0.95%, ctx=77, majf=0, minf=37 00:29:31.883 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.883 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.883 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.883 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.883 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.883 filename2: (groupid=0, jobs=1): err= 0: pid=342177: Tue Nov 26 23:21:58 2024 00:29:31.883 read: IOPS=476, BW=1906KiB/s (1952kB/s)(18.6MiB/10005msec) 00:29:31.883 slat (usec): min=8, max=115, avg=28.36, stdev=10.43 00:29:31.883 clat (msec): min=7, max=346, avg=33.36, stdev=25.30 00:29:31.883 lat (msec): min=7, max=346, avg=33.39, stdev=25.30 00:29:31.884 clat percentiles (msec): 00:29:31.884 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.884 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:29:31.884 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.884 | 99.00th=[ 203], 99.50th=[ 284], 99.90th=[ 347], 99.95th=[ 347], 00:29:31.884 | 99.99th=[ 347] 00:29:31.884 bw ( KiB/s): min= 128, max= 2160, per=4.15%, avg=1892.21, stdev=505.65, samples=19 00:29:31.884 iops : min= 32, max= 540, avg=473.05, stdev=126.41, samples=19 00:29:31.884 lat (msec) : 10=0.38%, 50=98.62%, 250=0.34%, 500=0.67% 00:29:31.884 cpu : usr=98.21%, sys=1.24%, ctx=81, majf=0, minf=33 00:29:31.884 IO depths : 1=0.1%, 2=6.4%, 4=25.0%, 8=56.1%, 16=12.4%, 32=0.0%, >=64=0.0% 00:29:31.884 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.884 complete : 0=0.0%, 4=94.4%, 8=0.1%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.884 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.884 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.884 filename2: (groupid=0, jobs=1): err= 0: pid=342178: Tue Nov 26 23:21:58 2024 00:29:31.884 read: IOPS=476, BW=1904KiB/s (1950kB/s)(18.6MiB/10016msec) 00:29:31.884 slat (nsec): min=6365, max=55419, avg=29720.03, stdev=6502.31 00:29:31.884 clat (msec): min=20, max=270, avg=33.35, stdev=20.92 00:29:31.884 lat (msec): min=20, max=270, avg=33.38, stdev=20.92 00:29:31.884 clat percentiles (msec): 00:29:31.884 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.884 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.884 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.884 | 99.00th=[ 138], 99.50th=[ 259], 99.90th=[ 271], 99.95th=[ 271], 00:29:31.884 | 99.99th=[ 271] 00:29:31.884 bw ( KiB/s): min= 384, max= 2176, per=4.16%, avg=1900.80, stdev=477.63, samples=20 00:29:31.884 iops : min= 96, max= 544, avg=475.20, stdev=119.41, samples=20 00:29:31.884 lat (msec) : 50=98.32%, 100=0.34%, 250=0.67%, 500=0.67% 00:29:31.884 cpu : usr=98.59%, sys=0.96%, ctx=21, majf=0, minf=49 00:29:31.884 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.885 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.885 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.885 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.885 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.885 filename2: (groupid=0, jobs=1): err= 0: pid=342179: Tue Nov 26 23:21:58 2024 00:29:31.885 read: IOPS=475, BW=1902KiB/s (1948kB/s)(18.6MiB/10025msec) 00:29:31.885 slat (usec): min=8, max=110, avg=34.97, stdev=20.50 00:29:31.885 clat (msec): min=23, max=281, avg=33.34, stdev=21.39 00:29:31.885 lat (msec): min=23, max=281, avg=33.38, stdev=21.39 00:29:31.885 clat percentiles (msec): 00:29:31.885 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.885 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.885 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.885 | 99.00th=[ 197], 99.50th=[ 211], 99.90th=[ 266], 99.95th=[ 266], 00:29:31.885 | 99.99th=[ 284] 00:29:31.885 bw ( KiB/s): min= 256, max= 2176, per=4.16%, avg=1900.80, stdev=483.01, samples=20 00:29:31.885 iops : min= 64, max= 544, avg=475.20, stdev=120.75, samples=20 00:29:31.885 lat (msec) : 50=98.66%, 250=1.01%, 500=0.34% 00:29:31.885 cpu : usr=98.44%, sys=1.04%, ctx=45, majf=0, minf=43 00:29:31.885 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.885 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.885 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.885 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.885 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.885 filename2: (groupid=0, jobs=1): err= 0: pid=342180: Tue Nov 26 23:21:58 2024 00:29:31.885 read: IOPS=477, BW=1910KiB/s (1956kB/s)(18.7MiB/10018msec) 00:29:31.885 slat (usec): min=6, max=127, avg=60.09, stdev=29.18 00:29:31.885 clat (msec): min=19, max=270, avg=32.98, stdev=20.88 00:29:31.885 lat (msec): min=19, max=270, avg=33.04, stdev=20.88 00:29:31.885 clat percentiles (msec): 00:29:31.885 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.886 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 31], 00:29:31.886 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.886 | 99.00th=[ 138], 99.50th=[ 259], 99.90th=[ 271], 99.95th=[ 271], 00:29:31.886 | 99.99th=[ 271] 00:29:31.886 bw ( KiB/s): min= 496, max= 2176, per=4.18%, avg=1907.20, stdev=456.89, samples=20 00:29:31.886 iops : min= 124, max= 544, avg=476.80, stdev=114.22, samples=20 00:29:31.886 lat (msec) : 20=0.33%, 50=98.04%, 100=0.29%, 250=0.71%, 500=0.63% 00:29:31.886 cpu : usr=97.75%, sys=1.31%, ctx=38, majf=0, minf=26 00:29:31.886 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:31.886 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.886 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.886 issued rwts: total=4784,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.886 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.886 filename2: (groupid=0, jobs=1): err= 0: pid=342181: Tue Nov 26 23:21:58 2024 00:29:31.886 read: IOPS=474, BW=1899KiB/s (1945kB/s)(18.6MiB/10008msec) 00:29:31.886 slat (usec): min=12, max=114, avg=33.09, stdev=11.66 00:29:31.886 clat (msec): min=20, max=357, avg=33.37, stdev=25.79 00:29:31.886 lat (msec): min=20, max=357, avg=33.41, stdev=25.79 00:29:31.887 clat percentiles (msec): 00:29:31.887 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.887 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 31], 00:29:31.887 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.887 | 99.00th=[ 203], 99.50th=[ 284], 99.90th=[ 359], 99.95th=[ 359], 00:29:31.887 | 99.99th=[ 359] 00:29:31.887 bw ( KiB/s): min= 128, max= 2176, per=4.13%, avg=1886.32, stdev=502.75, samples=19 00:29:31.887 iops : min= 32, max= 544, avg=471.58, stdev=125.69, samples=19 00:29:31.887 lat (msec) : 50=98.99%, 250=0.34%, 500=0.67% 00:29:31.887 cpu : usr=97.34%, sys=1.49%, ctx=120, majf=0, minf=31 00:29:31.887 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.887 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.887 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.887 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.887 filename2: (groupid=0, jobs=1): err= 0: pid=342182: Tue Nov 26 23:21:58 2024 00:29:31.887 read: IOPS=474, BW=1898KiB/s (1944kB/s)(18.6MiB/10013msec) 00:29:31.887 slat (nsec): min=8645, max=53162, avg=27319.50, stdev=8176.62 00:29:31.887 clat (msec): min=22, max=325, avg=33.50, stdev=25.12 00:29:31.887 lat (msec): min=22, max=325, avg=33.53, stdev=25.12 00:29:31.887 clat percentiles (msec): 00:29:31.887 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.887 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:31.887 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.887 | 99.00th=[ 249], 99.50th=[ 266], 99.90th=[ 326], 99.95th=[ 326], 00:29:31.887 | 99.99th=[ 326] 00:29:31.887 bw ( KiB/s): min= 128, max= 2064, per=4.15%, avg=1894.40, stdev=488.94, samples=20 00:29:31.887 iops : min= 32, max= 516, avg=473.60, stdev=122.23, samples=20 00:29:31.888 lat (msec) : 50=98.99%, 250=0.34%, 500=0.67% 00:29:31.888 cpu : usr=98.49%, sys=1.07%, ctx=18, majf=0, minf=38 00:29:31.888 IO depths : 1=0.3%, 2=6.5%, 4=25.0%, 8=56.0%, 16=12.2%, 32=0.0%, >=64=0.0% 00:29:31.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.888 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.888 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.888 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.888 filename2: (groupid=0, jobs=1): err= 0: pid=342183: Tue Nov 26 23:21:58 2024 00:29:31.888 read: IOPS=476, BW=1905KiB/s (1951kB/s)(18.6MiB/10010msec) 00:29:31.888 slat (nsec): min=9215, max=83884, avg=30025.36, stdev=8454.08 00:29:31.888 clat (msec): min=22, max=265, avg=33.31, stdev=21.09 00:29:31.888 lat (msec): min=22, max=265, avg=33.34, stdev=21.09 00:29:31.888 clat percentiles (msec): 00:29:31.888 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:31.888 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:29:31.888 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:31.888 | 99.00th=[ 209], 99.50th=[ 213], 99.90th=[ 266], 99.95th=[ 266], 00:29:31.888 | 99.99th=[ 266] 00:29:31.889 bw ( KiB/s): min= 256, max= 2048, per=4.16%, avg=1900.80, stdev=464.82, samples=20 00:29:31.889 iops : min= 64, max= 512, avg=475.20, stdev=116.20, samples=20 00:29:31.889 lat (msec) : 50=98.66%, 250=1.01%, 500=0.34% 00:29:31.889 cpu : usr=97.69%, sys=1.42%, ctx=164, majf=0, minf=28 00:29:31.889 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.889 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.889 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.889 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.889 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.889 00:29:31.889 Run status group 0 (all jobs): 00:29:31.889 READ: bw=44.6MiB/s (46.7MB/s), 1898KiB/s-1914KiB/s (1944kB/s-1960kB/s), io=447MiB (469MB), run=10002-10029msec 00:29:32.457 23:21:58 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:32.457 23:21:58 -- target/dif.sh@43 -- # local sub 00:29:32.457 23:21:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:32.457 23:21:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:32.457 23:21:58 -- target/dif.sh@36 -- # local sub_id=0 00:29:32.457 23:21:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:32.457 23:21:58 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:32.457 23:21:58 -- target/dif.sh@36 -- # local sub_id=1 00:29:32.457 23:21:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:32.457 23:21:58 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:32.457 23:21:58 -- target/dif.sh@36 -- # local sub_id=2 00:29:32.457 23:21:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:32.457 23:21:58 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:32.457 23:21:58 -- target/dif.sh@115 -- # numjobs=2 00:29:32.457 23:21:58 -- target/dif.sh@115 -- # iodepth=8 00:29:32.457 23:21:58 -- target/dif.sh@115 -- # runtime=5 00:29:32.457 23:21:58 -- target/dif.sh@115 -- # files=1 00:29:32.457 23:21:58 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:32.457 23:21:58 -- target/dif.sh@28 -- # local sub 00:29:32.457 23:21:58 -- target/dif.sh@30 -- # for sub in "$@" 00:29:32.457 23:21:58 -- target/dif.sh@31 -- # create_subsystem 0 00:29:32.457 23:21:58 -- target/dif.sh@18 -- # local sub_id=0 00:29:32.457 23:21:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 bdev_null0 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 [2024-11-26 23:21:58.651634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@30 -- # for sub in "$@" 00:29:32.457 23:21:58 -- target/dif.sh@31 -- # create_subsystem 1 00:29:32.457 23:21:58 -- target/dif.sh@18 -- # local sub_id=1 00:29:32.457 23:21:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 bdev_null1 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:32.457 23:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.457 23:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:32.457 23:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.457 23:21:58 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:32.457 23:21:58 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:32.457 23:21:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:32.457 23:21:58 -- nvmf/common.sh@520 -- # config=() 00:29:32.457 23:21:58 -- nvmf/common.sh@520 -- # local subsystem config 00:29:32.457 23:21:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:32.457 23:21:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:32.457 { 00:29:32.457 "params": { 00:29:32.457 "name": "Nvme$subsystem", 00:29:32.457 "trtype": "$TEST_TRANSPORT", 00:29:32.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:32.457 "adrfam": "ipv4", 00:29:32.457 "trsvcid": "$NVMF_PORT", 00:29:32.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:32.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:32.457 "hdgst": ${hdgst:-false}, 00:29:32.457 "ddgst": ${ddgst:-false} 00:29:32.457 }, 00:29:32.457 "method": "bdev_nvme_attach_controller" 00:29:32.457 } 00:29:32.457 EOF 00:29:32.457 )") 00:29:32.457 23:21:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.457 23:21:58 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.458 23:21:58 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:32.458 23:21:58 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:32.458 23:21:58 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:32.458 23:21:58 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.458 23:21:58 -- common/autotest_common.sh@1330 -- # shift 00:29:32.458 23:21:58 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:32.458 23:21:58 -- target/dif.sh@82 -- # gen_fio_conf 00:29:32.458 23:21:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:32.458 23:21:58 -- target/dif.sh@54 -- # local file 00:29:32.458 23:21:58 -- target/dif.sh@56 -- # cat 00:29:32.458 23:21:58 -- nvmf/common.sh@542 -- # cat 00:29:32.458 23:21:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.458 23:21:58 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:32.458 23:21:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:32.458 23:21:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:32.458 23:21:58 -- target/dif.sh@72 -- # (( file <= files )) 00:29:32.458 23:21:58 -- target/dif.sh@73 -- # cat 00:29:32.458 23:21:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:32.458 23:21:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:32.458 { 00:29:32.458 "params": { 00:29:32.458 "name": "Nvme$subsystem", 00:29:32.458 "trtype": "$TEST_TRANSPORT", 00:29:32.458 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:32.458 "adrfam": "ipv4", 00:29:32.458 "trsvcid": "$NVMF_PORT", 00:29:32.458 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:32.458 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:32.458 "hdgst": ${hdgst:-false}, 00:29:32.458 "ddgst": ${ddgst:-false} 00:29:32.458 }, 00:29:32.458 "method": "bdev_nvme_attach_controller" 00:29:32.458 } 00:29:32.458 EOF 00:29:32.458 )") 00:29:32.458 23:21:58 -- nvmf/common.sh@542 -- # cat 00:29:32.458 23:21:58 -- target/dif.sh@72 -- # (( file++ )) 00:29:32.458 23:21:58 -- target/dif.sh@72 -- # (( file <= files )) 00:29:32.458 23:21:58 -- nvmf/common.sh@544 -- # jq . 00:29:32.458 23:21:58 -- nvmf/common.sh@545 -- # IFS=, 00:29:32.458 23:21:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:32.458 "params": { 00:29:32.458 "name": "Nvme0", 00:29:32.458 "trtype": "tcp", 00:29:32.458 "traddr": "10.0.0.2", 00:29:32.458 "adrfam": "ipv4", 00:29:32.458 "trsvcid": "4420", 00:29:32.458 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:32.458 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:32.458 "hdgst": false, 00:29:32.458 "ddgst": false 00:29:32.458 }, 00:29:32.458 "method": "bdev_nvme_attach_controller" 00:29:32.458 },{ 00:29:32.458 "params": { 00:29:32.458 "name": "Nvme1", 00:29:32.458 "trtype": "tcp", 00:29:32.458 "traddr": "10.0.0.2", 00:29:32.458 "adrfam": "ipv4", 00:29:32.458 "trsvcid": "4420", 00:29:32.458 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:32.458 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:32.458 "hdgst": false, 00:29:32.458 "ddgst": false 00:29:32.458 }, 00:29:32.458 "method": "bdev_nvme_attach_controller" 00:29:32.458 }' 00:29:32.458 23:21:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:32.458 23:21:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:32.458 23:21:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:32.458 23:21:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.458 23:21:58 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:32.458 23:21:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:32.458 23:21:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:32.458 23:21:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:32.458 23:21:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:32.458 23:21:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.716 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:32.716 ... 00:29:32.716 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:32.716 ... 00:29:32.716 fio-3.35 00:29:32.716 Starting 4 threads 00:29:32.716 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.284 [2024-11-26 23:21:59.590768] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:33.284 [2024-11-26 23:21:59.590842] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:38.553 00:29:38.553 filename0: (groupid=0, jobs=1): err= 0: pid=343607: Tue Nov 26 23:22:04 2024 00:29:38.553 read: IOPS=1941, BW=15.2MiB/s (15.9MB/s)(75.9MiB/5007msec) 00:29:38.553 slat (nsec): min=4314, max=65697, avg=21877.03, stdev=7899.53 00:29:38.553 clat (usec): min=743, max=7476, avg=4040.20, stdev=399.50 00:29:38.553 lat (usec): min=758, max=7497, avg=4062.08, stdev=399.67 00:29:38.553 clat percentiles (usec): 00:29:38.553 | 1.00th=[ 2835], 5.00th=[ 3523], 10.00th=[ 3785], 20.00th=[ 3916], 00:29:38.553 | 30.00th=[ 3949], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4080], 00:29:38.553 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4424], 00:29:38.553 | 99.00th=[ 5276], 99.50th=[ 6063], 99.90th=[ 6849], 99.95th=[ 7111], 00:29:38.553 | 99.99th=[ 7504] 00:29:38.553 bw ( KiB/s): min=15152, max=16016, per=25.11%, avg=15539.20, stdev=209.68, samples=10 00:29:38.553 iops : min= 1894, max= 2002, avg=1942.40, stdev=26.21, samples=10 00:29:38.553 lat (usec) : 750=0.01%, 1000=0.09% 00:29:38.553 lat (msec) : 2=0.30%, 4=37.98%, 10=61.62% 00:29:38.553 cpu : usr=94.31%, sys=4.69%, ctx=73, majf=0, minf=9 00:29:38.553 IO depths : 1=0.6%, 2=17.5%, 4=56.3%, 8=25.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:38.553 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.553 complete : 0=0.0%, 4=90.9%, 8=9.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.553 issued rwts: total=9720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.553 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:38.553 filename0: (groupid=0, jobs=1): err= 0: pid=343608: Tue Nov 26 23:22:04 2024 00:29:38.553 read: IOPS=1930, BW=15.1MiB/s (15.8MB/s)(75.4MiB/5003msec) 00:29:38.553 slat (nsec): min=7097, max=68889, avg=20312.06, stdev=10052.17 00:29:38.553 clat (usec): min=626, max=7488, avg=4069.95, stdev=439.66 00:29:38.553 lat (usec): min=638, max=7501, avg=4090.27, stdev=439.87 00:29:38.553 clat percentiles (usec): 00:29:38.553 | 1.00th=[ 2802], 5.00th=[ 3589], 10.00th=[ 3818], 20.00th=[ 3916], 00:29:38.553 | 30.00th=[ 3982], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4113], 00:29:38.553 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4490], 00:29:38.553 | 99.00th=[ 5866], 99.50th=[ 6390], 99.90th=[ 7046], 99.95th=[ 7242], 00:29:38.553 | 99.99th=[ 7504] 00:29:38.553 bw ( KiB/s): min=15200, max=15680, per=24.96%, avg=15441.40, stdev=140.67, samples=10 00:29:38.553 iops : min= 1900, max= 1960, avg=1930.10, stdev=17.62, samples=10 00:29:38.553 lat (usec) : 750=0.03%, 1000=0.08% 00:29:38.553 lat (msec) : 2=0.35%, 4=36.02%, 10=63.52% 00:29:38.553 cpu : usr=95.40%, sys=4.08%, ctx=8, majf=0, minf=9 00:29:38.553 IO depths : 1=0.3%, 2=18.1%, 4=55.6%, 8=25.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:38.553 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.553 complete : 0=0.0%, 4=91.0%, 8=9.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.553 issued rwts: total=9657,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.553 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:38.553 filename1: (groupid=0, jobs=1): err= 0: pid=343609: Tue Nov 26 23:22:04 2024 00:29:38.553 read: IOPS=1945, BW=15.2MiB/s (15.9MB/s)(76.0MiB/5001msec) 00:29:38.553 slat (nsec): min=5244, max=67295, avg=19633.15, stdev=10017.76 00:29:38.553 clat (usec): min=758, max=7300, avg=4041.62, stdev=419.44 00:29:38.553 lat (usec): min=770, max=7316, avg=4061.25, stdev=419.97 00:29:38.553 clat percentiles (usec): 00:29:38.553 | 1.00th=[ 2769], 5.00th=[ 3458], 10.00th=[ 3752], 20.00th=[ 3884], 00:29:38.553 | 30.00th=[ 3982], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4113], 00:29:38.553 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4424], 00:29:38.553 | 99.00th=[ 5669], 99.50th=[ 6390], 99.90th=[ 7046], 99.95th=[ 7111], 00:29:38.553 | 99.99th=[ 7308] 00:29:38.553 bw ( KiB/s): min=15344, max=15888, per=25.13%, avg=15548.44, stdev=186.90, samples=9 00:29:38.553 iops : min= 1918, max= 1986, avg=1943.56, stdev=23.36, samples=9 00:29:38.553 lat (usec) : 1000=0.09% 00:29:38.553 lat (msec) : 2=0.39%, 4=35.99%, 10=63.53% 00:29:38.553 cpu : usr=96.22%, sys=3.30%, ctx=7, majf=0, minf=9 00:29:38.553 IO depths : 1=0.2%, 2=16.6%, 4=56.9%, 8=26.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:38.553 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.553 complete : 0=0.0%, 4=91.3%, 8=8.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.553 issued rwts: total=9731,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.553 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:38.553 filename1: (groupid=0, jobs=1): err= 0: pid=343610: Tue Nov 26 23:22:04 2024 00:29:38.553 read: IOPS=1922, BW=15.0MiB/s (15.7MB/s)(75.1MiB/5002msec) 00:29:38.554 slat (nsec): min=7060, max=62948, avg=19139.03, stdev=8832.53 00:29:38.554 clat (usec): min=639, max=7575, avg=4093.81, stdev=459.66 00:29:38.554 lat (usec): min=650, max=7616, avg=4112.95, stdev=459.64 00:29:38.554 clat percentiles (usec): 00:29:38.554 | 1.00th=[ 2573], 5.00th=[ 3687], 10.00th=[ 3851], 20.00th=[ 3916], 00:29:38.554 | 30.00th=[ 3982], 40.00th=[ 4047], 50.00th=[ 4080], 60.00th=[ 4113], 00:29:38.554 | 70.00th=[ 4178], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4555], 00:29:38.554 | 99.00th=[ 6063], 99.50th=[ 6456], 99.90th=[ 6915], 99.95th=[ 7242], 00:29:38.554 | 99.99th=[ 7570] 00:29:38.554 bw ( KiB/s): min=15168, max=15536, per=24.85%, avg=15378.80, stdev=136.36, samples=10 00:29:38.554 iops : min= 1896, max= 1942, avg=1922.20, stdev=17.05, samples=10 00:29:38.554 lat (usec) : 750=0.01%, 1000=0.09% 00:29:38.554 lat (msec) : 2=0.58%, 4=32.20%, 10=67.12% 00:29:38.554 cpu : usr=94.86%, sys=4.66%, ctx=15, majf=0, minf=9 00:29:38.554 IO depths : 1=0.2%, 2=15.1%, 4=58.0%, 8=26.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:38.554 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.554 complete : 0=0.0%, 4=91.5%, 8=8.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:38.554 issued rwts: total=9616,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:38.554 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:38.554 00:29:38.554 Run status group 0 (all jobs): 00:29:38.554 READ: bw=60.4MiB/s (63.4MB/s), 15.0MiB/s-15.2MiB/s (15.7MB/s-15.9MB/s), io=303MiB (317MB), run=5001-5007msec 00:29:38.812 23:22:04 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:38.812 23:22:04 -- target/dif.sh@43 -- # local sub 00:29:38.812 23:22:04 -- target/dif.sh@45 -- # for sub in "$@" 00:29:38.812 23:22:04 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:38.812 23:22:04 -- target/dif.sh@36 -- # local sub_id=0 00:29:38.812 23:22:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:38.812 23:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.812 23:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:38.812 23:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.812 23:22:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:38.812 23:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.812 23:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:38.812 23:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.812 23:22:04 -- target/dif.sh@45 -- # for sub in "$@" 00:29:38.812 23:22:04 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:38.812 23:22:04 -- target/dif.sh@36 -- # local sub_id=1 00:29:38.812 23:22:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:38.813 23:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.813 23:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:38.813 23:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.813 23:22:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:38.813 23:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.813 23:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:38.813 23:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.813 00:29:38.813 real 0m24.425s 00:29:38.813 user 4m32.649s 00:29:38.813 sys 0m6.047s 00:29:38.813 23:22:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:38.813 23:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:38.813 ************************************ 00:29:38.813 END TEST fio_dif_rand_params 00:29:38.813 ************************************ 00:29:38.813 23:22:05 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:38.813 23:22:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:38.813 23:22:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:38.813 23:22:05 -- common/autotest_common.sh@10 -- # set +x 00:29:38.813 ************************************ 00:29:38.813 START TEST fio_dif_digest 00:29:38.813 ************************************ 00:29:38.813 23:22:05 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:38.813 23:22:05 -- target/dif.sh@123 -- # local NULL_DIF 00:29:38.813 23:22:05 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:38.813 23:22:05 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:38.813 23:22:05 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:38.813 23:22:05 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:38.813 23:22:05 -- target/dif.sh@127 -- # numjobs=3 00:29:38.813 23:22:05 -- target/dif.sh@127 -- # iodepth=3 00:29:38.813 23:22:05 -- target/dif.sh@127 -- # runtime=10 00:29:38.813 23:22:05 -- target/dif.sh@128 -- # hdgst=true 00:29:38.813 23:22:05 -- target/dif.sh@128 -- # ddgst=true 00:29:38.813 23:22:05 -- target/dif.sh@130 -- # create_subsystems 0 00:29:38.813 23:22:05 -- target/dif.sh@28 -- # local sub 00:29:38.813 23:22:05 -- target/dif.sh@30 -- # for sub in "$@" 00:29:38.813 23:22:05 -- target/dif.sh@31 -- # create_subsystem 0 00:29:38.813 23:22:05 -- target/dif.sh@18 -- # local sub_id=0 00:29:38.813 23:22:05 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:38.813 23:22:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.813 23:22:05 -- common/autotest_common.sh@10 -- # set +x 00:29:38.813 bdev_null0 00:29:38.813 23:22:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.813 23:22:05 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:38.813 23:22:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.813 23:22:05 -- common/autotest_common.sh@10 -- # set +x 00:29:38.813 23:22:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.813 23:22:05 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:38.813 23:22:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.813 23:22:05 -- common/autotest_common.sh@10 -- # set +x 00:29:38.813 23:22:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.813 23:22:05 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:38.813 23:22:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.813 23:22:05 -- common/autotest_common.sh@10 -- # set +x 00:29:38.813 [2024-11-26 23:22:05.039417] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:38.813 23:22:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.813 23:22:05 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:38.813 23:22:05 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:38.813 23:22:05 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:38.813 23:22:05 -- nvmf/common.sh@520 -- # config=() 00:29:38.813 23:22:05 -- nvmf/common.sh@520 -- # local subsystem config 00:29:38.813 23:22:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:38.813 23:22:05 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:38.813 23:22:05 -- target/dif.sh@82 -- # gen_fio_conf 00:29:38.813 23:22:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:38.813 { 00:29:38.813 "params": { 00:29:38.813 "name": "Nvme$subsystem", 00:29:38.813 "trtype": "$TEST_TRANSPORT", 00:29:38.813 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:38.813 "adrfam": "ipv4", 00:29:38.813 "trsvcid": "$NVMF_PORT", 00:29:38.813 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:38.813 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:38.813 "hdgst": ${hdgst:-false}, 00:29:38.813 "ddgst": ${ddgst:-false} 00:29:38.813 }, 00:29:38.813 "method": "bdev_nvme_attach_controller" 00:29:38.813 } 00:29:38.813 EOF 00:29:38.813 )") 00:29:38.813 23:22:05 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:38.813 23:22:05 -- target/dif.sh@54 -- # local file 00:29:38.813 23:22:05 -- target/dif.sh@56 -- # cat 00:29:38.813 23:22:05 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:38.813 23:22:05 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:38.813 23:22:05 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:38.813 23:22:05 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:38.813 23:22:05 -- common/autotest_common.sh@1330 -- # shift 00:29:38.813 23:22:05 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:38.813 23:22:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:38.813 23:22:05 -- nvmf/common.sh@542 -- # cat 00:29:38.813 23:22:05 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:38.813 23:22:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:38.813 23:22:05 -- target/dif.sh@72 -- # (( file <= files )) 00:29:38.813 23:22:05 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:38.813 23:22:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:38.813 23:22:05 -- nvmf/common.sh@544 -- # jq . 00:29:38.813 23:22:05 -- nvmf/common.sh@545 -- # IFS=, 00:29:38.813 23:22:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:38.813 "params": { 00:29:38.813 "name": "Nvme0", 00:29:38.813 "trtype": "tcp", 00:29:38.813 "traddr": "10.0.0.2", 00:29:38.813 "adrfam": "ipv4", 00:29:38.813 "trsvcid": "4420", 00:29:38.813 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:38.813 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:38.813 "hdgst": true, 00:29:38.813 "ddgst": true 00:29:38.813 }, 00:29:38.813 "method": "bdev_nvme_attach_controller" 00:29:38.813 }' 00:29:38.813 23:22:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:38.813 23:22:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:38.813 23:22:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:38.813 23:22:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:38.813 23:22:05 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:38.813 23:22:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:38.813 23:22:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:38.813 23:22:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:38.813 23:22:05 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:38.813 23:22:05 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:39.073 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:39.073 ... 00:29:39.073 fio-3.35 00:29:39.073 Starting 3 threads 00:29:39.073 EAL: No free 2048 kB hugepages reported on node 1 00:29:39.642 [2024-11-26 23:22:05.759228] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:39.642 [2024-11-26 23:22:05.759312] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:49.612 00:29:49.612 filename0: (groupid=0, jobs=1): err= 0: pid=344379: Tue Nov 26 23:22:15 2024 00:29:49.612 read: IOPS=216, BW=27.0MiB/s (28.3MB/s)(271MiB/10045msec) 00:29:49.612 slat (nsec): min=4880, max=48886, avg=14003.75, stdev=4824.46 00:29:49.612 clat (usec): min=9467, max=55842, avg=13843.38, stdev=3389.07 00:29:49.612 lat (usec): min=9494, max=55849, avg=13857.38, stdev=3389.07 00:29:49.612 clat percentiles (usec): 00:29:49.613 | 1.00th=[10945], 5.00th=[11731], 10.00th=[12125], 20.00th=[12649], 00:29:49.613 | 30.00th=[13042], 40.00th=[13304], 50.00th=[13566], 60.00th=[13960], 00:29:49.613 | 70.00th=[14222], 80.00th=[14484], 90.00th=[14877], 95.00th=[15270], 00:29:49.613 | 99.00th=[16712], 99.50th=[53216], 99.90th=[54264], 99.95th=[54789], 00:29:49.613 | 99.99th=[55837] 00:29:49.613 bw ( KiB/s): min=24576, max=29696, per=37.88%, avg=27763.20, stdev=1353.29, samples=20 00:29:49.613 iops : min= 192, max= 232, avg=216.90, stdev=10.57, samples=20 00:29:49.613 lat (msec) : 10=0.09%, 20=99.26%, 50=0.05%, 100=0.60% 00:29:49.613 cpu : usr=92.82%, sys=6.68%, ctx=14, majf=0, minf=164 00:29:49.613 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:49.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.613 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.613 issued rwts: total=2171,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:49.613 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:49.613 filename0: (groupid=0, jobs=1): err= 0: pid=344380: Tue Nov 26 23:22:15 2024 00:29:49.613 read: IOPS=177, BW=22.2MiB/s (23.2MB/s)(223MiB/10045msec) 00:29:49.613 slat (nsec): min=4609, max=60984, avg=15871.82, stdev=5665.52 00:29:49.613 clat (usec): min=9096, max=54736, avg=16875.45, stdev=2089.97 00:29:49.613 lat (usec): min=9108, max=54755, avg=16891.32, stdev=2089.28 00:29:49.613 clat percentiles (usec): 00:29:49.613 | 1.00th=[10421], 5.00th=[14484], 10.00th=[15139], 20.00th=[15664], 00:29:49.613 | 30.00th=[16057], 40.00th=[16450], 50.00th=[16909], 60.00th=[17171], 00:29:49.613 | 70.00th=[17695], 80.00th=[18220], 90.00th=[18744], 95.00th=[19530], 00:29:49.613 | 99.00th=[20841], 99.50th=[21365], 99.90th=[47973], 99.95th=[54789], 00:29:49.613 | 99.99th=[54789] 00:29:49.613 bw ( KiB/s): min=20480, max=24320, per=31.07%, avg=22771.20, stdev=973.85, samples=20 00:29:49.613 iops : min= 160, max= 190, avg=177.90, stdev= 7.61, samples=20 00:29:49.613 lat (msec) : 10=0.28%, 20=96.41%, 50=3.26%, 100=0.06% 00:29:49.613 cpu : usr=92.73%, sys=6.40%, ctx=115, majf=0, minf=196 00:29:49.613 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:49.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.613 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.613 issued rwts: total=1781,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:49.613 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:49.613 filename0: (groupid=0, jobs=1): err= 0: pid=344381: Tue Nov 26 23:22:15 2024 00:29:49.613 read: IOPS=179, BW=22.5MiB/s (23.6MB/s)(225MiB/10004msec) 00:29:49.613 slat (nsec): min=7084, max=41143, avg=13860.87, stdev=3765.16 00:29:49.613 clat (usec): min=8699, max=60697, avg=16655.60, stdev=2462.12 00:29:49.613 lat (usec): min=8711, max=60711, avg=16669.46, stdev=2462.07 00:29:49.613 clat percentiles (usec): 00:29:49.613 | 1.00th=[10028], 5.00th=[14091], 10.00th=[14746], 20.00th=[15401], 00:29:49.613 | 30.00th=[15795], 40.00th=[16319], 50.00th=[16581], 60.00th=[16909], 00:29:49.613 | 70.00th=[17433], 80.00th=[17957], 90.00th=[18744], 95.00th=[19268], 00:29:49.613 | 99.00th=[20841], 99.50th=[21365], 99.90th=[57410], 99.95th=[60556], 00:29:49.613 | 99.99th=[60556] 00:29:49.613 bw ( KiB/s): min=19200, max=24832, per=31.40%, avg=23016.60, stdev=1388.36, samples=20 00:29:49.613 iops : min= 150, max= 194, avg=179.80, stdev=10.86, samples=20 00:29:49.613 lat (msec) : 10=0.61%, 20=96.50%, 50=2.72%, 100=0.17% 00:29:49.613 cpu : usr=93.49%, sys=6.03%, ctx=19, majf=0, minf=126 00:29:49.613 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:49.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.613 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.613 issued rwts: total=1800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:49.613 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:49.613 00:29:49.613 Run status group 0 (all jobs): 00:29:49.613 READ: bw=71.6MiB/s (75.1MB/s), 22.2MiB/s-27.0MiB/s (23.2MB/s-28.3MB/s), io=719MiB (754MB), run=10004-10045msec 00:29:49.871 23:22:16 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:49.871 23:22:16 -- target/dif.sh@43 -- # local sub 00:29:49.871 23:22:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:49.871 23:22:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:49.871 23:22:16 -- target/dif.sh@36 -- # local sub_id=0 00:29:49.871 23:22:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:49.871 23:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.871 23:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:49.871 23:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.871 23:22:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:49.871 23:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.871 23:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:49.871 23:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.871 00:29:49.871 real 0m11.230s 00:29:49.871 user 0m29.207s 00:29:49.871 sys 0m2.165s 00:29:49.871 23:22:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:49.871 23:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:49.871 ************************************ 00:29:49.871 END TEST fio_dif_digest 00:29:49.871 ************************************ 00:29:49.871 23:22:16 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:49.871 23:22:16 -- target/dif.sh@147 -- # nvmftestfini 00:29:49.871 23:22:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:50.131 23:22:16 -- nvmf/common.sh@116 -- # sync 00:29:50.131 23:22:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:50.131 23:22:16 -- nvmf/common.sh@119 -- # set +e 00:29:50.131 23:22:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:50.131 23:22:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:50.131 rmmod nvme_tcp 00:29:50.131 rmmod nvme_fabrics 00:29:50.131 rmmod nvme_keyring 00:29:50.131 23:22:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:50.131 23:22:16 -- nvmf/common.sh@123 -- # set -e 00:29:50.131 23:22:16 -- nvmf/common.sh@124 -- # return 0 00:29:50.131 23:22:16 -- nvmf/common.sh@477 -- # '[' -n 338151 ']' 00:29:50.131 23:22:16 -- nvmf/common.sh@478 -- # killprocess 338151 00:29:50.131 23:22:16 -- common/autotest_common.sh@936 -- # '[' -z 338151 ']' 00:29:50.131 23:22:16 -- common/autotest_common.sh@940 -- # kill -0 338151 00:29:50.131 23:22:16 -- common/autotest_common.sh@941 -- # uname 00:29:50.131 23:22:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:50.131 23:22:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 338151 00:29:50.131 23:22:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:50.131 23:22:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:50.131 23:22:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 338151' 00:29:50.131 killing process with pid 338151 00:29:50.131 23:22:16 -- common/autotest_common.sh@955 -- # kill 338151 00:29:50.131 23:22:16 -- common/autotest_common.sh@960 -- # wait 338151 00:29:50.389 23:22:16 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:50.389 23:22:16 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:51.323 Waiting for block devices as requested 00:29:51.323 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:51.582 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:51.582 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:51.841 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:51.841 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:51.841 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:51.841 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:51.841 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:52.099 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:52.099 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:52.099 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:52.099 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:52.357 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:52.358 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:52.358 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:52.358 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:52.615 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:52.615 23:22:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:52.615 23:22:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:52.615 23:22:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:52.615 23:22:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:52.615 23:22:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:52.615 23:22:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:52.615 23:22:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:55.145 23:22:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:55.145 00:29:55.145 real 1m7.543s 00:29:55.145 user 6m29.110s 00:29:55.145 sys 0m17.985s 00:29:55.145 23:22:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:55.145 23:22:20 -- common/autotest_common.sh@10 -- # set +x 00:29:55.145 ************************************ 00:29:55.145 END TEST nvmf_dif 00:29:55.145 ************************************ 00:29:55.145 23:22:20 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:55.145 23:22:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:55.145 23:22:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:55.145 23:22:20 -- common/autotest_common.sh@10 -- # set +x 00:29:55.145 ************************************ 00:29:55.145 START TEST nvmf_abort_qd_sizes 00:29:55.145 ************************************ 00:29:55.145 23:22:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:55.145 * Looking for test storage... 00:29:55.145 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:55.145 23:22:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:55.145 23:22:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:55.145 23:22:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:55.145 23:22:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:55.145 23:22:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:55.145 23:22:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:55.145 23:22:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:55.145 23:22:21 -- scripts/common.sh@335 -- # IFS=.-: 00:29:55.145 23:22:21 -- scripts/common.sh@335 -- # read -ra ver1 00:29:55.145 23:22:21 -- scripts/common.sh@336 -- # IFS=.-: 00:29:55.145 23:22:21 -- scripts/common.sh@336 -- # read -ra ver2 00:29:55.145 23:22:21 -- scripts/common.sh@337 -- # local 'op=<' 00:29:55.145 23:22:21 -- scripts/common.sh@339 -- # ver1_l=2 00:29:55.145 23:22:21 -- scripts/common.sh@340 -- # ver2_l=1 00:29:55.145 23:22:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:55.145 23:22:21 -- scripts/common.sh@343 -- # case "$op" in 00:29:55.145 23:22:21 -- scripts/common.sh@344 -- # : 1 00:29:55.145 23:22:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:55.145 23:22:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:55.145 23:22:21 -- scripts/common.sh@364 -- # decimal 1 00:29:55.145 23:22:21 -- scripts/common.sh@352 -- # local d=1 00:29:55.145 23:22:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:55.145 23:22:21 -- scripts/common.sh@354 -- # echo 1 00:29:55.145 23:22:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:55.145 23:22:21 -- scripts/common.sh@365 -- # decimal 2 00:29:55.145 23:22:21 -- scripts/common.sh@352 -- # local d=2 00:29:55.145 23:22:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:55.145 23:22:21 -- scripts/common.sh@354 -- # echo 2 00:29:55.145 23:22:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:55.145 23:22:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:55.145 23:22:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:55.146 23:22:21 -- scripts/common.sh@367 -- # return 0 00:29:55.146 23:22:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:55.146 23:22:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:55.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:55.146 --rc genhtml_branch_coverage=1 00:29:55.146 --rc genhtml_function_coverage=1 00:29:55.146 --rc genhtml_legend=1 00:29:55.146 --rc geninfo_all_blocks=1 00:29:55.146 --rc geninfo_unexecuted_blocks=1 00:29:55.146 00:29:55.146 ' 00:29:55.146 23:22:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:55.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:55.146 --rc genhtml_branch_coverage=1 00:29:55.146 --rc genhtml_function_coverage=1 00:29:55.146 --rc genhtml_legend=1 00:29:55.146 --rc geninfo_all_blocks=1 00:29:55.146 --rc geninfo_unexecuted_blocks=1 00:29:55.146 00:29:55.146 ' 00:29:55.146 23:22:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:55.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:55.146 --rc genhtml_branch_coverage=1 00:29:55.146 --rc genhtml_function_coverage=1 00:29:55.146 --rc genhtml_legend=1 00:29:55.146 --rc geninfo_all_blocks=1 00:29:55.146 --rc geninfo_unexecuted_blocks=1 00:29:55.146 00:29:55.146 ' 00:29:55.146 23:22:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:55.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:55.146 --rc genhtml_branch_coverage=1 00:29:55.146 --rc genhtml_function_coverage=1 00:29:55.146 --rc genhtml_legend=1 00:29:55.146 --rc geninfo_all_blocks=1 00:29:55.146 --rc geninfo_unexecuted_blocks=1 00:29:55.146 00:29:55.146 ' 00:29:55.146 23:22:21 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:55.146 23:22:21 -- nvmf/common.sh@7 -- # uname -s 00:29:55.146 23:22:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:55.146 23:22:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:55.146 23:22:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:55.146 23:22:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:55.146 23:22:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:55.146 23:22:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:55.146 23:22:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:55.146 23:22:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:55.146 23:22:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:55.146 23:22:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:55.146 23:22:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:55.146 23:22:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:55.146 23:22:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:55.146 23:22:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:55.146 23:22:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:55.146 23:22:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:55.146 23:22:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:55.146 23:22:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:55.146 23:22:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:55.146 23:22:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.146 23:22:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.146 23:22:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.146 23:22:21 -- paths/export.sh@5 -- # export PATH 00:29:55.146 23:22:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.146 23:22:21 -- nvmf/common.sh@46 -- # : 0 00:29:55.146 23:22:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:55.146 23:22:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:55.146 23:22:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:55.146 23:22:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:55.146 23:22:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:55.146 23:22:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:55.146 23:22:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:55.146 23:22:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:55.146 23:22:21 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:55.146 23:22:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:55.146 23:22:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:55.146 23:22:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:55.146 23:22:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:55.146 23:22:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:55.146 23:22:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:55.146 23:22:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:55.146 23:22:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:55.146 23:22:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:55.146 23:22:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:55.146 23:22:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:55.146 23:22:21 -- common/autotest_common.sh@10 -- # set +x 00:29:57.049 23:22:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:57.049 23:22:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:57.049 23:22:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:57.049 23:22:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:57.049 23:22:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:57.049 23:22:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:57.049 23:22:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:57.049 23:22:23 -- nvmf/common.sh@294 -- # net_devs=() 00:29:57.049 23:22:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:57.049 23:22:23 -- nvmf/common.sh@295 -- # e810=() 00:29:57.049 23:22:23 -- nvmf/common.sh@295 -- # local -ga e810 00:29:57.049 23:22:23 -- nvmf/common.sh@296 -- # x722=() 00:29:57.049 23:22:23 -- nvmf/common.sh@296 -- # local -ga x722 00:29:57.049 23:22:23 -- nvmf/common.sh@297 -- # mlx=() 00:29:57.049 23:22:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:57.049 23:22:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:57.049 23:22:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:57.049 23:22:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:57.049 23:22:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:57.049 23:22:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:57.049 23:22:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:57.049 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:57.049 23:22:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:57.049 23:22:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:57.049 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:57.049 23:22:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:57.049 23:22:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:57.049 23:22:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:57.049 23:22:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:57.049 23:22:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:57.049 23:22:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:57.049 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:57.049 23:22:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:57.049 23:22:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:57.049 23:22:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:57.049 23:22:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:57.049 23:22:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:57.049 23:22:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:57.049 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:57.049 23:22:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:57.049 23:22:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:57.049 23:22:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:57.049 23:22:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:57.049 23:22:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:57.049 23:22:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:57.049 23:22:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:57.049 23:22:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:57.049 23:22:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:57.049 23:22:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:57.050 23:22:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:57.050 23:22:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:57.050 23:22:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:57.050 23:22:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:57.050 23:22:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:57.050 23:22:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:57.050 23:22:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:57.050 23:22:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:57.050 23:22:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:57.050 23:22:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:57.050 23:22:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:57.050 23:22:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:57.050 23:22:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:57.050 23:22:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:57.050 23:22:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:57.050 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:57.050 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:29:57.050 00:29:57.050 --- 10.0.0.2 ping statistics --- 00:29:57.050 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:57.050 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:29:57.050 23:22:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:57.050 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:57.050 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:29:57.050 00:29:57.050 --- 10.0.0.1 ping statistics --- 00:29:57.050 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:57.050 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:29:57.050 23:22:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:57.050 23:22:23 -- nvmf/common.sh@410 -- # return 0 00:29:57.050 23:22:23 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:57.050 23:22:23 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:58.424 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:58.424 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:58.424 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:58.424 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:58.424 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:58.424 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:58.424 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:58.424 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:58.424 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:58.424 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:58.424 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:58.424 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:58.424 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:58.424 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:58.424 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:58.424 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:59.358 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:59.358 23:22:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:59.358 23:22:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:59.358 23:22:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:59.358 23:22:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:59.358 23:22:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:59.358 23:22:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:59.358 23:22:25 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:59.358 23:22:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:59.358 23:22:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:59.358 23:22:25 -- common/autotest_common.sh@10 -- # set +x 00:29:59.358 23:22:25 -- nvmf/common.sh@469 -- # nvmfpid=349403 00:29:59.358 23:22:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:59.358 23:22:25 -- nvmf/common.sh@470 -- # waitforlisten 349403 00:29:59.358 23:22:25 -- common/autotest_common.sh@829 -- # '[' -z 349403 ']' 00:29:59.358 23:22:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:59.358 23:22:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:59.358 23:22:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:59.358 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:59.358 23:22:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:59.358 23:22:25 -- common/autotest_common.sh@10 -- # set +x 00:29:59.358 [2024-11-26 23:22:25.699062] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:59.358 [2024-11-26 23:22:25.699138] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:59.358 EAL: No free 2048 kB hugepages reported on node 1 00:29:59.617 [2024-11-26 23:22:25.763968] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:59.617 [2024-11-26 23:22:25.876185] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:59.617 [2024-11-26 23:22:25.876346] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:59.617 [2024-11-26 23:22:25.876363] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:59.617 [2024-11-26 23:22:25.876375] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:59.617 [2024-11-26 23:22:25.876428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:59.617 [2024-11-26 23:22:25.876488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:59.617 [2024-11-26 23:22:25.876557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:59.617 [2024-11-26 23:22:25.876561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:00.550 23:22:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:00.550 23:22:26 -- common/autotest_common.sh@862 -- # return 0 00:30:00.550 23:22:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:00.550 23:22:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:00.550 23:22:26 -- common/autotest_common.sh@10 -- # set +x 00:30:00.550 23:22:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:00.550 23:22:26 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:30:00.550 23:22:26 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:30:00.550 23:22:26 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:30:00.550 23:22:26 -- scripts/common.sh@311 -- # local bdf bdfs 00:30:00.550 23:22:26 -- scripts/common.sh@312 -- # local nvmes 00:30:00.550 23:22:26 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:30:00.550 23:22:26 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:30:00.550 23:22:26 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:30:00.550 23:22:26 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:30:00.550 23:22:26 -- scripts/common.sh@322 -- # uname -s 00:30:00.550 23:22:26 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:30:00.550 23:22:26 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:30:00.550 23:22:26 -- scripts/common.sh@327 -- # (( 1 )) 00:30:00.550 23:22:26 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:30:00.550 23:22:26 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:30:00.550 23:22:26 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:30:00.550 23:22:26 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:30:00.550 23:22:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:00.551 23:22:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:00.551 23:22:26 -- common/autotest_common.sh@10 -- # set +x 00:30:00.551 ************************************ 00:30:00.551 START TEST spdk_target_abort 00:30:00.551 ************************************ 00:30:00.551 23:22:26 -- common/autotest_common.sh@1114 -- # spdk_target 00:30:00.551 23:22:26 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:30:00.551 23:22:26 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:00.551 23:22:26 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:30:00.551 23:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.551 23:22:26 -- common/autotest_common.sh@10 -- # set +x 00:30:03.830 spdk_targetn1 00:30:03.830 23:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:03.830 23:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:03.830 23:22:29 -- common/autotest_common.sh@10 -- # set +x 00:30:03.830 [2024-11-26 23:22:29.553928] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:03.830 23:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:30:03.830 23:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:03.830 23:22:29 -- common/autotest_common.sh@10 -- # set +x 00:30:03.830 23:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:30:03.830 23:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:03.830 23:22:29 -- common/autotest_common.sh@10 -- # set +x 00:30:03.830 23:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:30:03.830 23:22:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:03.830 23:22:29 -- common/autotest_common.sh@10 -- # set +x 00:30:03.830 [2024-11-26 23:22:29.586210] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:03.830 23:22:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:03.830 23:22:29 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:03.830 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.111 Initializing NVMe Controllers 00:30:07.111 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:07.111 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:07.111 Initialization complete. Launching workers. 00:30:07.111 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 13187, failed: 0 00:30:07.111 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1272, failed to submit 11915 00:30:07.111 success 725, unsuccess 547, failed 0 00:30:07.111 23:22:32 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:07.111 23:22:32 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:07.111 EAL: No free 2048 kB hugepages reported on node 1 00:30:09.638 [2024-11-26 23:22:35.952556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10d35e0 is same with the state(5) to be set 00:30:09.897 Initializing NVMe Controllers 00:30:09.897 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:09.897 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:09.897 Initialization complete. Launching workers. 00:30:09.897 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8692, failed: 0 00:30:09.897 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1247, failed to submit 7445 00:30:09.897 success 305, unsuccess 942, failed 0 00:30:09.897 23:22:36 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:09.897 23:22:36 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:09.897 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.179 Initializing NVMe Controllers 00:30:13.179 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:13.179 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:13.179 Initialization complete. Launching workers. 00:30:13.179 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32048, failed: 0 00:30:13.179 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2736, failed to submit 29312 00:30:13.179 success 532, unsuccess 2204, failed 0 00:30:13.179 23:22:39 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:13.179 23:22:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:13.179 23:22:39 -- common/autotest_common.sh@10 -- # set +x 00:30:13.179 23:22:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:13.179 23:22:39 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:13.179 23:22:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:13.179 23:22:39 -- common/autotest_common.sh@10 -- # set +x 00:30:14.555 23:22:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.555 23:22:40 -- target/abort_qd_sizes.sh@62 -- # killprocess 349403 00:30:14.555 23:22:40 -- common/autotest_common.sh@936 -- # '[' -z 349403 ']' 00:30:14.555 23:22:40 -- common/autotest_common.sh@940 -- # kill -0 349403 00:30:14.555 23:22:40 -- common/autotest_common.sh@941 -- # uname 00:30:14.555 23:22:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:14.555 23:22:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 349403 00:30:14.555 23:22:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:14.555 23:22:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:14.555 23:22:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 349403' 00:30:14.555 killing process with pid 349403 00:30:14.555 23:22:40 -- common/autotest_common.sh@955 -- # kill 349403 00:30:14.555 23:22:40 -- common/autotest_common.sh@960 -- # wait 349403 00:30:14.555 00:30:14.555 real 0m14.218s 00:30:14.555 user 0m56.203s 00:30:14.555 sys 0m2.643s 00:30:14.555 23:22:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:14.555 23:22:40 -- common/autotest_common.sh@10 -- # set +x 00:30:14.555 ************************************ 00:30:14.555 END TEST spdk_target_abort 00:30:14.555 ************************************ 00:30:14.814 23:22:40 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:14.814 23:22:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:14.814 23:22:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:14.814 23:22:40 -- common/autotest_common.sh@10 -- # set +x 00:30:14.814 ************************************ 00:30:14.814 START TEST kernel_target_abort 00:30:14.814 ************************************ 00:30:14.814 23:22:40 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:14.814 23:22:40 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:14.814 23:22:40 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:14.814 23:22:40 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:14.814 23:22:40 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:14.814 23:22:40 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:14.814 23:22:40 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:14.814 23:22:40 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:14.814 23:22:40 -- nvmf/common.sh@627 -- # local block nvme 00:30:14.814 23:22:40 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:14.814 23:22:40 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:14.814 23:22:40 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:14.814 23:22:40 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:15.750 Waiting for block devices as requested 00:30:15.750 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:16.009 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:16.009 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:16.268 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:16.268 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:16.268 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:16.268 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:16.527 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:16.527 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:16.527 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:16.527 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:16.785 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:16.785 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:16.785 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:16.785 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:17.043 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:17.043 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:17.302 23:22:43 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:17.302 23:22:43 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:17.302 23:22:43 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:17.302 23:22:43 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:17.302 23:22:43 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:17.302 No valid GPT data, bailing 00:30:17.302 23:22:43 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:17.302 23:22:43 -- scripts/common.sh@393 -- # pt= 00:30:17.302 23:22:43 -- scripts/common.sh@394 -- # return 1 00:30:17.302 23:22:43 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:17.302 23:22:43 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:17.302 23:22:43 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:17.302 23:22:43 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:17.302 23:22:43 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:17.302 23:22:43 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:17.302 23:22:43 -- nvmf/common.sh@654 -- # echo 1 00:30:17.302 23:22:43 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:17.302 23:22:43 -- nvmf/common.sh@656 -- # echo 1 00:30:17.302 23:22:43 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:17.302 23:22:43 -- nvmf/common.sh@663 -- # echo tcp 00:30:17.302 23:22:43 -- nvmf/common.sh@664 -- # echo 4420 00:30:17.302 23:22:43 -- nvmf/common.sh@665 -- # echo ipv4 00:30:17.302 23:22:43 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:17.302 23:22:43 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:17.302 00:30:17.302 Discovery Log Number of Records 2, Generation counter 2 00:30:17.302 =====Discovery Log Entry 0====== 00:30:17.302 trtype: tcp 00:30:17.302 adrfam: ipv4 00:30:17.302 subtype: current discovery subsystem 00:30:17.302 treq: not specified, sq flow control disable supported 00:30:17.302 portid: 1 00:30:17.302 trsvcid: 4420 00:30:17.302 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:17.302 traddr: 10.0.0.1 00:30:17.302 eflags: none 00:30:17.302 sectype: none 00:30:17.302 =====Discovery Log Entry 1====== 00:30:17.302 trtype: tcp 00:30:17.302 adrfam: ipv4 00:30:17.302 subtype: nvme subsystem 00:30:17.302 treq: not specified, sq flow control disable supported 00:30:17.302 portid: 1 00:30:17.302 trsvcid: 4420 00:30:17.302 subnqn: kernel_target 00:30:17.302 traddr: 10.0.0.1 00:30:17.302 eflags: none 00:30:17.302 sectype: none 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:17.302 23:22:43 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:17.302 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.584 Initializing NVMe Controllers 00:30:20.584 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:20.584 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:20.584 Initialization complete. Launching workers. 00:30:20.584 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 47585, failed: 0 00:30:20.584 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 47585, failed to submit 0 00:30:20.584 success 0, unsuccess 47585, failed 0 00:30:20.584 23:22:46 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:20.584 23:22:46 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:20.584 EAL: No free 2048 kB hugepages reported on node 1 00:30:24.130 Initializing NVMe Controllers 00:30:24.130 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:24.130 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:24.130 Initialization complete. Launching workers. 00:30:24.130 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 82968, failed: 0 00:30:24.130 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20910, failed to submit 62058 00:30:24.130 success 0, unsuccess 20910, failed 0 00:30:24.130 23:22:49 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:24.130 23:22:49 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:24.130 EAL: No free 2048 kB hugepages reported on node 1 00:30:26.660 Initializing NVMe Controllers 00:30:26.660 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:26.660 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:26.660 Initialization complete. Launching workers. 00:30:26.660 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 80624, failed: 0 00:30:26.660 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20126, failed to submit 60498 00:30:26.660 success 0, unsuccess 20126, failed 0 00:30:26.660 23:22:52 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:26.660 23:22:52 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:26.660 23:22:52 -- nvmf/common.sh@677 -- # echo 0 00:30:26.660 23:22:52 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:26.660 23:22:52 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:26.660 23:22:52 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:26.660 23:22:52 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:26.660 23:22:52 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:26.660 23:22:52 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:26.660 00:30:26.660 real 0m12.015s 00:30:26.660 user 0m5.993s 00:30:26.660 sys 0m2.359s 00:30:26.660 23:22:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:26.660 23:22:52 -- common/autotest_common.sh@10 -- # set +x 00:30:26.660 ************************************ 00:30:26.660 END TEST kernel_target_abort 00:30:26.660 ************************************ 00:30:26.660 23:22:52 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:26.660 23:22:52 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:26.660 23:22:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:26.660 23:22:52 -- nvmf/common.sh@116 -- # sync 00:30:26.660 23:22:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:26.660 23:22:53 -- nvmf/common.sh@119 -- # set +e 00:30:26.660 23:22:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:26.660 23:22:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:26.660 rmmod nvme_tcp 00:30:26.660 rmmod nvme_fabrics 00:30:26.660 rmmod nvme_keyring 00:30:26.660 23:22:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:26.660 23:22:53 -- nvmf/common.sh@123 -- # set -e 00:30:26.660 23:22:53 -- nvmf/common.sh@124 -- # return 0 00:30:26.660 23:22:53 -- nvmf/common.sh@477 -- # '[' -n 349403 ']' 00:30:26.660 23:22:53 -- nvmf/common.sh@478 -- # killprocess 349403 00:30:26.660 23:22:53 -- common/autotest_common.sh@936 -- # '[' -z 349403 ']' 00:30:26.660 23:22:53 -- common/autotest_common.sh@940 -- # kill -0 349403 00:30:26.660 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (349403) - No such process 00:30:26.660 23:22:53 -- common/autotest_common.sh@963 -- # echo 'Process with pid 349403 is not found' 00:30:26.660 Process with pid 349403 is not found 00:30:26.661 23:22:53 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:26.661 23:22:53 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:28.035 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:28.035 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:28.035 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:28.035 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:28.035 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:28.035 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:28.035 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:28.035 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:28.035 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:28.035 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:28.035 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:28.035 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:28.035 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:28.035 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:28.294 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:28.294 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:28.294 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:28.294 23:22:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:28.294 23:22:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:28.294 23:22:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:28.294 23:22:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:28.294 23:22:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:28.294 23:22:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:28.294 23:22:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:30.826 23:22:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:30.826 00:30:30.826 real 0m35.638s 00:30:30.826 user 1m4.677s 00:30:30.826 sys 0m8.517s 00:30:30.826 23:22:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:30.826 23:22:56 -- common/autotest_common.sh@10 -- # set +x 00:30:30.826 ************************************ 00:30:30.826 END TEST nvmf_abort_qd_sizes 00:30:30.826 ************************************ 00:30:30.826 23:22:56 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:30.826 23:22:56 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:30.826 23:22:56 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:30.826 23:22:56 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:30.826 23:22:56 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:30.826 23:22:56 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:30.826 23:22:56 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:30.826 23:22:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:30.826 23:22:56 -- common/autotest_common.sh@10 -- # set +x 00:30:30.826 23:22:56 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:30.826 23:22:56 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:30.826 23:22:56 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:30.826 23:22:56 -- common/autotest_common.sh@10 -- # set +x 00:30:32.200 INFO: APP EXITING 00:30:32.200 INFO: killing all VMs 00:30:32.200 INFO: killing vhost app 00:30:32.200 INFO: EXIT DONE 00:30:33.134 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:33.134 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:33.134 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:33.134 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:33.393 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:33.393 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:33.393 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:33.393 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:33.393 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:33.393 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:33.393 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:33.393 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:33.393 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:33.393 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:33.393 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:33.393 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:33.393 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:34.767 Cleaning 00:30:34.767 Removing: /var/run/dpdk/spdk0/config 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:34.767 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:34.767 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:34.767 Removing: /var/run/dpdk/spdk1/config 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:34.767 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:34.767 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:34.767 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:34.767 Removing: /var/run/dpdk/spdk2/config 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:34.767 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:34.767 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:34.767 Removing: /var/run/dpdk/spdk3/config 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:34.767 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:34.767 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:34.767 Removing: /var/run/dpdk/spdk4/config 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:34.767 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:34.767 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:34.767 Removing: /dev/shm/bdev_svc_trace.1 00:30:34.767 Removing: /dev/shm/nvmf_trace.0 00:30:34.767 Removing: /dev/shm/spdk_tgt_trace.pid79827 00:30:34.767 Removing: /var/run/dpdk/spdk0 00:30:34.767 Removing: /var/run/dpdk/spdk1 00:30:34.767 Removing: /var/run/dpdk/spdk2 00:30:34.767 Removing: /var/run/dpdk/spdk3 00:30:34.767 Removing: /var/run/dpdk/spdk4 00:30:34.767 Removing: /var/run/dpdk/spdk_pid101821 00:30:34.767 Removing: /var/run/dpdk/spdk_pid158977 00:30:34.767 Removing: /var/run/dpdk/spdk_pid161648 00:30:34.767 Removing: /var/run/dpdk/spdk_pid168783 00:30:34.767 Removing: /var/run/dpdk/spdk_pid172893 00:30:34.767 Removing: /var/run/dpdk/spdk_pid175292 00:30:34.767 Removing: /var/run/dpdk/spdk_pid175714 00:30:34.767 Removing: /var/run/dpdk/spdk_pid180935 00:30:34.767 Removing: /var/run/dpdk/spdk_pid181223 00:30:34.767 Removing: /var/run/dpdk/spdk_pid183903 00:30:34.767 Removing: /var/run/dpdk/spdk_pid187806 00:30:34.767 Removing: /var/run/dpdk/spdk_pid189922 00:30:34.767 Removing: /var/run/dpdk/spdk_pid196774 00:30:34.767 Removing: /var/run/dpdk/spdk_pid202236 00:30:34.767 Removing: /var/run/dpdk/spdk_pid203503 00:30:34.767 Removing: /var/run/dpdk/spdk_pid204261 00:30:34.767 Removing: /var/run/dpdk/spdk_pid215572 00:30:35.025 Removing: /var/run/dpdk/spdk_pid217820 00:30:35.025 Removing: /var/run/dpdk/spdk_pid220780 00:30:35.025 Removing: /var/run/dpdk/spdk_pid222002 00:30:35.025 Removing: /var/run/dpdk/spdk_pid223242 00:30:35.025 Removing: /var/run/dpdk/spdk_pid223510 00:30:35.025 Removing: /var/run/dpdk/spdk_pid223666 00:30:35.025 Removing: /var/run/dpdk/spdk_pid223934 00:30:35.025 Removing: /var/run/dpdk/spdk_pid224533 00:30:35.025 Removing: /var/run/dpdk/spdk_pid225903 00:30:35.025 Removing: /var/run/dpdk/spdk_pid226923 00:30:35.025 Removing: /var/run/dpdk/spdk_pid227374 00:30:35.025 Removing: /var/run/dpdk/spdk_pid231002 00:30:35.025 Removing: /var/run/dpdk/spdk_pid234598 00:30:35.025 Removing: /var/run/dpdk/spdk_pid238250 00:30:35.025 Removing: /var/run/dpdk/spdk_pid262834 00:30:35.025 Removing: /var/run/dpdk/spdk_pid265683 00:30:35.025 Removing: /var/run/dpdk/spdk_pid269751 00:30:35.025 Removing: /var/run/dpdk/spdk_pid271235 00:30:35.025 Removing: /var/run/dpdk/spdk_pid272481 00:30:35.025 Removing: /var/run/dpdk/spdk_pid275207 00:30:35.025 Removing: /var/run/dpdk/spdk_pid277698 00:30:35.025 Removing: /var/run/dpdk/spdk_pid282147 00:30:35.025 Removing: /var/run/dpdk/spdk_pid282150 00:30:35.025 Removing: /var/run/dpdk/spdk_pid285094 00:30:35.025 Removing: /var/run/dpdk/spdk_pid285243 00:30:35.025 Removing: /var/run/dpdk/spdk_pid285497 00:30:35.025 Removing: /var/run/dpdk/spdk_pid285768 00:30:35.025 Removing: /var/run/dpdk/spdk_pid285773 00:30:35.025 Removing: /var/run/dpdk/spdk_pid286878 00:30:35.025 Removing: /var/run/dpdk/spdk_pid288108 00:30:35.025 Removing: /var/run/dpdk/spdk_pid289320 00:30:35.025 Removing: /var/run/dpdk/spdk_pid290533 00:30:35.025 Removing: /var/run/dpdk/spdk_pid291750 00:30:35.025 Removing: /var/run/dpdk/spdk_pid293085 00:30:35.025 Removing: /var/run/dpdk/spdk_pid296979 00:30:35.025 Removing: /var/run/dpdk/spdk_pid297322 00:30:35.025 Removing: /var/run/dpdk/spdk_pid298758 00:30:35.025 Removing: /var/run/dpdk/spdk_pid299523 00:30:35.025 Removing: /var/run/dpdk/spdk_pid303935 00:30:35.025 Removing: /var/run/dpdk/spdk_pid306132 00:30:35.025 Removing: /var/run/dpdk/spdk_pid309757 00:30:35.025 Removing: /var/run/dpdk/spdk_pid313456 00:30:35.025 Removing: /var/run/dpdk/spdk_pid317064 00:30:35.025 Removing: /var/run/dpdk/spdk_pid317605 00:30:35.025 Removing: /var/run/dpdk/spdk_pid318030 00:30:35.025 Removing: /var/run/dpdk/spdk_pid318452 00:30:35.025 Removing: /var/run/dpdk/spdk_pid319045 00:30:35.025 Removing: /var/run/dpdk/spdk_pid319599 00:30:35.025 Removing: /var/run/dpdk/spdk_pid320153 00:30:35.025 Removing: /var/run/dpdk/spdk_pid320708 00:30:35.025 Removing: /var/run/dpdk/spdk_pid323383 00:30:35.025 Removing: /var/run/dpdk/spdk_pid323648 00:30:35.025 Removing: /var/run/dpdk/spdk_pid327510 00:30:35.025 Removing: /var/run/dpdk/spdk_pid327691 00:30:35.025 Removing: /var/run/dpdk/spdk_pid329368 00:30:35.025 Removing: /var/run/dpdk/spdk_pid335252 00:30:35.025 Removing: /var/run/dpdk/spdk_pid335259 00:30:35.025 Removing: /var/run/dpdk/spdk_pid338329 00:30:35.025 Removing: /var/run/dpdk/spdk_pid339650 00:30:35.025 Removing: /var/run/dpdk/spdk_pid341094 00:30:35.025 Removing: /var/run/dpdk/spdk_pid341974 00:30:35.025 Removing: /var/run/dpdk/spdk_pid343420 00:30:35.025 Removing: /var/run/dpdk/spdk_pid344326 00:30:35.025 Removing: /var/run/dpdk/spdk_pid349840 00:30:35.025 Removing: /var/run/dpdk/spdk_pid350244 00:30:35.025 Removing: /var/run/dpdk/spdk_pid350647 00:30:35.025 Removing: /var/run/dpdk/spdk_pid352174 00:30:35.025 Removing: /var/run/dpdk/spdk_pid352536 00:30:35.025 Removing: /var/run/dpdk/spdk_pid352959 00:30:35.025 Removing: /var/run/dpdk/spdk_pid78112 00:30:35.025 Removing: /var/run/dpdk/spdk_pid78870 00:30:35.025 Removing: /var/run/dpdk/spdk_pid79827 00:30:35.025 Removing: /var/run/dpdk/spdk_pid80325 00:30:35.025 Removing: /var/run/dpdk/spdk_pid81657 00:30:35.025 Removing: /var/run/dpdk/spdk_pid82731 00:30:35.025 Removing: /var/run/dpdk/spdk_pid83165 00:30:35.025 Removing: /var/run/dpdk/spdk_pid83766 00:30:35.025 Removing: /var/run/dpdk/spdk_pid84114 00:30:35.025 Removing: /var/run/dpdk/spdk_pid84314 00:30:35.025 Removing: /var/run/dpdk/spdk_pid84608 00:30:35.025 Removing: /var/run/dpdk/spdk_pid84762 00:30:35.025 Removing: /var/run/dpdk/spdk_pid84951 00:30:35.025 Removing: /var/run/dpdk/spdk_pid85433 00:30:35.025 Removing: /var/run/dpdk/spdk_pid88065 00:30:35.025 Removing: /var/run/dpdk/spdk_pid88270 00:30:35.025 Removing: /var/run/dpdk/spdk_pid88564 00:30:35.025 Removing: /var/run/dpdk/spdk_pid88699 00:30:35.025 Removing: /var/run/dpdk/spdk_pid89016 00:30:35.025 Removing: /var/run/dpdk/spdk_pid89152 00:30:35.025 Removing: /var/run/dpdk/spdk_pid89593 00:30:35.025 Removing: /var/run/dpdk/spdk_pid89732 00:30:35.025 Removing: /var/run/dpdk/spdk_pid89905 00:30:35.025 Removing: /var/run/dpdk/spdk_pid90047 00:30:35.025 Removing: /var/run/dpdk/spdk_pid90213 00:30:35.025 Removing: /var/run/dpdk/spdk_pid90355 00:30:35.025 Removing: /var/run/dpdk/spdk_pid90739 00:30:35.025 Removing: /var/run/dpdk/spdk_pid90935 00:30:35.025 Removing: /var/run/dpdk/spdk_pid91226 00:30:35.025 Removing: /var/run/dpdk/spdk_pid91396 00:30:35.025 Removing: /var/run/dpdk/spdk_pid91549 00:30:35.025 Removing: /var/run/dpdk/spdk_pid91605 00:30:35.025 Removing: /var/run/dpdk/spdk_pid91754 00:30:35.025 Removing: /var/run/dpdk/spdk_pid92033 00:30:35.025 Removing: /var/run/dpdk/spdk_pid92177 00:30:35.025 Removing: /var/run/dpdk/spdk_pid92336 00:30:35.025 Removing: /var/run/dpdk/spdk_pid92607 00:30:35.283 Removing: /var/run/dpdk/spdk_pid92768 00:30:35.283 Removing: /var/run/dpdk/spdk_pid92911 00:30:35.283 Removing: /var/run/dpdk/spdk_pid93205 00:30:35.283 Removing: /var/run/dpdk/spdk_pid93350 00:30:35.283 Removing: /var/run/dpdk/spdk_pid93516 00:30:35.283 Removing: /var/run/dpdk/spdk_pid93737 00:30:35.283 Removing: /var/run/dpdk/spdk_pid93962 00:30:35.283 Removing: /var/run/dpdk/spdk_pid94100 00:30:35.283 Removing: /var/run/dpdk/spdk_pid94261 00:30:35.283 Removing: /var/run/dpdk/spdk_pid94528 00:30:35.283 Removing: /var/run/dpdk/spdk_pid94689 00:30:35.283 Removing: /var/run/dpdk/spdk_pid94827 00:30:35.283 Removing: /var/run/dpdk/spdk_pid95115 00:30:35.283 Removing: /var/run/dpdk/spdk_pid95258 00:30:35.283 Removing: /var/run/dpdk/spdk_pid95413 00:30:35.283 Removing: /var/run/dpdk/spdk_pid95656 00:30:35.283 Removing: /var/run/dpdk/spdk_pid95840 00:30:35.283 Removing: /var/run/dpdk/spdk_pid95985 00:30:35.283 Removing: /var/run/dpdk/spdk_pid96151 00:30:35.283 Removing: /var/run/dpdk/spdk_pid96411 00:30:35.283 Removing: /var/run/dpdk/spdk_pid96566 00:30:35.283 Removing: /var/run/dpdk/spdk_pid96712 00:30:35.283 Removing: /var/run/dpdk/spdk_pid96984 00:30:35.283 Removing: /var/run/dpdk/spdk_pid97139 00:30:35.283 Removing: /var/run/dpdk/spdk_pid97293 00:30:35.283 Removing: /var/run/dpdk/spdk_pid97559 00:30:35.283 Removing: /var/run/dpdk/spdk_pid97717 00:30:35.283 Removing: /var/run/dpdk/spdk_pid97867 00:30:35.283 Removing: /var/run/dpdk/spdk_pid98096 00:30:35.283 Removing: /var/run/dpdk/spdk_pid98293 00:30:35.283 Removing: /var/run/dpdk/spdk_pid98461 00:30:35.283 Removing: /var/run/dpdk/spdk_pid98614 00:30:35.283 Removing: /var/run/dpdk/spdk_pid98882 00:30:35.283 Removing: /var/run/dpdk/spdk_pid99025 00:30:35.283 Removing: /var/run/dpdk/spdk_pid99211 00:30:35.283 Removing: /var/run/dpdk/spdk_pid99390 00:30:35.283 Removing: /var/run/dpdk/spdk_pid99601 00:30:35.283 Clean 00:30:35.283 killing process with pid 50290 00:30:43.397 killing process with pid 50279 00:30:43.397 killing process with pid 50288 00:30:43.397 killing process with pid 50283 00:30:43.397 23:23:09 -- common/autotest_common.sh@1446 -- # return 0 00:30:43.397 23:23:09 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:43.397 23:23:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:43.397 23:23:09 -- common/autotest_common.sh@10 -- # set +x 00:30:43.657 23:23:09 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:43.657 23:23:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:43.657 23:23:09 -- common/autotest_common.sh@10 -- # set +x 00:30:43.657 23:23:09 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:43.657 23:23:09 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:43.657 23:23:09 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:43.657 23:23:09 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:43.657 23:23:09 -- spdk/autotest.sh@383 -- # hostname 00:30:43.657 23:23:09 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:43.657 geninfo: WARNING: invalid characters removed from testname! 00:31:10.197 23:23:35 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:13.479 23:23:39 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:16.008 23:23:42 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:18.534 23:23:44 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:21.093 23:23:47 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:23.627 23:23:49 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:26.909 23:23:52 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:26.909 23:23:52 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:26.909 23:23:52 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:26.909 23:23:52 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:26.909 23:23:52 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:26.909 23:23:52 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:26.909 23:23:52 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:26.909 23:23:52 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:26.909 23:23:52 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:26.909 23:23:52 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:26.909 23:23:52 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:26.909 23:23:52 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:26.909 23:23:52 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:26.909 23:23:52 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:26.909 23:23:52 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:26.909 23:23:52 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:26.909 23:23:52 -- scripts/common.sh@343 -- $ case "$op" in 00:31:26.909 23:23:52 -- scripts/common.sh@344 -- $ : 1 00:31:26.909 23:23:52 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:26.909 23:23:52 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:26.909 23:23:52 -- scripts/common.sh@364 -- $ decimal 1 00:31:26.909 23:23:52 -- scripts/common.sh@352 -- $ local d=1 00:31:26.909 23:23:52 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:26.909 23:23:52 -- scripts/common.sh@354 -- $ echo 1 00:31:26.909 23:23:52 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:26.909 23:23:52 -- scripts/common.sh@365 -- $ decimal 2 00:31:26.909 23:23:52 -- scripts/common.sh@352 -- $ local d=2 00:31:26.909 23:23:52 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:26.909 23:23:52 -- scripts/common.sh@354 -- $ echo 2 00:31:26.909 23:23:52 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:26.909 23:23:52 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:26.909 23:23:52 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:26.909 23:23:52 -- scripts/common.sh@367 -- $ return 0 00:31:26.909 23:23:52 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:26.909 23:23:52 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:26.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.909 --rc genhtml_branch_coverage=1 00:31:26.909 --rc genhtml_function_coverage=1 00:31:26.909 --rc genhtml_legend=1 00:31:26.909 --rc geninfo_all_blocks=1 00:31:26.909 --rc geninfo_unexecuted_blocks=1 00:31:26.909 00:31:26.909 ' 00:31:26.909 23:23:52 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:26.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.909 --rc genhtml_branch_coverage=1 00:31:26.909 --rc genhtml_function_coverage=1 00:31:26.909 --rc genhtml_legend=1 00:31:26.909 --rc geninfo_all_blocks=1 00:31:26.909 --rc geninfo_unexecuted_blocks=1 00:31:26.909 00:31:26.909 ' 00:31:26.909 23:23:52 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:26.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.909 --rc genhtml_branch_coverage=1 00:31:26.909 --rc genhtml_function_coverage=1 00:31:26.909 --rc genhtml_legend=1 00:31:26.909 --rc geninfo_all_blocks=1 00:31:26.909 --rc geninfo_unexecuted_blocks=1 00:31:26.909 00:31:26.909 ' 00:31:26.909 23:23:52 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:26.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.909 --rc genhtml_branch_coverage=1 00:31:26.909 --rc genhtml_function_coverage=1 00:31:26.909 --rc genhtml_legend=1 00:31:26.909 --rc geninfo_all_blocks=1 00:31:26.909 --rc geninfo_unexecuted_blocks=1 00:31:26.909 00:31:26.909 ' 00:31:26.909 23:23:52 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:26.909 23:23:52 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:26.909 23:23:52 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:26.909 23:23:52 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:26.909 23:23:52 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.909 23:23:52 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.909 23:23:52 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.909 23:23:52 -- paths/export.sh@5 -- $ export PATH 00:31:26.909 23:23:52 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.909 23:23:52 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:26.909 23:23:52 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:26.909 23:23:52 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732659832.XXXXXX 00:31:26.909 23:23:52 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732659832.ffnwpR 00:31:26.909 23:23:52 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:26.909 23:23:52 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:26.910 23:23:52 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:26.910 23:23:52 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:26.910 23:23:52 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:26.910 23:23:52 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:26.910 23:23:52 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:26.910 23:23:52 -- common/autotest_common.sh@10 -- $ set +x 00:31:26.910 23:23:52 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:26.910 23:23:52 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:26.910 23:23:52 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:26.910 23:23:52 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:26.910 23:23:52 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:26.910 23:23:52 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:26.910 23:23:52 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:26.910 23:23:52 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:26.910 23:23:52 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:26.910 23:23:52 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:26.910 23:23:52 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:26.910 + [[ -n 7323 ]] 00:31:26.910 + sudo kill 7323 00:31:26.921 [Pipeline] } 00:31:26.936 [Pipeline] // stage 00:31:26.941 [Pipeline] } 00:31:26.955 [Pipeline] // timeout 00:31:26.960 [Pipeline] } 00:31:26.974 [Pipeline] // catchError 00:31:26.979 [Pipeline] } 00:31:26.994 [Pipeline] // wrap 00:31:27.000 [Pipeline] } 00:31:27.012 [Pipeline] // catchError 00:31:27.021 [Pipeline] stage 00:31:27.024 [Pipeline] { (Epilogue) 00:31:27.036 [Pipeline] catchError 00:31:27.038 [Pipeline] { 00:31:27.050 [Pipeline] echo 00:31:27.052 Cleanup processes 00:31:27.057 [Pipeline] sh 00:31:27.346 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:27.346 364958 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:27.361 [Pipeline] sh 00:31:27.647 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:27.647 ++ grep -v 'sudo pgrep' 00:31:27.647 ++ awk '{print $1}' 00:31:27.647 + sudo kill -9 00:31:27.647 + true 00:31:27.660 [Pipeline] sh 00:31:27.948 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:37.956 [Pipeline] sh 00:31:38.244 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:38.244 Artifacts sizes are good 00:31:38.262 [Pipeline] archiveArtifacts 00:31:38.272 Archiving artifacts 00:31:38.715 [Pipeline] sh 00:31:39.000 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:39.017 [Pipeline] cleanWs 00:31:39.029 [WS-CLEANUP] Deleting project workspace... 00:31:39.029 [WS-CLEANUP] Deferred wipeout is used... 00:31:39.037 [WS-CLEANUP] done 00:31:39.039 [Pipeline] } 00:31:39.058 [Pipeline] // catchError 00:31:39.072 [Pipeline] sh 00:31:39.361 + logger -p user.info -t JENKINS-CI 00:31:39.370 [Pipeline] } 00:31:39.386 [Pipeline] // stage 00:31:39.392 [Pipeline] } 00:31:39.408 [Pipeline] // node 00:31:39.415 [Pipeline] End of Pipeline 00:31:39.453 Finished: SUCCESS